Developer Herman Brunborg cut the NanoGPT Speedrun benchmark time from 39.9 seconds to 6.7 seconds. He achieved the 83.2 percent speedup by feeding retrieval-augmented phrase hints into the model from previously idle CPUs.
FireBrief
FireBrief