AI researcher Oguz Eldereli released a new training method called TTF that reduces memory use from 16 bytes to one byte per weight. The technique allows developers to train 27 billion parameter models directly on consumer gaming graphics cards.
FireBrief
FireBrief