I trained a 30M-param LLM from scratch and the scaling "floor" was a mirage
5 points by rpadhye 7 hours ago | 0 comments