Yann LeCun, Meta’s outgoing chief AI scientist, says his employer tested its latest Llama model in a way that may have made the model look better than it really was. 

In a recent Financial Times interview, LeCun says Meta researchers “fudged a little bit” by using different versions of Llama 4 Maverick and Llama 4 Scout models on different benchmarks to improve test results. Normally researchers use a single version of a new model for all benchmarks, instead of choosing a variant that........

© Fast Company