The AI industry’s massive bet on transformer models may not be enough for true AGI

As Big Tech pours unprecedented resources into scaling large language models, critics argue that transformer-based systems face fundamental limitations.

[Images: Adobe Stock]

Welcome to AI Decoded, Fast Company’s weekly newsletter that breaks down the most important news in the world of AI. You can sign up to receive this newsletter every week via email here.

Are the biggest AI labs betting on the wrong horse?

Big AI companies are betting nearly all of their R&D and capital expenditure on the idea that pre-trained transformer models can deliver AI with human-level general intelligence. This approach relies heavily on backpropagation, the standard algorithm used to train deep neural........

© Fast Company