Data scaling and compute scaling are *multipliers* for the generalization power of an approach. Trillions of dollars in investment can make very inefficient, low-generalization approaches look adequate, but that doesn't make them the ultimate end-all-be-all of AI. You should work on methods that *can* scale, because if you don't benefit from this multiplier you simply can't compete. But you should keep in mind scaling is only a multiplier: a cleverer approach will scale *better*.
— François Chollet (@fchollet) November 7, 2026
Saturday, November 7, 2026
Scaling is only a multiplier; we need to work on developing new approaches
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment