cm0002@lemmy.world to Technology@lemmy.worldEnglish · 2 months agoMajority of AI Researchers Say Tech Industry Is Pouring Billions Into a Dead Endfuturism.comexternal-linkmessage-square97fedilinkarrow-up1211arrow-down14
arrow-up1207arrow-down1external-linkMajority of AI Researchers Say Tech Industry Is Pouring Billions Into a Dead Endfuturism.comcm0002@lemmy.world to Technology@lemmy.worldEnglish · 2 months agomessage-square97fedilink
minus-squaredeegeese@sopuli.xyzlinkfedilinkEnglisharrow-up55·2 months agoOptimizing AI performance by “scaling” is lazy and wasteful. Reminds me of back in the early 2000s when someone would say don’t worry about performance, GHz will always go up.
minus-squareNoiseColor @lemmy.worldlinkfedilinkEnglisharrow-up13·2 months agoThing is, same as with GHz, you have to do it as much as you can until the gains get too small. You do that, then you move on to the next optimization. Like ai has and is now optimizing test time compute, token quality, and other areas.
minus-squarech00f@lemmy.worldlinkfedilinkEnglisharrow-up7·2 months agohttps://en.wikipedia.org/wiki/Wirth's_law
minus-squareAdrianTheFrog@lemmy.worldlinkfedilinkEnglisharrow-up1·2 months ago don’t worry about performance, GHz will always go up TF2 devs lol
Optimizing AI performance by “scaling” is lazy and wasteful.
Reminds me of back in the early 2000s when someone would say don’t worry about performance, GHz will always go up.
Thing is, same as with GHz, you have to do it as much as you can until the gains get too small. You do that, then you move on to the next optimization. Like ai has and is now optimizing test time compute, token quality, and other areas.
https://en.wikipedia.org/wiki/Wirth's_law
TF2 devs lol