Meta’s storied AI research lab faces existential questions amid leadership changes and internal reshuffling—while its founder insists it’s just entering a new chapter.
For example, as a coding assistant, a lot of people quite like them. But as a replacement for a human coder, they’re a disaster.
New technology is best when it can meaningfully improve the productivity of a group of people so that the group can shrink. The technology doesn’t take any one identifiable job, but now an organization of 10 people, properly organized in a way conscious of that technology’s capabilities and limitations, can do what used to require 12.
A forklift and a bunch of pallets can make a warehouse more efficient, when everyone who works in that warehouse knows how the forklift is best used, even when not everyone is a forklift operator themselves.
Same with a white collar office where there’s less need for people physically scheduling things and taking messages, because everyone knows how to use an electronic calendar and email system for coordinating those things. There might still be need for pooled assistants and secretaries, but maybe not as many in any given office as before.
So when we need an LLM to chip in and reduce the amount of time a group of programmers need in order to put out a product, the manager of that team, and all the members of that team, need to have a good sense of what that LLM is good at and what it isn’t. Obviously autocomplete has always been a productivity enhancer for long before LLMs have been around, and extensions of that general concept may be helpful for the more tedious or repetitive tasks, but any team that uses it will need to use it with full knowledge of its limitations and where it best supplements the human’s own tasks.
I have no doubt that some things will improve and people will find workflows that leverage the strengths while avoiding the weaknesses. But it remains to be seen whether it’ll be worth the sheer amount of cost spent so far.
That’s true but at least one of these things needs to happen:
the forklift costs billions and consumes tons of energy, but it can lift a whole mountain, which no group of humans can do
the forklift helps a team of 10 do the work of 50 and, while still relatively expensive, it costs less than the 40 people it’s replacing
the forklift becomes an inexpensive commodity and it augments human capabilities and creates new possibilities for society as a whole
This is roughly what happened with mainframes to personal computers to mobile devices. LLMs are stuck between 1 and 2, they are not good enough forklifts to lift a mountain and not cheap enough to replace 40 people and save money. There are some hints that they could at one point move to 3 but the large players that could make it happen are starting to be scared by the amount of investment to get there.
On a related note, lot of people are being fooled by this hype machine mixing GenAI with good “old” machine learning and you now read about all these “AI wins” like “student discovers new galaxies with AI” or “scientist discover new medicines with AI” that make it sound like these people just asked ChatGPT “how would you go about discovering a new galaxy?” or “could you make up a new drug for me pretty please?”.
New technology is best when it can meaningfully improve the productivity of a group of people so that the group can shrink. The technology doesn’t take any one identifiable job, but now an organization of 10 people, properly organized in a way conscious of that technology’s capabilities and limitations, can do what used to require 12.
A forklift and a bunch of pallets can make a warehouse more efficient, when everyone who works in that warehouse knows how the forklift is best used, even when not everyone is a forklift operator themselves.
Same with a white collar office where there’s less need for people physically scheduling things and taking messages, because everyone knows how to use an electronic calendar and email system for coordinating those things. There might still be need for pooled assistants and secretaries, but maybe not as many in any given office as before.
So when we need an LLM to chip in and reduce the amount of time a group of programmers need in order to put out a product, the manager of that team, and all the members of that team, need to have a good sense of what that LLM is good at and what it isn’t. Obviously autocomplete has always been a productivity enhancer for long before LLMs have been around, and extensions of that general concept may be helpful for the more tedious or repetitive tasks, but any team that uses it will need to use it with full knowledge of its limitations and where it best supplements the human’s own tasks.
I have no doubt that some things will improve and people will find workflows that leverage the strengths while avoiding the weaknesses. But it remains to be seen whether it’ll be worth the sheer amount of cost spent so far.
That’s true but at least one of these things needs to happen:
the forklift costs billions and consumes tons of energy, but it can lift a whole mountain, which no group of humans can do
the forklift helps a team of 10 do the work of 50 and, while still relatively expensive, it costs less than the 40 people it’s replacing
the forklift becomes an inexpensive commodity and it augments human capabilities and creates new possibilities for society as a whole
This is roughly what happened with mainframes to personal computers to mobile devices. LLMs are stuck between 1 and 2, they are not good enough forklifts to lift a mountain and not cheap enough to replace 40 people and save money. There are some hints that they could at one point move to 3 but the large players that could make it happen are starting to be scared by the amount of investment to get there.
On a related note, lot of people are being fooled by this hype machine mixing GenAI with good “old” machine learning and you now read about all these “AI wins” like “student discovers new galaxies with AI” or “scientist discover new medicines with AI” that make it sound like these people just asked ChatGPT “how would you go about discovering a new galaxy?” or “could you make up a new drug for me pretty please?”.