There has been a bit of hyperbole of late about energy saving AI.
There isn't a magic bullet here, it's just people improving a relatively new technology. Even though the underlying neural nets are fairly old now, the newness of transformers and the newness of the massive scale means there's quite a lot of low hanging fruit still. Some of the best minds are on this problem and are reaching for the hardest to get fruit.
A lot of these advancements work well together improving efficiency a few percent here, a few percent there.
This is a good thing, but people are doing crazy comparisons by extrapolating older tech into future use cases.
This is like estimating the impact of cars by correctly guessing that there are 1.4 Billion cars in the world and multiplying that by the impact of a single model-T Ford.
There isn't a magic bullet here, it's just people improving a relatively new technology. Even though the underlying neural nets are fairly old now, the newness of transformers and the newness of the massive scale means there's quite a lot of low hanging fruit still. Some of the best minds are on this problem and are reaching for the hardest to get fruit.
A lot of these advancements work well together improving efficiency a few percent here, a few percent there.
This is a good thing, but people are doing crazy comparisons by extrapolating older tech into future use cases.
This is like estimating the impact of cars by correctly guessing that there are 1.4 Billion cars in the world and multiplying that by the impact of a single model-T Ford.