Simply increasing the number of GPUs will provide diminishing returns. Computer scientists are therefore looking for cleverer, less resource-intensive ways to train future AI models.
Up to this point the decreasing return from applying more labour to a given capital equipment has been offset by the acquiescence of labour in a diminishing real wage.
KEVIN SCOTT: I think the other interesting thing here is, again, I do have a point of view about whether or not we're reaching the point of diminishing marginal returns on model power.
This is the long-tail problem of AI.If you were to take all current and potential AI projects and sort them in decreasing order of value and plot them, you get a graph that looks like this.
这是 AI 的长尾问题。如果你将所有当前和潜在的 AI 项目按照价值的递减顺序对它们进行排序并绘制它们,你会得到一个看起来像这样的图表。
In each home, his team attached one of two large cardboard panels to a doorframe. One panel had five holes of the same height but decreasing width. The other had five holes of the same width but decreasing height.