Technology

Not even another info transferring entity would solve it. Be it quantum computers, photonic computers, at the end of the day we'd be simply brute forcing the problem harder, due to increased processing power. But we need something else than brute force due to the diminishing returns.

Just to give you an idea. A human needs around 2400kcal/day to survive, or 100kcal/h = 116W. Only 20% of that is taken by the brain, so ~23W. (I bet that most of that is used for motor control, not reasoning.) We clearly suck as computing machines, and yet our output is considerably better than the junk yielded by LLMs and diffusion models, even if you use a really nice computer and let the model take its time producing its [babble | six fingers "art"]. Those models are clearly doing lots of unnecessary operations, while failing hard at what they're expected to do.

Regarding research, my point is that what's going to fix generative models is likely from outside the field of artificial intelligence. It'll be likely something small and barely related, that happens to have some ML application.