Technology

Meanwhile a huge chunk of the software industry is now heavily using this "dead end" technology 👀

I work in a pretty massive tech company (think, the type that frequently acquires other smaller ones and absorbs them)

Everyone I know here is using it. A lot.

However my company also has tonnes of dedicated sessions and paid time to instruct it's employees on how to use it well, and to get good value out of it, abd the pitfalls it can have

So yeah turns out if you teach your employees how to use a tool, they start using it.

I'd say LLMs have made me about 3x as efficient or so at my job.

Technology in most cases progresses on a logarithmic scale when innovation isn't prioritized. We've basically reached the plateau of what LLMs can currently do without a breakthrough. They could absorb all the information on the internet and not even come close to what they say it is. These days we're in the "bells and whistles" phase where they add unnecessary bullshit to make it seem new like adding 5 cameras to a phone or adding touchscreens to cars. Things that make something seem fancy by slapping buzzwords and features nobody needs without needing to actually change anything but bump up the price.

Worst case scenario, I don't think money spent on supercomputers is the worst way to spend money. That in itself has brought chip design and development forward. Not to mention ai is already invaluable with a lot of science research. Invaluable!

Take a car that's stuck in reverse, slap a 454 Chevy big block in it. You'll have a car that still drives the wrong way; but faster.

I liked generative AI more when it was just a funny novelty and not being advertised to everyone under the false pretenses of being smart and useful. Its architecture is incompatible with actual intelligence, and anyone who thinks otherwise is just fooling themselves. (It does make an alright autocomplete though).

Imo our current version of ai are too generalized, we add so much information into the ai to make them good at everything it all mixes together into a single grey halucinating slop that the ai ends up being good at nothing.

We need to find ways to specialize ai and give said ai a more consistent and concrete personality to move forward.

Its not a dead end if you replace all big name search engines with this. Then slowly replace real results with your own. Then it accomplishes something.

Optimizing AI performance by “scaling” is lazy and wasteful.

Reminds me of back in the early 2000s when someone would say don’t worry about performance, GHz will always go up.

They're throwing billions upon billions into a technology with extremely limited use cases and a novelty, at best. My god, even drones fared better in the long run.