this post was submitted on 06 Sep 2024
860 points (97.4% liked)

Technology

60462 readers
3886 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
(page 5) 50 comments
sorted by: hot top controversial new old
[–] [email protected] 53 points 4 months ago (1 children)

Personally I can't wait for a few good bankruptcies so I can pick up a couple of high end data centre GPUs for cents on the dollar

[–] [email protected] 24 points 4 months ago* (last edited 4 months ago) (15 children)

Search Nvidia p40 24gb on eBay, 200$ each and surprisingly good for selfhosted llm, if you plan to build array of gpus then search for p100 16gb, same price but unlike p40, p100 supports nvlink, and these 16gb is hbm2 memory with 4096bit bandwidth so it's still competitive in llm field while p40 24gb is gddr5 so it's good point is amount of memory for money it cost but it's rather slow compared to p100 and compared to p100 it doesn't support nvlink

[–] [email protected] 3 points 4 months ago (1 children)

Personally I don't much for the LLM stuff, I'm more curious how they perform in Blender.

load more comments (1 replies)
load more comments (14 replies)
[–] [email protected] 100 points 4 months ago (2 children)

Shed a tear, if you wish, for Nvidia founder and Chief Executive Jenson Huang, whose fortune (on paper) fell by almost $10 billion that day.

Thanks, but I think I'll pass.

[–] [email protected] 44 points 4 months ago (5 children)

I’m sure he won’t mind. Worrying about that doesn’t sound like working.

I work from the moment I wake up to the moment I go to bed. I work seven days a week. When I'm not working, I'm thinking about working, and when I'm working, I'm working. I sit through movies, but I don't remember them because I'm thinking about work.

- Huang on his 14 hour workdays

It is one way to live.

[–] [email protected] 50 points 4 months ago* (last edited 4 months ago) (2 children)

That sounds like mental illness.

ETA: Replace "work" in that quote with practically any other activity/subject, whether outlandish or banal.

I sit through movies but I don't remember them because I'm thinking about baking cakes.

I sit through movies but I don't remember them because I'm thinking about traffic patterns.

I sit through movies but I don't remember them because I'm thinking about cannibalism.

I sit through movies but I don't remember them because I'm thinking about shitposting.

Obsessed with something? At best, you're "quirky" (depending on what you're obsessed with). Unless it's money. Being obsessed with that is somehow virtuous.

[–] [email protected] 16 points 4 months ago (1 children)

Valid argument for sure

It would be sad if therapists kept telling him that but he could never remember

[–] [email protected] 11 points 4 months ago (1 children)

"Sorry doc, was thinking about work. Did you say something about line go up?"

load more comments (1 replies)
load more comments (4 replies)
load more comments (1 replies)
[–] [email protected] 10 points 4 months ago* (last edited 4 months ago) (4 children)

Wether we like it or not AI is here to stay, and in 20-30 years, it’ll be as embedded in our lives as computers and smartphones are now.

[–] [email protected] 12 points 4 months ago* (last edited 4 months ago) (1 children)

Is there a "young man yells at clouds meme" here?

"Yes, you're very clever calling out the hype train. Oooh, what a smart boy you are!" Until the dust settles...

Lemmy sounds like my grandma in 1998, "Pushah. This 'internet' is just a fad.'"

load more comments (3 replies)
[–] [email protected] 5 points 4 months ago

I've spent time with an AI laptop the past couple of weeks and 'overinflated' seems a generous description of where end user AI is today.

[–] [email protected] 64 points 4 months ago* (last edited 4 months ago) (4 children)

I find it insane when "tech bros" and AI researchers at major tech companies try to justify the wasting of resources (like water and electricity) in order to achieve "AGI" or whatever the fuck that means in their wildest fantasies.

These companies have no accountability for the shit that they do and consistently ignore all the consequences their actions will cause for years down the road.

[–] [email protected] 30 points 4 months ago (3 children)

It's research. Most of it never pans out, so a lot of it is "wasteful". But if we didn't experiment, we wouldn't find the things that do work.

[–] [email protected] 25 points 4 months ago (6 children)

Most of the entire AI economy isn't even research. It's just grift. Slapping a label on ChatGPT and saying you're an AI company. It's hustlers trying to make a quick buck from easy venture capital money.

load more comments (6 replies)
[–] [email protected] 7 points 4 months ago (1 children)

I agree, but these researchers/scientists should be more mindful about the resources they use up in order to generate the computational power necessary to carry out their experiments. AI is good when it gets utilized to achieve a specific task, but funneling a lot of money and research towards general purpose AI just seems wasteful.

[–] [email protected] 8 points 4 months ago

I mean general purpose AI doesn't cap out at human intelligence, of which you could utilize to come up with ideas for better resource management.

Could also be a huge waste but the potential is there... potentially.

load more comments (1 replies)
load more comments (3 replies)
[–] [email protected] 7 points 4 months ago* (last edited 4 months ago) (1 children)

I just want computer parts to stop being so expensive. Remember when gaming was cheap? Pepperidge farm remembers. You used to be able to build a relatively high end pc for less than the average dogshit Walmart laptop.

[–] [email protected] 2 points 4 months ago

To be honest right now is a relatively good time to build a PC, except for the GPU, which is heavily overpriced. I think if you are content with last gen AMD, this can also be turned to somewhat acceptable levels.

[–] [email protected] 2 points 4 months ago

The fact that is is from LA Times shows that it's still significant though

load more comments
view more: ‹ prev next ›