196

16190 readers

2151 users here now

Be sure to follow the rule before you head out.

Rule: You must post before you leave.

^other^ ^rules^

founded 1 year ago

MODERATORS

[email protected]

654

The Rule (lemmy.ml)

submitted 1 month ago by [email protected] to c/[email protected]

63 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 86 points 1 month ago (31 children)

I doubt this person actually had a computer than could run the 405b model. You need over 200gb of ram, let alone having enough vram to run it with gpu acceleration.

[–] [email protected] 89 points 1 month ago* (last edited 1 month ago) (5 children)

simple, just create 200GB of swap space and convince yourself that you really are patient enough to spend 3 days unable to use your computer while it uses its entire CPU and disk bandwidth to run ollama (and hate your SSD enough to let it spend 3 days constantly swapping)

[–] [email protected] 13 points 1 month ago (1 children)

SSD, huh? Real AI enthusiasts swap with an HDD.

[–] [email protected] 7 points 1 month ago

I don't have any spare HDs but I can swap on a rewritable optical disc.

load more comments (3 replies)

load more comments (28 replies)