Hardware

5630 readers

5 users here now

This is a community dedicated to the hardware aspect of technology, from PC parts, to gadgets, to servers, to industrial control equipment, to semiconductors.

Rules:

Posts must be relevant to electronic hardware
No NSFW content
No hate speech, bigotry, etc

founded 5 years ago

Recommendations for External GPU Docks for Home Lab Use (lemmy.ml)

submitted 1 week ago by [email protected] to c/[email protected]

2 comments fedilink hide all child comments

Hi, currently have a spare GeForce 1060 lying around collecting dust.

Planning to use it with Ollama for self-hosting my own AI model or maybe even for AI training.

Problem is, none of my home lab devices have a compatible connection to the GPU’s GPIO. My current setup includes:

Beelink MINI S12 Intel Alder Lake N100
Raspberry Pi 5
Le Potato AML-S905X-CC
Pi Picos

Would like to hear about recommendations or experiences with external GPU docks that I can use to connect my GPU to my home lab setup, thanks.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 4 points 1 week ago

You won't get much use out of a 1060 for AI. Maybe some toy models to learn but even then you might run into limitations with the older CUDA version