Unable to load image

Bought a used mining rig

Since I've now listened to one (1) entire talk on AI, I am the world's foremost leading expert.

As such I will be running a localized llama 13B instance. For the first time in over a decade I've bought a PC that wasn't an HP workstation.

Specs:

H110 motherboard w/celeron and 4GB ram alongside Nvidia quadro 5200 8gb

Do you guys think it'll actually run a quantized llama? Is 500W PSU enough?

16
Jump in the discussion.

No email address required.

How much did you pay for it???

omg! For 800-1000 you can get a much better consumer rig

If you look up the quantized models on hugging face theyll tell you how much ram you need

Jump in the discussion.

No email address required.

So far this is my build :marseypoor:


Gigabyte H110 motherboard w/4gig DDR4 and celeron: $80

Power supply: :$70

32GB DDDR 2133: $70

Intel i3: $30

Gfx: some POS 2gb card, free

HDD: free

Antec case: $40

Total: $290 CAD

I am actually gonna run a quantized 7b which runs on android and pi, I'm no longer worried about specs. With 32GB ram i can hold the entire model in memory with room to spare. I am actually going to use it for searching a vector DB so it should actually run fairly quickly.

Jump in the discussion.

No email address required.

Link copied to clipboard
Action successful!
Error, please refresh the page and try again.