Ask HN: What's the best hardware to run small/medium models locally? - Webb Industries

Ask HN: What's the best hardware to run small/medium models locally?

74 points by triyambakam - 512 Days, 0 Hour ago Hacker News

M2 MacBook? A certain graphics card? Running inference on CPU on my old Thinkpad isn't fun.

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...