Ask HN: What's the best hardware to run small/medium models locally? - Webb Industries

Ask HN: What's the best hardware to run small/medium models locally?

74 points by triyambakam - 536 Days, 2 Hours ago Hacker News

M2 MacBook? A certain graphics card? Running inference on CPU on my old Thinkpad isn't fun.

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...