Ask HN: What's the best hardware to run small/medium models locally? - Webb Industries

Ask HN: What's the best hardware to run small/medium models locally?

74 points by triyambakam - 601 Days, 2 Hours ago Hacker News

M2 MacBook? A certain graphics card? Running inference on CPU on my old Thinkpad isn't fun.

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...