Ask HN: What's the best hardware to run small/medium models locally? - Webb Industries

Ask HN: What's the best hardware to run small/medium models locally?

74 points by triyambakam - 630 Days, 14 Hours ago Hacker News

M2 MacBook? A certain graphics card? Running inference on CPU on my old Thinkpad isn't fun.

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...