Do you know how many tokens per second you are getting? I have a similar laptop ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

jhickok on Jan 30, 2025 | parent | context | favorite | on: Mistral Small 3

Do you know how many tokens per second you are getting? I have a similar laptop that I can test on later but if you have that info handy let me know!

snickell on Jan 30, 2025 [–]

M2 max with 64GB: 14 tokens/s running `ollama run mistral-small:24b --verbose`

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact