Doesn't need it at Q4 at least; it'll run in 64GB. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

dofm 56 days ago | parent | context | favorite | on: Qwen 3.6 27B is the sweet spot for local developme...

Doesn't need it at Q4 at least; it'll run in 64GB.

intothemild 55 days ago [–]

Q6 can run with 256k at Q4 on 32gb easy.

200k @ K : Q5_0 V: 4_1 (which is a bit of a sweet spot)

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact