60 to 70 on a 5080, but only tinkering for now. The smaller models seem exceptio... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		politelemon 11 days ago \| parent \| context \| favorite \| on: Something is afoot in the land of Qwen 60 to 70 on a 5080, but only tinkering for now. The smaller models seem exceptionally good for what they are, and some can even do OCR reliably.

		help

cpburns2009 9 days ago [–]

What quantization are you running on the 5080? I'm waiting to receive mine.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact