15 t/s way too slow for anything but chatting, call and response, and you don't ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		yieldcrv 3 months ago \| parent \| context \| favorite \| on: macOS 26.2 enables fast AI clusters with RDMA over... 15 t/s way too slow for anything but chatting, call and response, and you don't need a 3T parameter model for that Wake me up when the situation improves

rbanffy 3 months ago [–]

Just wait for the M5-Ultra with a terabyte of RAM.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact