Which conveniently fits on one 8xH100 machine. With 100-200 GB left over for ove... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		wongarsu 42 days ago \| parent \| context \| favorite \| on: Kimi Released Kimi K2.5, Open-Source Visual SOTA-A... Which conveniently fits on one 8xH100 machine. With 100-200 GB left over for overhead, kv-cache, etc.

storystarling 42 days ago [–]

The unit economics seem pretty rough though. You're locking up 8xH100s for the compute of ~32B active parameters. I guess memory is the bottleneck but hard to see how the margins work on that.

kristianp 41 days ago | [–]

Yes, it only makes sense economically if you have batching over many users.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact