Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
MacsHeadroom
on Dec 9, 2023
|
parent
|
context
|
favorite
| on:
Mistral "Mixtral" 8x7B 32k model [magnet]
The answer is yes if you have a 24GB GPU. Just wait for 4bit quantization.
Or watch Tim Dettmers, who is releasing code to run Mixtral 8x7b in just 4GB of RAM.
Consider applying for YC's Fall 2026 batch!
Applications
are open till July 27.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
Or watch Tim Dettmers, who is releasing code to run Mixtral 8x7b in just 4GB of RAM.