Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

After digging it looks like 70B Q4 requires 35GB or so. So yes the AMD comparison is a strix halo not swapping vs a 4090 that is swapping. Seems kinda misleading, but is a real advantage for larger models.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: