Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

At the risk of torturing this analogy beyond recognition, it’s more like having an 8 core CPU but with a weak 150W PSU such that you can only run one core at a time.


Analogy sufficiently tortured


Is each core specialized to some particular type of task or something like that? Which would make this less silly of an idea.


in my understanding with an 8 way MoE youre still running all 8 for every request. only if you’re making a router model then itd be the “weak PSU” analogy. and even then a sufficiently perfect router would essentially have to know enough about its routes to almost simulate them which idk if i can believe works




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: