Hugging Face's logo
Songhao Wu's picture
2 14

Songhao Wu

shwu
Datawitch-Programmer's profile picture Cardlnal's profile picture jxhong's profile picture
ยท
https://ericshwu.github.io/

AI & ML interests

Mixture-of-Experts Model, Language Model Pretraining

Recent Activity

upvoted a paper 3 days ago
LatentMoE: Toward Optimal Accuracy per FLOP and Parameter in Mixture of Experts
authored a paper 16 days ago
Redesign Mixture-of-Experts Routers with Manifold Power Iteration
upvoted a paper 16 days ago
Redesign Mixture-of-Experts Routers with Manifold Power Iteration
View all activity

Organizations

None yet