You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
2. Please use English, otherwise it will be closed.
Motivation
The code for EP and block wise FP8 required by V3 is available separately. The task is to integrate block wise FP8 into the current DeepSeek V2 EP, based on the previous integration of Fused MoE with block wise FP8.
Checklist
Motivation
The code for EP and block wise FP8 required by V3 is available separately. The task is to integrate block wise FP8 into the current DeepSeek V2 EP, based on the previous integration of Fused MoE with block wise FP8.
ref
https://github.com/sgl-project/sglang/tree/main/python/sglang/srt/layers/moe/ep_moe
#2575
Related resources
No response
The text was updated successfully, but these errors were encountered: