HAPMoE proposes an automatic parallelism planner that handles both mixture-of-experts architectures and heterogeneous compute clusters for distributed training. It aims to derive efficient parallelism…

#MoE #DistributedTraining #AutoParallelism #AIResearch
https://arxiv.org/abs/2609.39350