bagua.torch_api.model_parallel.moe.experts¶

Module Contents¶

class bagua.torch_api.model_parallel.moe.experts.Experts(expert, num_local_experts=1)¶

Bases: torch.nn.Module