bagua.torch_api.model_parallel.moe.experts

Module Contents

class bagua.torch_api.model_parallel.moe.experts.Experts(expert, num_local_experts=1)

Bases: torch.nn.Module

forward(self, inputs)