Bagua API Documentation
stable
API Documents
bagua
bagua.torch_api
bagua.torch_api.algorithms
bagua.torch_api.checkpoint
bagua.torch_api.contrib
bagua.torch_api.data_parallel
bagua.torch_api.model_parallel
bagua.torch_api.model_parallel.moe
bagua.torch_api.bucket
bagua.torch_api.communication
bagua.torch_api.distributed
bagua.torch_api.env
bagua.torch_api.tensor
Bagua API Documentation
Bagua API Documentation
»
bagua
»
bagua.torch_api
»
bagua.torch_api.model_parallel
»
bagua.torch_api.model_parallel.moe
»
bagua.torch_api.model_parallel.moe.experts
Edit on GitHub
bagua.torch_api.model_parallel.moe.experts
¶
Module Contents
¶
class
bagua.torch_api.model_parallel.moe.experts.
Experts
(
expert
,
num_local_experts
=
1
)
¶
Bases:
torch.nn.Module
forward
(
inputs
)
¶
Read the Docs
v: stable
Versions
latest
stable
v0.9.2
v0.9.1
v0.9.0
v0.8.2
v0.8.1.post1
v0.8.1
v0.8.0
v0.7.0
v0.6.3
v0.6.2
v0.6.1
v0.6.0
0.5.0
0.4.0
Downloads
html
On Read the Docs
Project Home
Builds
Free document hosting provided by
Read the Docs
.