Bagua API Documentation
v0.8.2
API Documents
bagua
bagua.torch_api
bagua.torch_api.algorithms
bagua.torch_api.checkpoint
bagua.torch_api.contrib
bagua.torch_api.model_parallel
bagua.torch_api.model_parallel.moe
bagua.torch_api.bucket
bagua.torch_api.communication
bagua.torch_api.distributed
bagua.torch_api.env
bagua.torch_api.tensor
Bagua API Documentation
Bagua API Documentation
»
bagua
»
bagua.torch_api
»
bagua.torch_api.model_parallel
»
bagua.torch_api.model_parallel.moe
»
bagua.torch_api.model_parallel.moe.experts
Edit on GitHub
bagua.torch_api.model_parallel.moe.experts
¶
Module Contents
¶
class
bagua.torch_api.model_parallel.moe.experts.
Experts
(
expert
,
num_local_experts
=
1
)
¶
Bases:
torch.nn.Module
forward
(
self
,
inputs
)
¶
Read the Docs
v: v0.8.2
Versions
latest
stable
v0.8.2
v0.8.1.post1
v0.8.1
v0.8.0
v0.7.0
v0.6.3
v0.6.2
v0.6.1
v0.6.0
0.5.0
0.4.0
Downloads
On Read the Docs
Project Home
Builds
Free document hosting provided by
Read the Docs
.