Bagua API Documentation
v0.8.1.post1

API Documents

  • bagua
    • bagua.torch_api
      • bagua.torch_api.algorithms
      • bagua.torch_api.checkpoint
      • bagua.torch_api.contrib
      • bagua.torch_api.model_parallel
        • bagua.torch_api.model_parallel.moe
      • bagua.torch_api.bucket
      • bagua.torch_api.communication
      • bagua.torch_api.distributed
      • bagua.torch_api.env
      • bagua.torch_api.tensor
Bagua API Documentation
  • Bagua API Documentation »
  • bagua »
  • bagua.torch_api »
  • bagua.torch_api.model_parallel
  • Edit on GitHub

bagua.torch_api.model_parallel¶

Subpackages¶

  • bagua.torch_api.model_parallel.moe
    • bagua.torch_api.model_parallel.moe.experts
    • bagua.torch_api.model_parallel.moe.layer
    • bagua.torch_api.model_parallel.moe.sharded_moe
Next Previous

© Copyright 2021, Kuaishou AI Platform and DS3 Lab Revision dc578eed.

Read the Docs v: v0.8.1.post1
Versions
latest
stable
v0.8.1.post1
v0.8.1
v0.8.0
v0.7.0
v0.6.3
v0.6.2
v0.6.1
v0.6.0
0.5.0
0.4.0
Downloads
On Read the Docs
Project Home
Builds
Free document hosting provided by Read the Docs.