All modules for which code is available
- fairscale.experimental.nn.data_parallel.gossip.distributed
- fairscale.experimental.nn.offload
- fairscale.nn.checkpoint.checkpoint_activations
- fairscale.nn.data_parallel.fully_sharded_data_parallel
- fairscale.nn.data_parallel.sharded_ddp
- fairscale.nn.moe.moe_layer
- fairscale.nn.pipe.pipe
- fairscale.optim.adascale
- fairscale.optim.oss