PyTorch



Automatic Differentiation



Automatic Mixed Precision



Backends



CUDA



Datasets and Data Loaders



DDP Communication Hooks

torch.distributed.algorithms.ddp_comm_hooks.powerSGD_hook.PowerSGDState.__setstate__()
torch.distributed.algorithms.ddp_comm_hooks.powerSGD_hook.powerSGD_hook()


Discrete Fourier Transforms



Distributed Checkpoint



Distributed Communication



Distributed Elastic

torch.distributed.elastic.rendezvous.RendezvousTimeoutError
torch.distributed.elastic.rendezvous.dynamic_rendezvous.RendezvousTimeout.close
torch.distributed.elastic.rendezvous.etcd_rendezvous_backend.EtcdRendezvousBackend.get_state()


Distributed Optimizers



Distributed RPC



Fully Sharded Data Parallel

torch.distributed.fsdp.FullyShardedDataParallel.apply()
torch.distributed.fsdp.FullyShardedDataParallel.optim_state_dict()


FX



JAX-like Function Transforms



Linear Algebra



Miscellaneous

torch.compiler.TorchDynamo APIs for fine-grained tracing


Monitor



MPS



Neuro Network



NN Functions



ONNX

torch.onnx.TorchDynamo-based ONNX Exporter.FXE0012:unsupported-fx-node-analysis
torch.onnx.TorchDynamo-based ONNX Exporter.FXE0016:find-operator-overloads-in-onnx-registry


Optimization



Package



Parameter Initializations



Probability Distributions

torch.distributions.categorical.Categorical.has_enumerate_support
torch.distributions.lowrank_multivariate_normal.LowRankMultivariateNormal.log_prob()
torch.distributions.negative_binomial.NegativeBinomial.expand()
torch.distributions.relaxed_categorical.RelaxedOneHotCategorical.temperature
torch.distributions.transformed_distribution.TransformedDistribution.arg_constraints


Profiler



Quantization

torch.ao.quantization.fx.custom_config.ConvertCustomConfig.set_preserved_attributes()


SciPy-like Signal



SciPy-like Special



Sparse Tensors



Storage



Tensor



Tensor Parallelism



Tensorboard



Torch



Torch Script



Traced Graph Export