Amazon’s Trainium chips have a reputation problem, and it isn’t about speed. They have been good at running finished AI models but awkward for the messy, experimental work of building new ones.
AWS now wants to fix that. It has launched TorchNeuron, a native PyTorch backend for its Trainium2 and Trainium3 accelerators, built to make research training feel like any other PyTorch job.
What AWS actually shipped
TorchNeuron entered public beta on October 19, 2026. AWS open-sourced it a day later, on October 20, during the PyTorch Conference North America.
The release arrived alongside version 2.33.0 of the Neuron SDK, the software toolkit AWS uses to program its in-house chips. The headline feature is simplicity. Developers can move a model onto Trainium with a single line, such as .to(‘neuron’), much like pointing code at any other device.
That one-liner keeps compatibility with standard PyTorch APIs. It also supports eager execution, meaning operations run immediately as the code calls them instead of first being compiled into a larger graph.
The previous setup leaned on a PyTorch/XLA integration. That path required developers to scatter calls like xm.step() through their training loops and work around a custom, compiler-heavy style of programming. It worked, but it demanded extra code and offered narrower API coverage.
Neuron 2.33 also brings a few supporting upgrades:
- Neuron Observer, a tool for detecting hardware health issues
- Improved NKI functionality for lower-level customization
- Updated vLLM plugins tuned to work with TorchNeuron
There is a catch for owners of older hardware. TorchNeuron supports only Trainium2 and Trainium3. Trainium1 and the Inferentia chip family are left out.
Why inference came first
Trainium has already found its footing in inference, the stage where a trained model answers real requests. Anthropic runs production inference and reinforcement learning rollouts on Trainium2 and Trainium3.
Research training is a different animal. Scientists constantly swap layers, test variations, and run ablations, which are experiments that remove or change one component to see what breaks. Each tweak can call on a different corner of the PyTorch API.
Who is already using it
AWS says it has more than 30 early customers on TorchNeuron. They span robotics, voice AI, and large language model development.
Cartesia and Deepgram, two companies working in voice AI, report substantial performance improvements compared with their earlier configurations. Hugging Face, the popular hub for open AI models, has also adopted Trainium support.
The update also opens Trainium to broader research use cases, with fields such as drug discovery cited as areas that could benefit from easier access to the hardware.
Disclosure: This article was edited by Diego Almada Lopez. For more information on how we create and review content, see our Editorial Policy.