Amazon Unveils TorchNeuron to Ease PyTorch Use on Trainium Chips

Amazon has introduced TorchNeuron, a PyTorch backend that lets developers move existing AI models onto its Trainium chips with fewer code changes, easing a hurdle in competing with Nvidia's hardware. TorchNeuron adds Trainium2 and Trainium3 as device options within PyTorch, a framework used to build AI models. Developers can direct a model to the chips with a setting such as .to("neuron"). Programs that already use PyTorch's hardware detection interface may need no device setting change, while compiled models must select the Neuron backend. The public code repository identifies TorchNeuron as beta software and carries an Apache 2.0 license.

Source: TokenPost