Amazon opens TorchNeuron to all developers, taking aim at Nvidia's software advantage
The tool runs standard PyTorch code on Amazon's Trainium chips after a basic configuration change.
Amazon said Monday it is opening TorchNeuron, software that runs code written in the PyTorch framework on its Trainium AI chips, to all developers as a public beta, and plans to release it as open source on Tuesday at the PyTorch Conference in San Jose. Until now, developers had to modify their code to call Trainium-specific interfaces.
“If you know PyTorch, then you know Trainium,” said Colin Brace, vice president of technology software at Annapurna Labs, Amazon’s chip-design unit. Nvidia’s lead in AI chips rests partly on software built around its CUDA platform, and adapting that code to other hardware can take months.
More than 30 companies and internal teams used TorchNeuron during a private beta. San Francisco speech AI company Deepgram says Trainium processed about 60% more audio per dollar than its GPU setup, and Prime Video used it to build Prime 360, which reconstructs NBA plays in 3D. Amazon tests the tool nightly against more than 100,000 models from Hugging Face.
CEO Andy Jassy wrote in April that Amazon’s chip business, including Trainium and Graviton, had an annual revenue run rate above $20 billion.
From ARQS Sponsored
Readers looking to act on this kind of technology shift can start with Design Workbench, TradeHound, Website audit and Flow automation. In the ARQS Store, Wine Cellar Ledger — 1 Month Access, ARQS ContractDiff Desk, SponsorKit — Creator Media Kit & Rate Card Builder are among the newest tools available.
- AI services
- AI Front Desk
- SignDesk
- Northline course catalogue
- ARQS security
- Live Intelligence
- AI receptionist
- AI Academy courses
- ARQS Store
- Northline Technology Institute
- AI Academy Year 2 — Applied Agentic AI Systems
- AI Academy Year 2 — Applied No-Code AI Development
- AI Academy Year 2 — Applied Business Process Automation
From our partners
Partner content
ARQSARQS StoreAI receptionist, business automation, readiness reviews, website audits and launch packages.
ARQS LinguaQuestLinguaQuest Creator BundleBrowser language-learning software with adaptive review and speech support.
AI AcademyAI Academy course catalogueSelf-study courses in practical AI workflows from Northline Technology Institute.AI AcademyAI Academy Year 1: FoundationsDesign controlled AI-assisted workflows for real operations.
ARQS Flow ConnectFlow Connect starter accessA workspace for integrations, approvals and governed workflows. 30-day starter access.
ARQS PressPress RoomReleases, editorials and new books from ARQS Press.Most read
- Court halts Vancouver Aquatic Centre demolition until after civic election
- TSX gains 319 points as energy and telecom stocks lead
- Poilievre takes his tariff-free auto pact pitch to Detroit
- 'I Play Rocky' and 'Ceremony' take VIFF audience awards
- BC Conservatives take five-point lead as leaders head into only TV debate
