Amazon opens TorchNeuron: native PyTorch on its Trainium AI chips
Checked on
Published on
Available in public beta from 20 October, open source (Apache 2.0): what changes.

In this article
The essentials
AWS published TorchNeuron on 20 October, a native PyTorch backend for its Trainium AI chips.
What changes
PyTorch is the most widely used tool for building AI models. Until now, Trainium required a specific setup. With TorchNeuron, you just write .to('neuron'); the backend relies on PyTorch’s official extension for new hardware, so standard APIs work as they are. Trainium2 and Trainium3 are supported.
Features available
Eager mode (research, debugging) and torch.compile (production) are both supported, as are the distributed computing APIs. To go further, developers can write their own kernels with NKI. Hugging Face libraries (Transformers, Diffusers…) work directly.
Feedback and tests
Deepgram says it processes about 60% more seconds of audio per dollar than with its GPUs. Amazon continuously tests 100,000 Hugging Face models on Trainium and wants to close the remaining gaps. Some features are not supported in the first version (sparse tensors, dynamic shapes…).
To keep in mind
The performance is that announced by a customer, Deepgram, without independent verification. This article is based on the official PyTorch blog.
Learn the grammar
French grammar
Learn sentence patterns and usage from the article’s own sentences.
01The present indicative
est / sont + attribute (noun, adjective, prepositional phrase)
PyTorch est l’outil le plus utilisé pour créer des modèles d’IA.Key pointsÊtre in the present is est for a singular subject and sont for a plural one. It describes nature, state or place (“is”, “is located”). If what follows (the attribute) is a noun, adjective or prepositional phrase, it is not a passive. If a past participle follows, it is a passive (est annoncé). Headlines and summaries often use the present to describe the current situation.
02The passé composé
present of avoir + past participle
AWS a publié le 20 octobre TorchNeuron, un backend PyTorch natif pour ses puces d’IA Trainium.Key pointsThe passé composé is the most common past tense, used for “did” and “has done” — actions completed in the past. It is formed with the auxiliary avoir (a / ont…) in the present + a past participle. Past participles of -er verbs end in -é (annoncer → annoncé); learn the irregular ones (faire → fait, prendre → pris, voir → vu). In the negative, ne … pas wraps the auxiliary (n’a pas annoncé). In the news it reports facts that have already happened, such as “announced” or “voted”.
03The imparfait
stem (nous form of the present) + -ais / -ait / -ions / -iez / -aient
Jusqu’ici, Trainium demandait une configuration spécifique.Key pointsThe imparfait describes states, background, habits and actions in progress in the past (il était, elle avait, ils pensaient). Take the nous form of the present, drop -ons, and add -ais / -ais / -ait / -ions / -iez / -aient. If the passé composé gives “the event itself”, the imparfait paints “the situation at the time”.
04The passive voice in the present
être (est / sont) + past participle (+ par / de)
Trainium2 et Trainium3 sont pris en charge.Key pointsThe passive means “is done” or “is being done”. It is formed with être + past participle, which agrees with the subject in gender and number (la mesure est adoptée / les mesures sont adoptées). The agent is introduced by par (or de). In the news it is common when the event, rather than the actor, is the focus (est prévu / est annoncé / est connu).
05Negation and its scope
ne / n’ … pas · ne … plus
Certaines fonctions ne sont pas prises en charge dans la première version (tenseurs creux, formes dynamiques…).Key pointsNormally ne and pas wrap the verb. Before a vowel, ne becomes n’. Check which part of the sentence the negation covers. Ne … plus means “no longer”.
06Pouvoir: ability and possibility
peut / peuvent / pourrait + infinitive
Pour aller plus loin, les développeurs peuvent écrire leurs propres noyaux avec NKI.Key pointsPut a base-form verb after pouvoir. Peut means “can” or “may”; the conditional pourrait gives a more reserved possibility, “might”. It does not necessarily mean implementation is settled.
07Purpose with pour
pour + infinitive
PyTorch est l’outil le plus utilisé pour créer des modèles d’IA.Key pointsThis is the purpose, “in order to…”. Put the base form of a verb after pour. The purpose stated here is separate from whether the effect was actually achieved.
08The subject relative pronoun qui
noun + qui + verb
Disponible en bêta publique dès le 20 octobre, en open source (Apache 2.0) : ce qui change.Key pointsQui continues a description of the person or thing just mentioned (“the one that does…”). Because qui is itself the subject of the next verb, do not repeat the subject. The verb agrees with the noun qui refers to.
Japanese grammar
Understand the structure and usage from the text.
01Polite negation and plain form
〜ではありません / 〜ではない
性能の数字は、顧客であるDeepgramの発言で、第三者の検証ではありません。Key pointsThey negate a noun and similar content. “ではありません” is the polite form and “ではない” the plain form. “成立ではありません” shows that it cannot be said to have been concluded.
02Cause or purpose with ため
〜ため / 〜ために
PyTorchは、AIのモデルを作るために、広く使われているツールです。Key pointsため is used for both reason and purpose. “成立ではないため” is a reason and “運転手を守るため” a purpose. Decide from the whole sentence whether what precedes is a cause or a goal.
03Giving examples with など
noun / expression + など
Hugging Faceの、TransformersやDiffusersなどのライブラリも、そのまま動きます。Key points“暴言など” gives “abusive language” as one example. It is not necessarily a closed list of only the things named. It also helps when reading the scope of a news story.
04The polite past ました
verb stem (連用形) + ました
アマゾンのAWSは、自社のAIチップ「Trainium」で、PyTorchのプログラムをそのまま動かせる仕組み「TorchNeuron」を、20日に公開しました。Key pointsIn “発表しました”, ました makes a verb polite past. The negative is “ませんでした”. Read the actual date together with the date and time in the text.
05Possibility in Japanese: できる・られる
verb potential form / 〜ことができる
特別な高速化には、「NKI」という仕組みで、自分のプログラムを書くこともできます。Key pointsできる is the basic verb for ability. The potential form of 受ける is 受けられる. The same られる can also be passive or honorific, so decide from the meaning of the sentence.
06Linking actions with the て-form
verb て-form + next expression
PyTorchが用意している、新しいチップを登録するための仕組みを使うので、PyTorchの標準の機能が、そのまま使えます。Key pointsThe て-form links actions in a series, in order or as a reason. In “確認して、出発する” the relation is judged from the content. In “〜ている” it can show an action in progress or a continuing state.