JAPANITIESJapan and France, through words and food.
Tech newsJAPANITIES

Amazon opens TorchNeuron: native PyTorch on its Trainium AI chips

Checked on

Published on

AT A GLANCE

Available in public beta from 20 October, open source (Apache 2.0): what changes.

Photo of a researcher handling a semiconductor wafer
U.S. Department of Energy · Public domain
In this article

The essentials

AWS published TorchNeuron on 20 October, a native PyTorch backend for its Trainium AI chips.

What changes

PyTorch is the most widely used tool for building AI models. Until now, Trainium required a specific setup. With TorchNeuron, you just write .to('neuron'); the backend relies on PyTorch’s official extension for new hardware, so standard APIs work as they are. Trainium2 and Trainium3 are supported.

Features available

Eager mode (research, debugging) and torch.compile (production) are both supported, as are the distributed computing APIs. To go further, developers can write their own kernels with NKI. Hugging Face libraries (Transformers, Diffusers…) work directly.

Feedback and tests

Deepgram says it processes about 60% more seconds of audio per dollar than with its GPUs. Amazon continuously tests 100,000 Hugging Face models on Trainium and wants to close the remaining gaps. Some features are not supported in the first version (sparse tensors, dynamic shapes…).

To keep in mind

The performance is that announced by a customer, Deepgram, without independent verification. This article is based on the official PyTorch blog.

LANGUAGE NOTES

Learn the grammar

Explained in English

French grammar

Learn sentence patterns and usage from the article’s own sentences.

01The present indicative
Structure

est / sont + attribute (noun, adjective, prepositional phrase)

In the article
PyTorch est l’outil le plus utilisé pour créer des modèles d’IA.
Key points

Être in the present is est for a singular subject and sont for a plural one. It describes nature, state or place (“is”, “is located”). If what follows (the attribute) is a noun, adjective or prepositional phrase, it is not a passive. If a past participle follows, it is a passive (est annoncé). Headlines and summaries often use the present to describe the current situation.

02The passé composé
Structure

present of avoir + past participle

In the article
AWS a publié le 20 octobre TorchNeuron, un backend PyTorch natif pour ses puces d’IA Trainium.
Key points

The passé composé is the most common past tense, used for “did” and “has done” — actions completed in the past. It is formed with the auxiliary avoir (a / ont…) in the present + a past participle. Past participles of -er verbs end in -é (annoncer → annoncé); learn the irregular ones (faire → fait, prendre → pris, voir → vu). In the negative, ne … pas wraps the auxiliary (n’a pas annoncé). In the news it reports facts that have already happened, such as “announced” or “voted”.

03The imparfait
Structure

stem (nous form of the present) + -ais / -ait / -ions / -iez / -aient

In the article
Jusqu’ici, Trainium demandait une configuration spécifique.
Key points

The imparfait describes states, background, habits and actions in progress in the past (il était, elle avait, ils pensaient). Take the nous form of the present, drop -ons, and add -ais / -ais / -ait / -ions / -iez / -aient. If the passé composé gives “the event itself”, the imparfait paints “the situation at the time”.

04The passive voice in the present
Structure

être (est / sont) + past participle (+ par / de)

In the article
Trainium2 et Trainium3 sont pris en charge.
Key points

The passive means “is done” or “is being done”. It is formed with être + past participle, which agrees with the subject in gender and number (la mesure est adoptée / les mesures sont adoptées). The agent is introduced by par (or de). In the news it is common when the event, rather than the actor, is the focus (est prévu / est annoncé / est connu).

05Negation and its scope
Structure

ne / n’ … pas · ne … plus

In the article
Certaines fonctions ne sont pas prises en charge dans la première version (tenseurs creux, formes dynamiques…).
Key points

Normally ne and pas wrap the verb. Before a vowel, ne becomes n’. Check which part of the sentence the negation covers. Ne … plus means “no longer”.

06Pouvoir: ability and possibility
Structure

peut / peuvent / pourrait + infinitive

In the article
Pour aller plus loin, les développeurs peuvent écrire leurs propres noyaux avec NKI.
Key points

Put a base-form verb after pouvoir. Peut means “can” or “may”; the conditional pourrait gives a more reserved possibility, “might”. It does not necessarily mean implementation is settled.

07Purpose with pour
Structure

pour + infinitive

In the article
PyTorch est l’outil le plus utilisé pour créer des modèles d’IA.
Key points

This is the purpose, “in order to…”. Put the base form of a verb after pour. The purpose stated here is separate from whether the effect was actually achieved.

08The subject relative pronoun qui
Structure

noun + qui + verb

In the article
Disponible en bêta publique dès le 20 octobre, en open source (Apache 2.0) : ce qui change.
Key points

Qui continues a description of the person or thing just mentioned (“the one that does…”). Because qui is itself the subject of the next verb, do not repeat the subject. The verb agrees with the noun qui refers to.

Explained in English

Japanese grammar

Understand the structure and usage from the text.

01Polite negation and plain form
Structure

〜ではありません / 〜ではない

In the article
性能の数字は、顧客であるDeepgramの発言で、第三者の検証ではありません。
Key points

They negate a noun and similar content. “ではありません” is the polite form and “ではない” the plain form. “成立ではありません” shows that it cannot be said to have been concluded.

02Cause or purpose with ため
Structure

〜ため / 〜ために

In the article
PyTorchは、AIのモデルを作るために、広く使われているツールです。
Key points

ため is used for both reason and purpose. “成立ではないため” is a reason and “運転手を守るため” a purpose. Decide from the whole sentence whether what precedes is a cause or a goal.

03Giving examples with など
Structure

noun / expression + など

In the article
Hugging Faceの、TransformersやDiffusersなどのライブラリも、そのまま動きます。
Key points

“暴言など” gives “abusive language” as one example. It is not necessarily a closed list of only the things named. It also helps when reading the scope of a news story.

04The polite past ました
Structure

verb stem (連用形) + ました

In the article
アマゾンのAWSは、自社のAIチップ「Trainium」で、PyTorchのプログラムをそのまま動かせる仕組み「TorchNeuron」を、20日に公開しました。
Key points

In “発表しました”, ました makes a verb polite past. The negative is “ませんでした”. Read the actual date together with the date and time in the text.

05Possibility in Japanese: できる・られる
Structure

verb potential form / 〜ことができる

In the article
特別な高速化には、「NKI」という仕組みで、自分のプログラムを書くこともできます。
Key points

できる is the basic verb for ability. The potential form of 受ける is 受けられる. The same られる can also be passive or honorific, so decide from the meaning of the sentence.

06Linking actions with the て-form
Structure

verb て-form + next expression

In the article
PyTorchが用意している、新しいチップを登録するための仕組みを使うので、PyTorchの標準の機能が、そのまま使えます。
Key points

The て-form links actions in a series, in order or as a reason. In “確認して、出発する” the relation is judged from the content. In “〜ている” it can show an action in progress or a continuing state.

Related articles