RunanywhereAI/trnrt

The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.

LLM & foundation modelsPython Apache-2.0 16created 2026-10-30

Stars

1,577

1-day growth

—

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

The chart appears after at least 2 days of data.

#aws#glm#inference#llm#llm-serving#megakernels#neuron#nki#openai-api#trainium

Top contributors

Not collected yet (contributors job).