Toolchain · 2023

TensorRT-LLM

Python, C++, CUDA, PyTorchWritten in
2023First released
NVIDIABuilt by
Built from TTensorRT-LLM PythonC++CUDAPyTorch
Runtime

NVIDIA inference software combining a Python-facing model/executor stack, C++ scheduling and cache-management bindings, and specialized GPU kernels.

What is TensorRT-LLM written in?

Its runtime is implemented in Python, C++, CUDA, and PyTorch (documented).

Frequently Asked Questions

What language is TensorRT-LLM written in?
TensorRT-LLM is primarily implemented in Python and C++ and CUDA and PyTorch.
When was TensorRT-LLM first released?
TensorRT-LLM was first released in 2023.

Evidence Sources

Discover More

Spot something wrong?

Every fact on this page is meant to be checkable. If one is wrong, say so and it becomes a dataset change, not a patch to this page.

Goes to a public GitHub issue for review. Nothing you write appears on this site.

Explore TensorRT-LLM in Graph →