Tao Li @ NVIDIA (litaotju): what they build

Tao Li @ NVIDIA (litaotju) is a software engineer who works mostly in python and c++. Sr. software engineer optimizing LLM inference on NVIDIA GPUs with TensorRT Vamo shows Tao Li @ NVIDIA on the Engineers who build Nvidia's open-source AI software Discover list for their work on NVIDIA/TensorRT-LLM, read from what they have shipped on GitHub.

Tao Li @ NVIDIA and others on Engineers who build Nvidia's open-source AI software

  • Tao Li @ NVIDIA
    @litaotju
    May
    Jul
    Aug
    Sep
    Oct
    Nov

    Sr. software engineer optimizing LLM inference on NVIDIA GPUs with TensorRT

    Optimizes LLM inference on NVIDIA GPUs with TensorRT, after performance architecture at NVIDIA. Commits to NVIDIA/TensorRT-LLM, a library for defining and optimizing large language models, and triton-inference-server/tensorrtllm_backend, a backend for serving large language models.

  • May
    Jul
    Aug
    Sep
    Oct
    Nov

    Principal systems engineer who collects technical specs and builds C libraries

    Ships C and C++ systems tooling for CUDA developers, after principal engineering at OpenTeams. Creator of pdfs, a website that hosts a collection of technical PDFs, and perfecthash, a library that generates perfect hashes.

  • Eric Niebler
    @ericniebler
    May
    Jul
    Aug
    Sep
    Oct
    Nov

    Distinguished C++ engineer behind the ranges that became std, ranges

    Develops C++ range and async execution libraries at NVIDIA, after software engineering at Meta. Creator of range-v3, a range library for C++, and works on NVIDIA/stdexec, a framework for asynchronous and parallel programming.

Vamo's read on Tao Li @ NVIDIA

devRank
87
Languages
python, c++

Optimizes LLM inference on NVIDIA GPUs with TensorRT, after performance architecture at NVIDIA. Commits to NVIDIA/TensorRT-LLM, a library for defining and optimizing large language models, and triton-inference-server/tensorrtllm_backend, a backend for serving large language models.

The repos that put Tao Li @ NVIDIA on Vamo's lists

  • NVIDIA/TensorRT-LLM

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT

    python · 14,787 stars GitHub

Discover lists Tao Li @ NVIDIA is on

Find engineers like Tao Li @ NVIDIA in Vamo, see litaotju on GitHub, or browse every developer on Vamo's public lists.

Is this you? Email support@vamo.app and we will edit or take down this page.