Skip to main content

Skill · AI Hiring Index · as of 2026-11-19

vLLM / SGLang / TensorRT in AI job postings

3% of technical postings at the AI companies we track mention vLLM / SGLang / TensorRT (143 postings). Inference / Perf postings ask for it most: 29%.

Technical postings that mention it
3%
143 postings
Change since the previous Index
±0 pt

Which roles ask for it

Share of each technical role family's open postings that mention vLLM / SGLang / TensorRT.

Role familyShare, as a barShare
Inference / Perf29%
AI / ML Engineer5%
Research Engineer5%
Research Scientist5%
FDE / Applied4%
Infra / Hardware1%
Software Eng1%
Evals / Data0%
Safety / Policy0%
Security0%

Companies asking for it most

CompanyPostingsOf its technical postings
Nebius2210%
CoreWeave1811%
SambaNova1427%
Baseten919%
Crusoe64%
Cerebras66%
Fireworks AI616%
Together AI512%
Mistral AI53%
Modal417%

Open postings that mention vLLM / SGLang / TensorRT

How to learn it

  • LLM Inference Handbook — Modular free

    Latency, throughput and cost of serving a model — batching, KV cache, quantization, which engine when — as one practical handbook rather than twenty blog posts.

  • Inside vLLM: Anatomy of a High-Throughput LLM Inference System free

    One request followed through the scheduler, paged KV cache, continuous batching, prefix caching and speculative decoding, ending on the latency-against-throughput curve a design answer needs.

  • vLLM documentation free

    The engine the cloud-GPU route runs on: the docs explain the trade-off behind each setting, and the bundled vllm bench serve prints TTFT, TPOT and throughput — the deployment project's numbers.

Project: Serve a small open model and measure it — Serve a small open model with vLLM, then measure time to first token and tokens per second at 1, 8 and 32 concurrent requests, with and without quantization.
A posting counts when its description mentions the skill in what the role does or asks for — the company's description of itself is left out. Shares are over technical postings only; the tags are checked against the postings every month and a skill below90% precision is not shown. How we count.

Spot a mistake on this page?