Skip to content
View john-liu-dev's full-sized avatar
🎯
Focusing
🎯
Focusing

Block or report john-liu-dev

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
john-liu-dev/README.md
Yuehua Liu — Making LLMs answer faster and agents wait less.

I work on LLM and agentic inference: making models answer faster and agents wait less. I also keep an eye on what people build with agents.

做LLM和Agentic推理优化,让模型答得快一点、agent少等一会儿,也关注agent应用

Now · multimodal serving (Qwen3-VL video) on Dynamo + TensorRT-LLM · encode / prefill / decode disaggregation · KV-aware decode routing · agentic workloads

Side project · HackerShelf · papers and free books Hacker News kept recommending over 20 years, with Chinese reading guides · how it's built

Writing

  • Pending — the first posts are in the works.

Upstream field notes

PRs and issues from multimodal, disaggregated serving and KV-aware routing.

NVIDIA 博客作者页 · Views are my own.

Pinned Loading

  1. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

    Python 15.1k 2.9k

  2. ai-dynamo/dynamo ai-dynamo/dynamo Public

    A Datacenter Scale Distributed Inference Serving Framework

    Rust 8.5k 1.9k