HuaizhengZhang/AI-Infra-from-Zero-to-Hero resource

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

4309 stars · 410 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A curated awesome-list of research papers, industry practices, and video tutorials on systems for machine learning, LLMs, and generative AI. It organizes resources by ML/DL infrastructure, LLM training and serving, and domain-specific systems, tied to top systems conferences like OSDI, NSDI, and MLSys.

Use cases

• learn AI infrastructure from research papers
• find papers on LLM training and serving systems
• study MLSys and OSDI conference papers on ML systems
• get video tutorials explaining vLLM and LLM serving internals
• find resources on machine learning systems engineering
• prepare for research in AI systems and infrastructure

When to choose

• you want a curated, categorized reading list of ML/LLM systems research
• you prefer learning via video walkthroughs of real systems like vLLM
• you need pointers to code implementations alongside papers
• you are a student or researcher entering the MLSys field

When to avoid

• you need runnable software or a production tool rather than a reading list
• you want beginner tutorials on using ML frameworks rather than systems research
• you need up-to-date product documentation for a specific serving framework

Facets

learning-resource · maturity active

llm-inference llm-training machine-learning deep-learning gpu-computing machine-learning deep-learning large-language-models gpu-computing tutorials awesome-lists cross-platform awesome-list mlsys ai-infrastructure model-serving research-papers video-tutorials

Member repositories

For agents

markdown · JSON · MCP: product_card(name="HuaizhengZhang/AI-Infra-from-Zero-to-Hero")