microsoft/i-Code

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1703 stars · 166 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Microsoft's i-Code is a collection of research models and frameworks for integrative, composable multimodal AI spanning vision, language, and speech, including CoDi (any-to-any generation), UDOP (document intelligence), and i-Code Studio. It is primarily a research codebase accompanying published papers, implemented in Jupyter Notebook/Python.

Use cases

• generate any output modality (image, video, audio, text) from any input modality
• build composable multimodal learning models combining vision, language, and speech
• unified document understanding and processing with vision, text, and layout
• autoregressive generation over vision, language, and speech data
• knowledge-based visual question answering
• reproduce research papers on multimodal foundation models

When to choose

• you need state-of-the-art any-to-any multimodal generation like CoDi
• you want unified document AI with UDOP
• you are doing research on integrative multimodal learning and want reference implementations

When to avoid

• you need a production-ready, well-supported library with stable APIs
• you want a simple pretrained model served via an API without GPU research setup
• you need lightweight inference on CPU or edge devices

Facets

library · maturity maintenance

machine-learning deep-learning nlp speech-recognition image-processing llm-training artificial-intelligence machine-learning computer-vision speech-processing deep-learning python multimodal foundation-models diffusion document-intelligence research any-to-any-generation composable-ai natural-language-processing gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="microsoft/i-Code")