👋 Welcome to MLC LLM

Discord | GitHub

Machine Learning Compilation for Large Language Models (MLC LLM) is a high-performance universal deployment solution that allows native deployment of any large language models with native APIs with compiler acceleration. The mission of this project is to enable everyone to develop, optimize and deploy AI models natively on everyone’s devices with ML compilation techniques.

Quick Start

Check out Quick Start for quick start examples of using MLC LLM.

Introduction to MLC LLM

Check out Introduction to MLC LLM for the introduction and tutorial of a complete workflow in MLC LLM.