Skip to content

Files

Latest commit

24d0796 · Jan 14, 2025

History

History
This branch is 2 commits behind mlc-ai/mlc-llm:main.

web

MLC-LLM WebAssembly Runtime

This folder contains MLC-LLM WebAssembly Runtime.

Please refer to https://llm.mlc.ai/docs/install/emcc.html.

The main step is running make under this folder, a step included in web/prep_emcc_deps.sh.

make creates web/dist/wasm/mlc_wasm_runtime.bc, which will be included in the model library wasm when we compile the model. Thus during runtime, runtimes like WebLLM can directly reuse source code from MLC-LLM.