Frequently Asked Questions¶
This is a list of Frequently Asked Questions (FAQ) about the MLC-LLM. Feel free to suggest new entries!
- … How can I customize the temperature, and repetition penalty of models?
Please check our Configure MLCChat in JSON tutorial.
- … What’s the quantization algorithm MLC-LLM using?
Please check our 🚧 Configure Quantization tutorial.
- … Why do I encounter an error
free(): invalid pointer, Aborted (core dumped)at the end of model compilation?
This happens if you compiled TVM-Unity from source and didn’t hide LLVM symbols in cmake configurations. Please follow our instructions in Building TVM Unity from Source tutorial to compile TVM-Unity which hides LLVM symbols, or use our pre-built MLC-LLM pip wheels.