Frequently Asked Questions

This is a list of Frequently Asked Questions (FAQ) about the MLC-LLM. Feel free to suggest new entries!

… How can I customize the temperature, and repetition penalty of models?

Please check our Customize MLC Chat Config tutorial.

… What’s the quantization algorithm MLC-LLM using?

Please check our Configure Quantization tutorial.

… Why do I encounter an error free(): invalid pointer, Aborted (core dumped) at the end of model compilation?

This happens if you compiled TVM from source and didn’t hide LLVM symbols in cmake configurations. Please follow our instructions in Building TVM from Source tutorial to compile TVM which hides LLVM symbols, or use our pre-built MLC-LLM pip wheels.