mlc_llm/serve/engine.py", line 101, in _convert_model_info assert isinstance(chat_config.conv_template, Conversation) AssertionError about mlc-llm HOT 2 OPEN

This is because the format of conv_template in mlc-chat-config.json is now changed, introduced in PR #1965 . You need to re-generate your mlc-chat-config.json using the python -m mlc_llm gen_config ... command

from mlc-llm.

Hey also I wanted to deploy this test api on hugging face spaces . I tried to do it using python client.But there was an error of device_type = none. Umm so as I was hosting on a docker. So I am not sure is this the right way to host the mlc compiled models .I have also raised a bug it's very latest.It would be helpful if I can get a advice on this.

from mlc-llm.