running openllm start opt or falcon for the first time fails about openllm HOT 12 CLOSED

Ok I did not realize that someone publish openllm to conda https://anaconda.org/selfexplainml/openllm

please don't use conda and use virtualenv instead.

from openllm.

Hey thanks for the tip but I use virtualenv instead and get the exact same error like before.

File "/Users/Desktop/test/ol/lib/python3.11/site-packages/openllm/_service.py", line 8, in <module> llm = openllm.LLM[t.Any, t.Any]( ^^^^^^^^^^^ AttributeError: module 'openllm' has no attribute 'LLM'

from openllm.

What version of openllm is this?

from openllm.

Probably you need to downgrade the version @heyili

from openllm.

I am using openllm 0.4.39. Which version would u suggest ?

from openllm.

I tried all the versions from 0.4.39 down to 0.4.30 for all versions I get:

llm = openllm.LLM[t.Any, t.Any](
^^^^^^^^^^^
AttributeError: module 'openllm' has no attribute 'LLM'

from openllm.

Can you do a pip uninstall -y openllm openllm-client openllm-core && pip install -U openllm

from openllm.

I run pip uninstall -y openllm openllm-client openllm-core && pip install -U openllm successfully

then try to run openllm start opt again

still get error

llm = openllm.LLM[t.Any, t.Any](
^^^^^^^^^^^
AttributeError: module 'openllm' has no attribute 'LLM'

from openllm.

What python version are you using?

from openllm.

I am using Python 3.11

openllm, 0.4.40 (compiled: False)
Python (CPython) 3.11.0

from openllm.

Hey I found the error, I have a file in the project called openllm.py. Now it is running

from openllm.

@heyili good to know about how python loads module https://docs.python.org/3/library/sys_path_init.html

from openllm.