Code Monkey home page Code Monkey logo

Comments (5)

aarnphm avatar aarnphm commented on May 30, 2024

brand new virtualenv 3.10

Screenshot 2023-12-16 at 13 06 31

The langchain I have a upstream PR for it.

from openllm.

jmformenti avatar jmformenti commented on May 30, 2024

Could you please share how you created the virtual environment?
And the url of the PR in langchain to be able to track?
Thanks

from openllm.

aarnphm avatar aarnphm commented on May 30, 2024

langchain-ai/langchain#12968

venv () {
	name="${1:-venv}" 
	if [[ ! -d "$name" ]]
	then
		pip freeze | grep "virtualenv" &> /dev/null || pip install virtualenv
		python -m virtualenv "$name" --download
		source "$name/bin/activate"
		pip install "protobuf<3.20"
	else
		source "$name/bin/activate"
	fi
}

from openllm.

jmformenti avatar jmformenti commented on May 30, 2024

Thanks!

Regarding the installation is not working neither, this is the full stack:

It is recommended to specify the backend explicitly. Cascading backend might lead to unexpected behaviour.
Traceback (most recent call last):
  File "/home/user/projects/sandbox/test/.venv/bin/openllm", line 8, in <module>
    sys.exit(cli())
  File "/home/user/projects/sandbox/test/.venv/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/home/user/projects/sandbox/test/.venv/lib/python3.10/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "/home/user/projects/sandbox/test/.venv/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/user/projects/sandbox/test/.venv/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/user/projects/sandbox/test/.venv/lib/python3.10/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/home/user/projects/sandbox/test/.venv/lib/python3.10/site-packages/openllm_cli/entrypoint.py", line 160, in wrapper
    return_value = func(*args, **attrs)
  File "/home/user/projects/sandbox/test/.venv/lib/python3.10/site-packages/click/decorators.py", line 33, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/home/user/projects/sandbox/test/.venv/lib/python3.10/site-packages/openllm_cli/entrypoint.py", line 141, in wrapper
    return f(*args, **attrs)
  File "/home/user/projects/sandbox/test/.venv/lib/python3.10/site-packages/openllm_cli/entrypoint.py", line 366, in start_command
    llm = openllm.LLM[t.Any, t.Any](
  File "/usr/lib/python3.10/typing.py", line 957, in __call__
    result = self.__origin__(*args, **kwargs)
  File "/home/user/projects/sandbox/test/.venv/lib/python3.10/site-packages/openllm/_llm.py", line 205, in __init__
    quantise=getattr(self._Quantise, backend)(self, quantize),
TypeError: getattr(): attribute name must be string

Anyway, I can fix it with:

pip install openllm[vllm]

Apparently this is a problem on my side, so I close the issue.

from openllm.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.