Light

dataprofessor / llama2 Goto Github PK

View Code? Open in Web Editor NEW

280.0 2.0 466.0 61 KB

This chatbot app is built using the Llama 2 open source LLM from Meta.

Home Page: https://llama2.streamlit.app

Python 73.09% Jupyter Notebook 26.91%

large-language-models llama2 llm meta python streamlit

llama2's Introduction

🦙💬 Llama 2 Chat

This chatbot is created using the open-source Llama 2 LLM model from Meta.

Particularly, we're using the Llama2-7B model deployed by the Andreessen Horowitz (a16z) team and hosted on the Replicate platform.

This app was refactored from a16z's implementation of their LLaMA2 Chatbot to be light-weight for deployment to the Streamlit Community Cloud.

Demo App

Prerequisite libraries

streamlit
replicate

Getting your own Replicate API token

To use this app, you'll need to get your own Replicate API token.

After signing up to Replicate, you can access your API token from this page.

Other Llama 2 models to try

As mentioned above, this chatbot implementation uses the Llama2-7B model that was trained on 7 billion parameters.

You can also try out the larger models:

llama2's People

Contributors

Stargazers

Watchers

Forkers

anhmike anishsingh20 meetpitsy chrisyang2017 hasans30 troywhite sohaib0399 ht55ght55 geeker-com randhirn11 rayisaninja shubham7694 alisaad ken1901 waldt profengel protocyber128 sainathpawar fahidmohammad sidjnsn66 sarthak405 cris-almodovar h3rn4n0s0r10 sunghee shephalibhardwaj ojh485 rain1921 linuxem chanthornsj morispolanco merkede glaceage bugie-boss sorokinvld typesdigital blackwhites lisaterumi jpscard jesusoctavioas zsclarx tomaszk88 jadouse5 paras-j rsamala aswin-m-the-coder gcjordi shabarinath4 prayyasss duongnhatthanh rajesh1505 sonyeric onemriganka jcidsv mahadev-hummanagol alexema22 trawmoney datascitriguy ardalan89 ricardo55costa isnabeel lunaisine moomoh tonywhite11 etloome oeminaga sagar-bakshi shirazihossein ashtoneonyango tonyjosephsebastians jmin-39 ankurchdry12 johnnykfeng karlocamus86 jackvartanian kc808 zifengw1 automationmike elon10musk ms-yun rcout328 tobivi aaxmed dilshanrakshitha perk4 oais7koo jackman337 juanjaragavi adityadarji18 thatdudejbob ton77v donnion99 orami01 aliziad24 kaurson lazyplatypus luckysails imvijay23 khaleel-000 vibha1704 saimaferoze

llama2's Issues

Running Llama in local

Hello
When I try to run the Llama2-local script, I get this error :
ValueError: Model path does not exist: models\llama-2-7b-chat.ggmlv3.q2_K.bin

Any ideas ?

The max value of parameter temperate of LLM should be 1 instead of 5

Don't have to simulate typewriter effect in streamlit_app.py

In streamlit_app.py, typewriter effect is simulated by the following code.
response = generate_llama2_response(prompt)
placeholder = st.empty()
full_response = ''
for item in response:
full_response += item
placeholder.markdown(full_response)
placeholder.markdown(full_response)

That's NOT a neat implementation because you can't display the partial response until the full response is received, esp. for the long response. The good example is available on replicate website. https://replicate.com/docs/get-started/python.

Some models stream output as the model is running. They will return an iterator, and you can iterate over that output

iterator = replicate.run(
"mistralai/mixtral-8x7b-instruct-v0.1",
input={"prompt": "Who was Dolly the sheep?"},
)
for text in iterator:
print(text)

Hopefully llama2 can return an iterator.

Can we able to connect other SQL and NoSQL databases

I would like to know, Can we able to connect other SQL and NoSQL databases like mongodb databases to make a natural language query on its data. Is that possible?!

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.