A mini framework built on top of Langchain and Llamaindex to provide LLM powered Autonomous Agents as a simplified service to assist users with their tasks.
ServifAI (Task-based Agent) = LLM + Memory + Planning + Toolbox
Instead of feeding all kinds of tools to a single agent and confusing it while selection, ServifAI narrows down the selection by combining only necessary tools on basis of the task at hand.
Read this article to get an overview on Agents.
Currently we only support OpenAI models. If you are privacy concerned you should apply for Azure OpenAI services. The reason for not yet supporting opensource local models are:
- You need a lot of money - either to buy a great GPU or host it on cloud with a great GPU
- even if you tick the first point, it won't help you much as currently opensource models are good for chat but lag behind
OpenAImodels in enabling complex agent workflows
| Tasks | Toolbox Tools | Required File Extensions |
|---|---|---|
default |
DuckDuckGo + LLM Math + PAL Math | None |
qna_local_docs |
Vector Index + Knowledge Graphs | PDF/DOCX |
Works best with Poetry
poetry add servifaiWith pip, you might have to install dependencies manually
pip install servifaiCreate a .env file for openai
OPENAI_API_KEY='sk-...'Run Python Code
from servifai import ServifAI
myagent = ServifAI()
while True:
text_input = input("Me: ")
if text_input == "exit":
break
response = myagent.chat(text_input)
print(f'ServifAI: {response}\n')Output
Me: I am feeling bored at home, provide me a list of places in bengaluru to chill out on a sunday.
ServifAI: Here is a list of places in Bengaluru to chill out on a Sunday:
1. Cubbon Park
2. Rasta Cafe
3. Skandagiri
4. Uttari Betta Sunrise
5. Ranganathaswamy Betta
6. Adventure Camping at Nandi Hills
7. Riverside Manchanabele
8. Caving at AntaraGange
9. Clubbing at Hard Rock Café
10. High Ultra lounge
11. Toit
12. Dinning at Empire Hotel
These are just a few options, and there are many more places in Bengaluru where you can relax and have a good time on a Sunday.
Me: Too many options for a day. Provide a itinerary instead for one day
ServifAI: Based on the search results, here is a suggested one-day itinerary for Bengaluru:
Morning: Start your day with a visit to Cubbon Park and enjoy the greenery. Join the locals on their early morning walk.
Afternoon: Indulge in a classic South Indian breakfast and then head to Savandurga, a famous place known for its temples and rock climbing.
Evening: Explore the vibrant streets of Bengaluru and visit popular spots like MG Road or Brigade Road for shopping and dining.
Night: End your day by experiencing the nightlife of Bengaluru at one of the city's popular clubs or lounges.
Please note that this is just a suggested itinerary and you can customize it based on your preferences and interests.
Me: Do you think this would be possible to complete based on today's weather?
ServifAI: Based on the weather forecast, it is possible to complete the activity you mentioned. The maximum temperature in Bengaluru is expected to be around 32 degrees Celsius today.
Me: exit
Check Examples for more.
- Add support for popular unstructured data formats
- Add support for other VectorDBs
- Add other task based tools
- Add support for structured data formats
- Support for OpenAI funcs
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent