Comments (1)
Yes, I am also encountering the same issue even with simple built-in tools in cases where I removed the tool, but they still run the command, so the output is a predictable error message, but their response can be unpredictable. Sometimes they acknowledge the error and attempt a different action, but I have recorded many cases where they hallucinate it was a success or misinterpret a response as a success. The misinterpretation happens very often if it was a command run by a delegate agent/subagent.
With the misinterpreted command responses from delegate agents spawned through the create_agent
command, there are two recurring cases that I have observed and recorded:
- The main agent creates a subagent and assigns a task, that they will follow up on later, then later requests for a report by using the
mesage_agent
command but they send the request to an invalid agent ID, and misinterpret the 'agent not found' error as a failure, or sometimes bizarrely as a success. - They create a subagent, assign a task then immediately get a response from the subagent to clarify their request, which the main agent then interprets as the end result of the subagent's task.
I have noticed that the agent will sometimes misinterpret their own commands too. I think the issue to these problems lie somewhere in the following code blocks:
https://github.com/farizrahman4u/loopgpt/blob/main/loopgpt/agent.py#L154-L181
https://github.com/farizrahman4u/loopgpt/blob/main/loopgpt/agent.py#L287-L340
from loopgpt.
Related Issues (20)
- How to get a Google Search API key? HOT 4
- Browser Issue: preloaded using link preload but not used within a few seconds from the window's load event. Please make sure it has an appropriate `as` value and it is preloaded intentionally HOT 4
- Running from notebook HOT 2
- Enviroment file HOT 33
- agent = Agent(model="gpt-4") throws an error HOT 1
- Make this compatible with Marvin / Langchain HOT 1
- example usage with fastapi on the server HOT 1
- Spike in usage of tokens of Open AI API using gpt-4 model HOT 1
- It doesn't seem to read text files HOT 4
- AssertionError HOT 1
- browser.py call to summarizer exceeds token limits
- Function call `agent.config()` throws an error if `agent.clear_state()` is called before it HOT 2
- Persistent Context Transfer Between Multiple Agents HOT 1
- Add SerpApi instead of direct Google Search
- Compatibility with Other Language Models
- Rate Limited Reached on Initial Install Running Example Script . . . HOT 2
- ImportError: cannot import name 'PROCEED_INPUT'
- Support More OpenAI Models Like gpt-3.5-turbo-16k
- bash:syntax error- Ubuntu pip install and install from source HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from loopgpt.