Comments (4)
It's hard to give a meaningful estimate in advance of how many output tokens will be used, although the number of input tokens would be known.
Asking if they want to continue would also need another ask for confirmation step, which I personally would always want to skip, thus would need some flag or config to disable, adding further complexity.
I question if most people really need/want this?
If users are on a limited budget, they could just set their spend limit in the OpenAI API settings.
from gpt-engineer.
It's hard to give a meaningful estimate in advance of how many output tokens will be used, although the number of input tokens would be known.
Asking if they want to continue would also need another ask for confirmation step, which I personally would always want to skip, thus would need some flag or config to disable, adding further complexity.
I question if most people really need/want this?
If users are on a limited budget, they could just set their spend limit in the OpenAI API settings.
I'm completely with you on not having unnecessary prompts for the user. Here's why i thought of my suggestion and thought it might be good because no one likes cost surprises.
Yesterday, I was creating an informational video on this tool and during the process i executed it to generate some simple codebase. And it did perfectly, but to find API cost : $0.05
or something at the end of the execution was a 'little surprise' to me. (I have used the tool earlier but completely forgot it uses GPT 4 API key behind the scenes.
So I thought it would be a 'nice-to-have'. Otherwise, what if i instruct it to generate a fairly complex codebase and it gives me a bill of say $5 unexpectedly? still not a lot but I hope I conveyed my point.
Setting the budget on Open AI itself is not relevant i guess given it's not even possible to track usage by API key
- https://community.openai.com/t/does-openai-support-seeing-cost-per-api-key-and-allow-limits-to-be-set-at-api-key-level/194418/2
- https://community.openai.com/t/how-to-track-api-usage-and-cost-by-api-key/174145/42).
Regarding the meaningful estimate, it can be ballpark then user has some idea than none.
I'm very much open to discussion on this.
from gpt-engineer.
Hi,
@RukshanJS thanks for the idea. From other comments it seems like budget is top of mind for many users, so I think your thoughts are relevant. For some combinations of flags, where the number of executions are known, it would be possible to provide an upper bound for the cost.
I see two problems:
- I agree with @ErikBjare that it will complicate the workflow. One possible way would be to print the number directly and then tell the user to abort the run dynamically if the price tag is too much. This would bypass the additional confirmation step.
- We are currently low on people developing features and the core team is focused on the most pressing functionality. If you are willing to implement this yourself, we should consider it.
from gpt-engineer.
Hi, @RukshanJS thanks for the idea. From other comments it seems like budget is top of mind for many users, so I think your thoughts are relevant. For some combinations of flags, where the number of executions are known, it would be possible to provide an upper bound for the cost.
I see two problems:
- I agree with @ErikBjare that it will complicate the workflow. One possible way would be to print the number directly and then tell the user to abort the run dynamically if the price tag is too much. This would bypass the additional confirmation step.
- We are currently low on people developing features and the core team is focused on the most pressing functionality. If you are willing to implement this yourself, we should consider it.
HI, sorry for the late reply. Yes I would love to work on this. I'm still learning this stuff so would love to take tasks like this. Let me know.
from gpt-engineer.
Related Issues (20)
- The Video demo on the Main Repo is Corrupted HOT 4
- Docker build is broken HOT 30
- Add GPTE CLI argument to output system information HOT 10
- how to set gpt-4o HOT 4
- Can't run poetry install. Greenlet not supporting PEP 517 builds. HOT 1
- Azure Deployment Name Bug HOT 20
- Could not build wheels for pyarrow, which is required to install pyproject.toml-based projects HOT 6
- Implement a Unified Configuration File for Project Settings HOT 4
- Editing a project: KeyError "src/index.js" HOT 3
- Creating new project: Hang at "npm start", crash if I say "y" HOT 4
- Gemini 1.5 pro/flash HOT 6
- INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 403 Forbidden" HOT 4
- TypeError: string indices must be integers HOT 4
- Can't edit files HOT 8
- Could not resolve authentication method. HOT 7
- Improve `--sysinfo` by providing version data and env variables insights HOT 2
- using with deepseek api problem HOT 3
- Failed to update new codes from gpte HOT 3
- IsADirectoryError: [Errno 21] Is a directory
- Improving existing code: No files were selected. Please select at least one file to proceed. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gpt-engineer.