Comments (5)
acheong08
commented on June 7, 2024
6
The issue:
- Cloudflare blocks can only be bypassed with a browser
- Rate limiting has increased
- OpenAI blocks IP addresses of VPS / hosted servers
My solution:
- Host API on VPS/server
- Run agents on local devices such as PC or Raspberry Pi via browser. This bypasses the IP blocks and cloudflare
- Multiple accounts can connect to a single API server. This gets around rate limits by cycling through connections
Further proposal:
- A public community API can be made where everyone can congregate their account resources and make a large connection pool. This will allow much faster response times and also higher stability that is not affected by a single connection error.
from chatgpt-api-server.
acheong08
commented on June 7, 2024
All interaction to ChatGPT's API is done on the agent side. The server is simply a remote endpoint that can pool connections
from chatgpt-api-server.
acheong08
commented on June 7, 2024
Using websockets, requests to the server can be instantly forwarded to the agents even if they're behind a NAT
from chatgpt-api-server.
PortRoyale
commented on June 7, 2024
Will this allow for conversations still?
from chatgpt-api-server.
acheong08
commented on June 7, 2024
Yes. Conversations are linked to connections
from chatgpt-api-server.
Related Issues (20)
- Hello, I did not find any executable exe program after finishing go install. Therefore, my ChatGPT-API-server 8080 mysecretkey cannot take effect. May I ask how to change it HOT 21
- Sugggestion: Video Tutorial HOT 10
- Request takes forever HOT 10
- #0 9.445 cgo: C compiler "gcc" not found: exec: "gcc": executable file not found in $PATH HOT 2
- Failed to create database HOT 5
- 503 service unavailable HOT 22
- [New Feature] Add default retry to every `/api/ask` endpoint to utilize connection pool. HOT 11
- help needed for a new webpage and app. HOT 1
- [Err] 404 page not found HOT 6
- tñrun run HOT 2
- I rent an ECS and have installed and configured software. Is the following procedure correct? HOT 6
- Failed to convert response to ChatGptResponse HOT 7
- How to play proxy in linux server environment
- Win10 and win2012 cannot create a database HOT 10
- support text/event-stream for /api/ask
- Very complex
- Requests hanging HOT 7
- go install github.com/ChatGPT-Hackers/ChatGPT-API-server@latest
- Error: Request failed with status code: 429 HOT 10
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from chatgpt-api-server.