Comments (8)
Hi @NageshMashette,
- Docs are available here:
localhost:800/docs
. Check the examples directory to see client and server combinations. I suggest using the python RemoteRunnable client to interact with the server. - The chain that you've implementing will NOT work correctly for what I'd consider server use since it has a single global state for the memory that will be shared between all users. We'll be releasing more documentation on how to set this up in the upcoming 1-2 weeks.
from langserve.
Closing as this is not an issue but a question
from langserve.
https://github.com/langchain-ai/langserve/blob/main/examples/conversational_retrieval_chain/client.ipynb
without memory also im facing issue , i fallowed client code provided in example folder.
i used
**from langserve import RemoteRunnable
remote_runnable = RemoteRunnable("http://localhost:8000/")
await remote_runnable.ainvoke({"question": "Hi how are you?", "chat_history": ""})**
HTTPStatusError: Client error '404 Not Found' for url 'http://localhost:8000/invoke'
For more information check: https://httpstatuses.com/404 for {"detail":"Not Found"}
from langserve.
faced same issue .After updating to latest version of langserve its started working for me.
from langserve.
faced same issue .After updating to latest version of langserve its started working for me.
are you able to execute with memory?
from langserve.
Has anyone tried to combine conversation memory with langchain chain that is served using langserve?
from langserve.
I don't recommend using the old memory abstractions. Instead take a look at the examples in the readme there are examples that show how to handle conversation history including multi user support.
from langserve.
thanks @eyurtsev ok let me try it.
from langserve.
Related Issues (20)
- Langserve configurable does not set/update the ConfigurableField variables that is given by per_req_config_modifier HOT 1
- Issue: custom metadata sent to `RemoteRunnable(...).with_config(metadata={...}).{invoke,stream,etc}()` is not provided to the runnable in langserve.api_handler.APIHandler._get_config_and_input
- Running background tasks HOT 2
- Default `extra_body` configuration lost when generating API documentation, use api also have this behavior HOT 1
- LangServe playground crashes on browser due to out of memory HOT 1
- `InvokeRequestShallowValidator` prevents LangGraph continuing execution after interrupt
- Issue with Integrating NeMo Guardrails with LangChain and LangServe for Chatbot
- Pass authentication token to RemoteRunnable HOT 2
- Grouping Traces into Threads using "Chat" Interface with LangServe
- LangServe JS client - forward Http-Only cookies when calling stream HOT 1
- Scaling to production -> OSError: [Errno 24] Too many open files socket.accept() out of system resource HOT 1
- Memory leak in LangServe HOT 39
- Langserve Playground does not put out any text response when in chat mode (but it does when in default mode) HOT 2
- Langserve :there is a conflict between langchain-cli and fastapi-cli on the version of typer.
- Bug: TypeError: Type is not JSON serializable: Send HOT 4
- No run_id found for the given run. HOT 1
- Support for stream_events v2 HOT 4
- RuntimeError calling add_routes with chains that have input types in Pydantic v2 HOT 2
- I have the same issue,The problem seems due to the ContextualCompressionRetriever,It outputs some info cannot be serialized. HOT 1
- langchain serve using different folder HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from langserve.