Comments (10)
Hi! Could you share a redacted section of your config?
from server.
@madkinsz Unfortunately, I had terminated that Virtual Machine from my cloud platform. I tried to create another setup but am seeing some different problem. I execute the following commands:
pip install prefect
prefect backend server
I am getting the following error:
ImportError: cannot import name 'stringify' from 'dask.utils' (/anaconda/envs/py37_default/lib/python3.7/site-packages/dask/utils.py)
I have docker and docker-compose installed on my machine. Please advise for this error.
from server.
This looks like an issue with your dask/distributed versions. I can't provide additional advice without more information
from server.
@madkinsz Attaching 2 files. The 1st one is Config.txt. It shows my docker is active. I have 2 config files - backend.toml and config.toml. I have a requirement to use my local Postgres database with Prefect. So I have added details to config.toml.
The 2nd file is prefect server start error related to docker service. I have docker running, even then I get error related to it.
I tried command - ip route | grep docker0 | awk '{print $9}'
Received response - 172.17.0.1.
Tried setting DOCKER_HOST=172.17.0.1.
But it did not work.
Please review the details that I have provided and advise on how to more forward with Prefect.
Let me know in case you still need any more details.
from server.
Do you have problems when you use an unmodified config? I do not believe this is an issue with Prefect and looks like a problem with your docker setup.
Can you run docker-compose pull
from the src/prefect/cli/
directory? (if you're not sure where this is -- python -c "import prefect; print(prefect.__file__)"
can you get started)
docker-compose up
won't work without all the environment variables set but you should able to use it to debug past this current error.
from server.
@madkinsz
1.
I saw a problem using unmodified config. Later installing psutil fixed it.
Without configuration, I am able to start Prefect. Refer file - Prefect Server Start without Config.txt
2.
docker-compose pull - Worked for me.
docker-compose up - Did not work. Refer attachment docker-compose executions.txt to see the errors.
3.
Further I tried to start Prefect with my configuration file. It started but I am not sure if it connected Postgres database installed in my machine or not. Refer Prefect Server Start with Config.txt for more details.
I used prefect server start --no-postgres-port to start Prefect because my local database is also running on 5432 and it was conflicting. I believe that --no-postgres-port does not configure postgres from docker image and uses my database.
If not then please correct me.
Prefect Server Start without Config.txt
Prefect Server Start with Config.txt
docker-compose executions.txt
from server.
This isn't really a supported pattern for prefect server start
but there may be a workaround. There's no way to stop the postgres container from being created so --no-postgres-port
stops the created container from binding to your local address so they no longer conflict. However, it looks like at https://github.com/PrefectHQ/prefect/blob/master/src/prefect/cli/server.py#L19 the localhost
is replaced with postgres
to use the docker-compose internal communication so it is likely that it is connecting to the wrong postgres instance still. I believe if you change localhost
to 127.0.0.1
or 0.0.0.0
it will no longer be replaced and it should connect to your database!
I've created an issue to improve this functionality at PrefectHQ/prefect#3891
from server.
@madkinsz Thank you for your analysis and issue reporting.
I already had localhost mapped to 127.0.0.1 in my system. I tried changing it to 0.0.0.0.
Please refer attached file. I still do not see my local database getting connected with Prefect.
Please advise.
Do you think I should wait for PrefectHQ/prefect#3891 to be fixed first?
from server.
@madkinsz Thank you for your analysis and issue reporting.
I already had localhost mapped to 127.0.0.1 in my system. I tried changing it to 0.0.0.0.
Please refer attached file. I still do not see my local database getting connected with Prefect.
Please advise.
I'm talking about changing the host of your database in the prefect the config to 127.0.0.1 explicitly instead of localhost so it is not replaced by postgres
by the line I linked.
Do you think I should wait for PrefectHQ/prefect#3891 to be fixed first?
If that's an option. I do not know how soon it will be fixed though.
from server.
@madkinsz This did not work. I get an error : Is the server running on host "127.0.0.1" and accepting TCP/IP connections on port 5432?
When I use the same credentials in DBeaver, I am able to connect to the database which means database is accepting connections. So not able to understand why the connection request s not going fine with Prefect.
from server.
Related Issues (20)
- Can't use special characters in `--postgres-url` connection string (user name) HOT 3
- Helm default values for env are of incorrect type HOT 1
- prefect 0.15.12 - zombie processes from hasura container HOT 10
- The latest Server release fails to start on M1 even when allocating 8GB RAM HOT 3
- Registering parameterized flows fails on 2022.01.12 HOT 1
- default value for agent.resources.limits is invalid HOT 1
- Maximum size for state payloads is limited to 1 mb HOT 4
- Update Postgres Helm chart template notes to include postgres prefix when setting password value HOT 3
- White flow run bars in the Cloud UI - flow runs created with Version 0 and with no state
- [Helm] Add RBAC support for KubeCluster (dask-kubernetes) HOT 6
- [Helm] Updating helm chart to 2022.03.29 fails HOT 1
- Cloud hooks not working with Microsoft Teams HOT 1
- helm chart (prefect-server) shouldn't contain a dash HOT 2
- Latest Helm chart does not pin versions HOT 1
- Upgrade from Ubuntu 16 CircleCI issues by May 31, 2022
- Backend Server is unable to start properly HOT 4
- Helm dep up failed because Postgresql version
- Malformed imagePullSecrets in Kubernetes agent
- Prefect Server on raspberry pi4 with Ubuntu 20.04 HOT 1
- Duplicated Helm chart
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from server.