Comments (7)
ilhnctn
commented on May 29, 2024
1
Yes @kaxil
I deployed on GKE and database is on CloudSQL (Postgresql).
data:
metadataConnection:
user: <AIRFLOW_DB_USER>
pass: <AIRFLOW_DB_PASSWORD>
host: postgres-db-proxy-service
port: 5432
db: airflowdb
...
postgresql:
enabled: falseBut interestingly it didn't work till I adjusted the liveness and readyness probes as below. The point is, periodSeconds has to be bigger than timeoutSeconds.
livenessProbe:
initialDelaySeconds: 25
timeoutSeconds: 20
failureThreshold: 20
periodSeconds: 30
readinessProbe:
initialDelaySeconds: 25
timeoutSeconds: 20
failureThreshold: 20
periodSeconds: 30from airflow-chart.
kaxil
commented on May 29, 2024
1
@ianstanton Whenever you get time can you look at this please, not urgent though
from airflow-chart.
vladwa
commented on May 29, 2024
Any updates on this?
from airflow-chart.
ilhnctn
commented on May 29, 2024
In my case I get password error.
psycopg2/__init__.py", line 127, in connect conn = _connect(dsn, connection_factory=connection_factory, **kwasync) psycopg2.OperationalError: FATAL: password authentication failed for user "postgres"from airflow-chart.
kaxil
commented on May 29, 2024
Did you'll setup the DB, user and password correctly for the Postgres DB?
from airflow-chart.
ianstanton
commented on May 29, 2024
@ilhnctn @vladwa What version of the chart are you using? I am seeing the following in version 0.18.7
▶ k logs airflow-postgresql-0 -f
postgresql 12:45:26.59
postgresql 12:45:26.60 Welcome to the Bitnami postgresql container
postgresql 12:45:26.60 Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-postgresql
postgresql 12:45:26.60 Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-postgresql/issues
postgresql 12:45:26.60 Send us your feedback at [email protected]
postgresql 12:45:26.60
postgresql 12:45:26.61 INFO ==> ** Starting PostgreSQL setup **
postgresql 12:45:26.63 INFO ==> Validating settings in POSTGRESQL_* env vars..
postgresql 12:45:26.64 INFO ==> Loading custom pre-init scripts...
postgresql 12:45:26.64 INFO ==> Initializing PostgreSQL database...
postgresql 12:45:26.65 INFO ==> postgresql.conf file not detected. Generating it...
postgresql 12:45:26.66 INFO ==> pg_hba.conf file not detected. Generating it...
postgresql 12:45:27.59 INFO ==> Starting PostgreSQL in background...
postgresql 12:45:27.72 INFO ==> Changing password of postgres
postgresql 12:45:27.75 INFO ==> Configuring replication parameters
postgresql 12:45:27.80 INFO ==> Configuring fsync
postgresql 12:45:27.81 INFO ==> Loading custom scripts...
postgresql 12:45:27.82 INFO ==> Enabling remote connections
postgresql 12:45:27.84 INFO ==> Stopping PostgreSQL...
postgresql 12:45:28.86 INFO ==> ** PostgreSQL setup finished! **
postgresql 12:45:28.94 INFO ==> ** Starting PostgreSQL **
2021-03-31 12:45:28.957 GMT [1] LOG: listening on IPv4 address "0.0.0.0", port 5432
2021-03-31 12:45:28.957 GMT [1] LOG: listening on IPv6 address "::", port 5432
2021-03-31 12:45:28.965 GMT [1] LOG: listening on Unix socket "/tmp/.s.PGSQL.5432"
2021-03-31 12:45:28.985 GMT [179] LOG: database system was shut down at 2021-03-31 12:45:27 GMT
2021-03-31 12:45:28.990 GMT [1] LOG: database system is ready to accept connections
2021-03-31 12:45:39.193 GMT [195] LOG: incomplete startup packet
2021-03-31 12:45:39.201 GMT [196] LOG: incomplete startup packet
2021-03-31 12:45:39.204 GMT [197] LOG: incomplete startup packet
2021-03-31 12:45:43.138 GMT [200] ERROR: relation "log" does not exist at character 13
2021-03-31 12:45:43.138 GMT [200] STATEMENT: INSERT INTO log (dttm, dag_id, task_id, event, execution_date, owner, extra) VALUES ('2021-03-31T12:45:43.130917+00:00'::timestamptz, NULL, NULL, 'cli_upgradedb', NULL, 'astro', '{"host_name": "airflow-run-airflow-migrations-7t5lt", "full_command": "[''/usr/local/bin/airflow'', ''upgradedb'']"}') RETURNING log.id
2021-03-31 12:45:46.697 GMT [201] LOG: incomplete startup packet
2021-03-31 12:45:46.706 GMT [202] LOG: incomplete startup packet
2021-03-31 12:45:47.258 GMT [203] LOG: incomplete startup packet
2021-03-31 12:45:54.358 GMT [214] LOG: unexpected EOF on client connection with an open transaction
from airflow-chart.
danielhoherd
commented on May 29, 2024
I'm closing this because the current chart is completely reworked, depending largely on the OSS chart.
from airflow-chart.
Related Issues (20)
- Spark binaries HOT 1
- Default ImagePullPolicy
- No gitSync config in values.yml HOT 1
- Astronomer maintenance of this repo? HOT 3
- Please update airflow version to 1.10.14 by default HOT 1
- If use 1.10.14-buster error alembic.script.revision.ResolutionError: No such revision or branch 'e959f08ac86c' HOT 1
- Can not change webserver.defaultUser.password when install by helm HOT 1
- Use helm-doc to generate parameter table
- Using Google Cloud Storage remote logging HOT 1
- Invalid image name when the image tag is integer HOT 6
- configmap sourced env values
- fernetKey when using airflow as dependency
- airflow command error: argument GROUP_OR_COMMAND: invalid choice: 'serve_logs' HOT 2
- Any helm upgrade with KEDA errors the scheduler HOT 1
- Syncing dags from multiple git-repos HOT 3
- Add imagePullSecret as a parameter to pull images from Private Container Registries HOT 1
- Help needed - additionalVolume not parsable by helm with version 0.25.8 HOT 1
- Unable to install chart "Deployment is not ready: airflow/airflow-scheduler" HOT 2
- Getting Airflow 404 = Lots of circles Error HOT 3
- Log Grooming script envvars HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from airflow-chart.