Comments (1)
Hello @Anthony-Duan, sorry for the delay.
Thank you for your questions. I will work on updating the documentation to include the answer to these questions, but here they are for your purposes:
Is the metadata_service_zookeeper_nodes configuration must required?
It is only required if metadata_service_type == ZookeeperMetadataService. Else you can leave it as the default.
If metadata_service_zookeeper_nodes is set, do I still need to configure scheduler_nodes_in_cluster?
Yes you would still need to set the scheduler_nodes_in_cluster
config as this is the list that the Scheduler Failover Conroller uses to determine which hosts are acting as Schedulers. These details are not included in Zookeeper.
use systemd to manage the airflow schedule process, Whether the Restart=always and the RestartSec=60configuration will affect the failover use scheduler_failover?
This may affect the Scheduler Failover controller as the controller might poll during a time in which the Scheduler is restarting. It is also recommended to diable the automatic restart of the Scheduler process in the SystemD file. So remove the Retry
and RestartSec
section in the default SystemD file.
from airflow-scheduler-failover-controller.
Related Issues (18)
- Will it work with apache-airflow 1.10.0 HOT 3
- Multiple Email Recievers HOT 1
- Convert to python3 HOT 3
- Cloudera Parcel HOT 2
- a bytes-like object is required, not 'str' 1.0.4 HOT 6
- it dont work for apache-airfow==1.9.0 and airflow-scheduler-failover-controller==1.0.5 HOT 1
- Add tests
- Need to Run on kubernetes
- meet AttributeError: 'NoneType' object has no attribute 'replace' when start the asfc
- the default ssh port is not 22,how to configure scheduler_failover_controller to another port?? HOT 1
- QA: Is this component still required for airflow 1.10.4 and later versions ?
- Airflow2.3.2 is incompatible
- Is there any way to keep airflow scheduler HA
- about metadata_service_type = SQLMetadataService Startup error HOT 1
- Failover Doesn't Occur if Scheduler Host is Dead HOT 1
- Will it work when I use apache-airflow 1.9.0? HOT 6
- Gave two nodes in scheduler_nodes_in_cluster . when I try to start failover controller. It fails.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from airflow-scheduler-failover-controller.