Comments (3)
I was unable to replicate this on main
. A few theories which might explain the issues here:
-
You will need to update the
max_templated_field_length
setting on your executors in order for it to take effect. Setting it on only the webserver won't change anything since the rendered fields are saved at execution time in the RTIF table. -
Changing this setting will not un-truncate the rendered templates for tasks which already ran, since the templates are only rendered once (at execution time), so only tasks run after the setting has been changed will reflect the larger value of
max_templated_field_length
.
Do either of these explain the issues you've been seeing?
from airflow.
@SamWheating Thank you very much, Sam, the problem was the the second point. What confused me was that the "truncated" data in the Task Instance Details section displayed correctly immediately after changing the max_templated_field_length.
from airflow.
not an error
from airflow.
Related Issues (20)
- TimeSensor change by default_timezone is not working HOT 1
- AwsAuthManager seems to be incompatible with Airflow 2.8 HOT 3
- A wild discussion turns to an issue HOT 9
- Visible Secrets in XCOM Outputs HOT 4
- Configuration file not in effect HOT 3
- Airflow Random Failure with SQS HOT 1
- Airflow scheduler gets exit while running application HOT 1
- Emit OL `FAIL` event when manually marking a DAG as failed HOT 1
- DynamoDBToS3Operator using native export functionality. HOT 4
- ExternalTaskSensor doesn't check existence in deferrable model HOT 4
- Add a keytab field to the Spark connection (handle the base64 encoded text value as a credential). HOT 2
- Status of testing Providers that were prepared on July 12, 2024 HOT 2
- Status of testing of Apache Airflow 2.9.3rc1 HOT 12
- Using the @task.external_python() to call a task in a venv fails due to attempting to import airflow and other packages not in the external venv HOT 2
- Exception when using session object in CustomPriorityWeightPlugin
- Dependent DAG Based schedules HOT 3
- soft_fail | operator is skipped in all cases and not only "data" related fail HOT 11
- DatabricksRunNowOperator failing as named parameters Jinja templating not getting resolved HOT 10
- AWS SNS Sensor HOT 3
- OpenLineage: Add AirflowRunFacet to DAG run events HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from airflow.