Remove shortcircuitoperator-in-apache-airflow
article thumbnail

11 Ways To Stop Data Anomalies Dead In Their Tracks

Monte Carlo

By leveraging the Airflow ShortCircuitOperator , you can stop the job from running if the data does not match a prescribed set of anticipated characteristics. The actual data contract itself is typically written in a templated interactive data language (IDL) such as Apache Avro or JSON. Interested in a deeper dive?

Food 52