Remove what-are-python-sets-and-how-do-you-use-them
article thumbnail

How To Run Your Python Scripts

Knowledge Hut

If you are planning to enter the world of Python programming, the first and the most essential skill you should learn is knowing how to run Python script and code. Once you grab a seat in the show, it will be easier for you to understand whether the code will actually work or not.

Python 98
article thumbnail

Airflow Sensors: What you need to know

Marc Lamberti

Do you need to wait for a file? If you want to make complex and robust data pipelines, you have to understand how Sensors work genuinely. If you want to make complex and robust data pipelines, you have to understand how Sensors work genuinely. Well, guess what? How do you do that?

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Airflow DAG: Create your first DAG in 5 minutes

Marc Lamberti

Wondering how to process data in Airflow? What are the steps to code your data pipelines? At the end of this short tutorial, you will have your first Airflow DAG! You might think starting with Apache Airflow is hard, but it is not. But don’t worry, you will discover only what you need to start now!

article thumbnail

Getting started with Airflow in 10 mins

Marc Lamberti

At the end of this introduction to Airflow, you will be all set for getting started with Airflow. You will start with the basics, such as what Airflow is and the essential concepts. Then you will set up and run your local development environment using the Astro CLI to create your first data pipeline.

article thumbnail

Top 8 Snowflake Marketplace Questions, Answered

Snowflake

We have more than 540 providers, offering over 2,400 live, ready-to-use data products (as of Jan 31, 2024), so there are many options to help you enrich your own data resources, build new data apps and leverage the power of AI on Snowflake. Q: What’s the process for listing a data product on Snowflake Marketplace?

article thumbnail

How to use Airflow templates and macros

Marc Lamberti

Imagine that you want to execute an SQL request with the execution date of your DAG. How can you do that? How can you use the DAG ID when you send notifications to know which DAG to look at? Or what if you need to know when the next DAG run will be? What if you missed a week?

SQL 130
article thumbnail

Airflow Variables: The Ultimate Guide

Marc Lamberti

Airflow Variables are easy to use but easy to misuse as well. In this tutorial, you will learn everything you need about variables in Apache Airflow. What are they, how do they work, define one, get the value, and more. Imagine you have different tasks or DAGs using the same API.

AWS 130