Remove 2022 Remove Big Data Tools Remove Blog Remove PostgreSQL
article thumbnail

The Top 25 Data Engineering Influencers and Content Creators on LinkedIn

Databand.ai

The Top 25 Data Engineering Influencers and Content Creators on LinkedIn Ryan Yackel 2022-12-13 10:23:19 Interested in data engineering? Currently, he helps companies define data-driven architecture and build robust data platforms in the cloud to scale their business using Microsoft Azure.

article thumbnail

Data Engineering Annotated Monthly – January 2022

Big Data Tools

.” Spark: Ability to turn off auto commit in JDBC source for read only operations – In read-only transactions, Spark is currently able to read a huge amount of data in a single request, even if the fetch size is limited. For example, this is the case for PostgreSQL, and this behavior is even described in the docs.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Data Engineering Annotated Monthly – January 2022

Big Data Tools

.” Spark: Ability to turn off auto commit in JDBC source for read only operations – In read-only transactions, Spark is currently able to read a huge amount of data in a single request, even if the fetch size is limited. For example, this is the case for PostgreSQL, and this behavior is even described in the docs.

article thumbnail

100+ Data Engineer Interview Questions and Answers for 2023

ProjectPro

This blog is your one-stop solution for the top 100+ Data Engineer Interview Questions and Answers. In this blog, we have collated the frequently asked data engineer interview questions based on tools and technologies that are highly useful for a data engineer in the Big Data industry.