Data Engineering Podcast

AUGUST 6, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Machine Learning 100

Machine Learning Database MySQL PostgreSQL 100

Knowledge Hut

SEPTEMBER 6, 2023

EnterpriseDB PostgreSQL 12 Associate Certification The associated exam is CERT-DBA-001.12. One needs to complete foundations of PostgreSQL course. EnterpriseDB PostgreSQL 12 Professional Certification The associated exam is CERT-DBA-002.12. MongoDB Associate DBA Exam The associated exam is C100DBA. MongoDB aggregation.

Database 52

Database Certification MongoDB MySQL 52

Ascend.io

SEPTEMBER 14, 2023

Use Case: Transforming monthly sales data to weekly averages import dask.dataframe as dd data = dd.read_csv('large_dataset.csv') mean_values = data.groupby('category').mean().compute() compute() Data Storage Python extends its mastery to data storage, boasting smooth integrations with both SQL and NoSQL databases.

Data Engineering 52

Data Engineering Data Engineer Python Engineering 52

Rockset

NOVEMBER 28, 2022

First, CDC theoretically allows companies to analyze and react to data in real time, as it’s generated. It works with existing streaming systems like Apache Kafka, Amazon Kinesis, and Azure Events Hubs, making it easier than ever to build a real-time data pipeline. Striim : A unified data integration and streaming platform.

Data Warehouse 52

Data Warehouse PostgreSQL MongoDB Data Pipeline 52

Rockset

AUGUST 30, 2021

A Quick Primer on Indexing in Rockset Rockset allows users to connect real-time data sources — data streams (Kafka, Kinesis), OLTP databases (DynamoDB, MongoDB, MySQL, PostgreSQL) and also data lakes (S3, GCS) — using built-in connectors.

SQL 52

SQL Kafka MongoDB MySQL 52

Rockset

OCTOBER 11, 2022

Introduction Managing streaming data from a source system, like PostgreSQL, MongoDB or DynamoDB, into a downstream system for real-time analytics is a challenge for many teams. Logstash is an event processing pipeline that ingests and transforms data before sending it to Elasticsearch.

Data Ingestion 52

Data Ingestion Kafka Relational Database PostgreSQL 52

Databand.ai

DECEMBER 13, 2022

We’d be remiss not to share that Joseph was a recent guest on Databand’s MAD Data Podcast , where he discussed ways to keep data systems from becoming unwieldy and shared tips for data teams to manage their data warehouses and keep data pipelines running reliably. You can also watch the video recording.

Data Engineering 52

Data Engineering Data Engineer Engineering AWS 52

AltexSoft

JUNE 26, 2023

Both data integration and ingestion require building data pipelines — series of automated operations to move data from one system to another. For this task, you need a dedicated specialist — a data engineer or ETL developer. They can be accumulated in NoSQL databases like MongoDB or Cassandra.

Data Collection 52

Data Collection Machine Learning Unstructured Data Non-relational Database 52

Rockset

JULY 25, 2019

Your user-facing interactive apps query the same data engine to fetch insights from your data set in real time, and you then use that intelligence to provide a better user experience to your users. In this respect, it is very similar to transactional databases like Oracle, PostgreSQL, etc.

Software Engineer 40

Software Engineer Software Engineering Engineering PostgreSQL 40

ProjectPro

JANUARY 19, 2022

Build an Awesome Job Winning Project Portfolio with Solved End-to-End Big Data Projects AWS Projects AWS Project-Website Monitoring using AWS Lambda and Aurora How to deal with slowly changing dimensions using Snowflake? If you have the correct data engineering learning path with you, you can easily become a data engineer in six months.

Data Engineering 52

Data Engineering Data Engineer Engineering Amazon Web Services 52

Knowledge Hut

SEPTEMBER 6, 2023

Certification Provider : IBM Duration : ~5 months at 10 hours a week Cost : $98 USD Importance : Learn to create, design, & manage relational databases & apply database administration (DBA) concepts to RDBMSs such as MySQL, PostgreSQL, & IBM Db2.

Big Data 52

Big Data Certification Hadoop Scala 52

ProjectPro

JULY 27, 2021

Non-relational databases are ideal if you need flexibility for storing the data since you cannot create documents without having a fixed schema. E.g. PostgreSQL, MySQL, Oracle, Microsoft SQL Server. E.g. Redis, MongoDB, Cassandra, HBase , Neo4j, CouchDB What is data modeling? How Data Engineering helps Businesses? |

Data Engineering 40

Data Engineering Data Engineer Engineering Hadoop 40