Christophe Blefari

FEBRUARY 23, 2024

This week I've participated to a round table about data and did a cool presentation about Engines. The idea was to depict the history of engines over the last 40 years and what leads to polars and DuckDB. Engines evolution (me) There are 3 points that have triggered discussion about the visualisation I done What about Arrow?

Data Lake 130

Data Lake PostgreSQL MongoDB Scala 130

Ascend.io

SEPTEMBER 14, 2023

The rise of data-intensive operations has positioned data engineering at the core of today’s organizations. As the demand to efficiently collect, process, and store data increases, data engineers have started to rely on Python to meet this escalating demand. Why Python for Data Engineering?

Data Engineering 52

Data Engineering Data Engineer Python Engineering 52

Data Engineering Podcast

JANUARY 7, 2018

Summary PostGreSQL has become one of the most popular and widely used databases, and for good reason. In this episode Ozgun Erdogan, the CTO of Citus, and Craig Kerstiens, Citus Product Manager, discuss how the company got started, the work that they are doing to scale out PostGreSQL, and how you can start using it in your environment.

PostgreSQL 100

PostgreSQL Big Data NoSQL Data 100

Rockset

NOVEMBER 5, 2021

Summary: DataBrain, a SaaS company, was using PostgreSQL through Amazon RDS to land and query incoming customer data. However, PostgreSQL couldn’t scale, quickly ingest schemaless data, or efficiently run analytics as DataBrain’s data grew. PostgreSQL in the cloud was also straightforward to set up and well-established as a technology.

PostgreSQL 52

PostgreSQL Structured Data Data Lake Data Ingestion 52

Cloudera

JULY 16, 2021

Today, we are pleased to announce the general availability of HPL/SQL integration in CDW public cloud. You can now define Hive stored procedures using the HPL/SQL to perform a set of SQL statements (DDLs & DMLs), control-of-flow language. These Hive stored procedures are stored in the Hive MetaStore (HMS).

Data Warehouse 118

Data Warehouse SQL PostgreSQL MySQL 118

Data Engineering Weekly

JULY 2, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack Profiles takes the SaaS guesswork, and SQL grunt work out of building complete customer profiles, so you can quickly ship actionable, enriched data to every downstream team. So, let's shape the future of Data Engineering together. See how it works today.

Data Engineering 52

Data Engineering Data Engineer Engineering Pipeline-centric 52

Data Engineering Podcast

JANUARY 13, 2020

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. A growing trend in database engines (e.g.

SQL 100

SQL PostgreSQL MongoDB Database Design 100

Rockset

JULY 9, 2019

Consider the hoops we have to jump through when working with semi-structured data, like JSON, in relational databases such as PostgreSQL and MySQL. In software engineering terms, this is what’s known as a high impedance mismatch. It sounds simple, but it rarely is. JSON is a good match for document databases, such as MongoDB.

Relational Database 40

Relational Database PostgreSQL MySQL Database 40

Christophe Blefari

JUNE 16, 2023

I'm now under the Berlin rain with 20° When I write in these conditions I feel like a tortured author writing a depressing novel while actually today I'll speak about the AI Act, Python, SQL and data platforms. The ultimate SQL guide — After the last canva on data interviews, here's a canva to learn SQL.

Programming Language 130

Programming Language SQL PostgreSQL Data 130

Data Engineering Weekly

JUNE 18, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make it easy to collect data from every application, website, and SaaS platform, then activate it in your warehouse and business tools. SQL, in theory, should be a standard, but unfortunately, that is not the case in the real world.

Data Engineering 52

Data Engineering Data Engineer Engineering MySQL 52

Knowledge Hut

NOVEMBER 28, 2023

The contemporary world experiences a huge growth in cloud implementations, consequently leading to a rise in demand for data engineers and IT professionals who are well-equipped with a wide range of application and process expertise. Data Engineer certification will aid in scaling up you knowledge and learning of data engineering.

Data Engineering 52

Data Engineering Data Engineer Engineering Generalist 52

Rockset

JULY 6, 2022

Typically stored in SQL statements, the schema also defines all the tables in the database and their relationship to each other. Companies carefully engineered their ETL data pipelines to align with their schemas (not vice-versa). SQL queries were easier to write. Changing schemas was difficult and rarely done.

NoSQL 52

NoSQL SQL Systems PostgreSQL 52

Data Science Blog: Data Engineering

DECEMBER 23, 2022

Warum Data Engineering der Data Science in Bedeutung und Berufschancen längst die Show stiehlt, dabei selbst ebenso einem stetigen Wandel unterliegt. Was ein Data Engineer wirklich können muss Der Data Scientist als sexiest Job des 21. Data Engineer, der gefragteste Job des 21sten Jahrhunderts? Jahrhunderts?

Data Engineering 52

Data Engineering Data Engineer Engineering Business Intelligence 52

Data Engineering Podcast

JANUARY 13, 2019

Introduction Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out Linode.

Database 100

Database PostgreSQL SQL MongoDB 100

Towards Data Science

JUNE 19, 2023

Photo by CHUTTERSNAP on Unsplash This article is about Meerschaum Compose , a tool for defining ETL pipelines in YAML and a plugin for the data engineering framework Meerschaum. As more data engineers built their pipelines using the platform, the dynamic nature of pipes meant that a solution was needed to provide project-level isolation.

PostgreSQL 80

PostgreSQL SQL Python Project 80

Christophe Blefari

JULY 8, 2023

Dans le premier épisode j'ai discuté avec Benoit Pimpaud qui a été data scientist à l'Olympique de Marseille et qui s'est reconverti plus tard chez Deezer en data engineer. The idea, is then, to use the semantics to generate SQL queries. I put words on data engineering.

Kafka 130

Kafka PostgreSQL Transportation Data 130

Christophe Blefari

APRIL 28, 2023

At the moment we have a dbt Semantic Layer that correspond to YAML definitions and MetricFlow—which was Transform open-source project—that is able to understand the semantics to generates SQL. or employees (SQL writing or document drafting) ; either by improving actual AI stuff: search, discovery, information extraction.

SQL 100

SQL Food PostgreSQL Data 100

Data Engineering Podcast

APRIL 19, 2020

In this episode Eventador Founder and CEO Kenny Gorman describes how the platform is architected, the challenges inherent to managing reliable streams of data, the simplicity offered by a SQL interface, and the interesting projects that his customers have built on top of it. How does it fit into an application architecture?

Building 100

Building PostgreSQL MongoDB SQL 100

Big Data Tools

OCTOBER 5, 2021

As data engineers, let’s follow their lead and learn something new, too! News A lot of engineering is about learning new things and keeping a finger on the pulse of new technologies. Here’s what’s happening in data engineering right now. And of course, PostgreSQL is one of the most popular databases.

Data Engineering 52

Data Engineering Data Engineer Engineering Big Data Tools 52

Big Data Tools

OCTOBER 5, 2021

As data engineers, let’s follow their lead and learn something new, too! News A lot of engineering is about learning new things and keeping a finger on the pulse of new technologies. Here’s what’s happening in data engineering right now. And of course, PostgreSQL is one of the most popular databases.

Data Engineering 52

Data Engineering Data Engineer Engineering Big Data Tools 52

Knowledge Hut

DECEMBER 5, 2023

If you have a passion for information technology (IT) and dream of turning it into a fulfilling career, ponder the path of a systems engineer. Join us on a detailed exploration of who can pursue a career as a systems engineer and the steps to become one in the year 2024. Who is a System Engineer, and What Do They Do?

Systems 52

Systems Engineering Recruitment Electronics 52

Rockset

AUGUST 30, 2021

The latest Rockset release, SQL-based rollups, has made real-time analytics on streaming data a lot more affordable and accessible. Anyone who knows SQL, the lingua franca of analytics, can now rollup, transform, enrich and aggregate real-time data at massive scale. That is sufficient for some use cases.

SQL 52

SQL Kafka MongoDB MySQL 52

Striim

NOVEMBER 17, 2023

Meanwhile, Google BigQuery ML is a machine learning service provided by Google Cloud, allowing you to create and deploy machine learning models using SQL-like syntax directly within the BigQuery environment. In this blog, we will focus on a PostgreSQL database. ensuring the consistency and integrity of your data.

Machine Learning 52

Machine Learning Data Process PostgreSQL Process 52

Data Engineering Podcast

OCTOBER 2, 2022

Alvin is a platform that aims to provide a low effort solution for data lineage capabilities focused on simplifying the work of data engineers. Sign up free… or just get the free t-shirt for being a listener of the Data Engineering Podcast at dataengineeringpodcast.com/rudder.

IT 100

IT Food PostgreSQL MongoDB 100

Data Engineering Podcast

FEBRUARY 11, 2018

Preamble Hello and welcome to the Data Engineering Podcast, the show about modern data infrastructure When you’re ready to launch your next project you’ll need somewhere to deploy it. release of PostGreSQL had on the design of the project? Is timescale compatible with systems such as Amazon RDS or Google Cloud SQL?

PostgreSQL 100

PostgreSQL NoSQL Google Cloud MongoDB 100

Data Engineering Podcast

JUNE 10, 2018

To address these shortcomings the engineers at Cockroach Labs have built a globally distributed SQL database with full ACID semantics in Cockroach DB. I know that your SQL syntax is PostGreSQL compatible, so is it possible to use existing ORMs unmodified with CockroachDB?

PostgreSQL 100

PostgreSQL NoSQL Relational Database SQL 100

Cloudera

JULY 15, 2019

At a time when machine learning, deep learning, and artificial intelligence capture an outsize share of media attention, jobs requiring SQL skills continue to vastly outnumber jobs requiring those more advanced skills. Influential data scientists often point to SQL as the most important yet underrated skill for anyone who works with data.

Education 58

Education Data Analysis Big Data SQL 58

Monte Carlo

DECEMBER 4, 2023

At the heart of data engineering lies the ETL process—a necessary, if sometimes tedious, set of operations to move data across pipelines for production. So, don’t forget to review your ChatGPT outputs before leverage scripts or pushing any SQL code to production. Can you help me craft the SQL query for this extraction?

PostgreSQL 52

PostgreSQL Data Lake ETL Tools MySQL 52

Knowledge Hut

MARCH 27, 2024

SQL, or structured query language, is widely used for writing and querying data. Storage Format Stored in tables with rows and columns, often using SQL (Structured Query Language). Examples MySQL, PostgreSQL, MongoDB Arrays, Linked Lists, Trees, Hash Tables Scaling Challenges Scales well for handling large datasets and complex queries.

Database 52

Database Algorithm Relational Database PostgreSQL 52

Databand.ai

DECEMBER 13, 2022

The Top 25 Data Engineering Influencers and Content Creators on LinkedIn Ryan Yackel 2022-12-13 10:23:19 Interested in data engineering? LinkedIn is full of influencers sharing new ideas and sparking conversations on all kinds of topics, and data engineering is no exception. You’ve come to the right place. Happy following!

Data Engineering 52

Data Engineering Data Engineer Engineering AWS 52

Data Engineering Podcast

MAY 20, 2018

Presto is a distributed SQL engine that allows you to tie all of your information together without having to first aggregate it all into a data warehouse. For someone who is using the Presto SQL interface, what are some of the considerations that they should keep in mind to avoid writing poorly performing queries?

PostgreSQL 100

PostgreSQL Hadoop SQL Kafka 100

Data Engineering Podcast

MARCH 2, 2020

Summary Building applications on top of unbounded event streams is a complex endeavor, requiring careful integration of multiple disparate systems that were engineered in isolation. Developers can work with the SQL constructs that they are familiar with while automatically getting the durability and reliability that Kafka offers.

Kafka 100

Kafka Process PostgreSQL MySQL 100

Silectis

JANUARY 3, 2021

If you’re new to data engineering or are a practitioner of a related field, such as data science, or business intelligence, we thought it might be helpful to have a handy list of commonly used terms available for you to get up to speed. Data Engineering Data engineering is a process by which data engineers make data useful.

Data Engineering 40

Data Engineering Data Engineer Engineering Hadoop 40

Data Engineering Podcast

JUNE 22, 2021

We spend countless hours designing the data model, updating engine versions, and tuning performance. In this episode he explains how the system works, the challenge of scaling it to work across different database engines, and his hopes for the future of database systems. What is involved in adding support for a new database engine?

Database 100

Database MySQL PostgreSQL Data Warehouse 100

Data Engineering Podcast

AUGUST 6, 2022

In this episode Frank Liu explains how the open source Milvus vector database is implemented to speed up machine learning development cycles, how to think about proper storage and scaling of these vectors, and how data engineering and machine learning teams can collaborate on the creation and maintenance of these data sets.

Machine Learning 100

Machine Learning Database MySQL PostgreSQL 100

Cloudera

JUNE 3, 2022

Data scientists and machine learning engineers in enterprise organizations need to fully understand their data in order to properly analyze it, build models, and power machine learning use cases across their business. Data scientists are likely to use a variety of different tools to move through their processes. Next Steps.

Data Analysis 92

Data Analysis PostgreSQL Data Science SQL 92

Pipeline Data Engineering

DECEMBER 15, 2021

Data engineering salon. Serverless dbt on Google Cloud Platform Robert Sahlin, Senior Data Engineer, MatHem.se Orchestrating ELT with Prefect and dbt — a Flow of Flows (Part 1) Anna Geller, Solutions Engineer, Prefect How to manage dependencies between data pipelines. News and interesting reads about the world of data.

PostgreSQL 52

PostgreSQL Google Cloud Banking Consulting 52