Data Engineering Podcast

OCTOBER 23, 2022

To help other people find the show please leave a review on Apple Podcasts and tell your friends and co-workers Links MariaDB HTML Goodies MySQL PHP MySQL/MariaDB Pluggable Storage InnoDB MyISAM Aria Storage SQL/PSM MyRocks MariaDB XPand BSL == Business Source License Paxos MariaDB MongoDB Compatibility Vertica MariaDB Spider Storage Engine IHME == (..)

Database 100

Database MySQL Cloud MongoDB 100

Data Engineering Podcast

MAY 29, 2022

To help other people find the show please leave a review on iTunes and tell your friends and co-workers Links Bluesky Data Get A Free Health Check For Your Snowflake From Bluesky RocksDB Snowflake Podcast Episode Trino Podcast Episode Firebolt Podcast Episode Bigquery Hive Vertica Michael Stonebraker Teradata C-Store Paper Ottertune Podcast Episode (..)

Cloud 100

Cloud Data Warehouse Data Lake Data 100

Data Engineering Podcast

APRIL 22, 2018

Links OctopAI Metadata Metadata Management Data Integrity CRM (Customer Relationship Management) ERP (Enterprise Resource Planning) Business Intelligence ETL (Extract, Transform, Load) Informatica SAP Data Governance SSIS (SQL Server Integration Services) Vertica Airflow Luigi Oozie GDPR (General Data Privacy Regulation) Root Cause Analysis The intro (..)

Business Intelligence 113

Business Intelligence Metadata Management Data Governance 113

Data Engineering Podcast

SEPTEMBER 19, 2021

How does this differ from in-database ML capabilities such as what is offered by Vertica and BigQuery? How does this differ from in-database ML capabilities such as what is offered by Vertica and BigQuery? Once a model has been deployed, what are the mechanisms that you expose for interacting with it?

Machine Learning 100

Machine Learning Data Warehouse Banking Metadata 100

Data Engineering Podcast

NOVEMBER 22, 2017

Contact Information Doug: cutting on GitHub Blog @cutting on Twitter Julien Email @J_ on Twitter Blog julienledem on GitHub Links Apache Avro Apache Parquet Apache Arrow Hadoop Apache Pig Xerox Parc Excite Nutch Vertica Dremel White Paper Twitter Blog on Release of Parquet CSV XML Hive Impala Presto Spark SQL Brotli ZStandard Apache Drill Trevni Apache (..)

Hadoop 100

Hadoop Data Storage Data Pipeline SQL 100

Data Engineering Podcast

JUNE 10, 2018

Links CockroachDB Cockroach Labs SQL Google Bigtable Spanner NoSQL RDBMS (Relational Database Management System) “Big Iron” (colloquial term for mainframe computers) RAFT Consensus Algorithm Consensus MVCC (Multiversion Concurrency Control) Isolation Etcd GDPR Golang C++ Garbage Collection Metaprogramming Rust Static Linking Docker Kubernetes (..)

PostgreSQL 100

PostgreSQL NoSQL Relational Database SQL 100

Data Engineering Podcast

NOVEMBER 23, 2020

To help other people find the show please leave a review on iTunes and tell your friends and co-workers Join the community in the new Zulip chat workspace at dataengineeringpodcast.com/chat Links Bigeye Uber A/B Testing Hadoop MapReduce Apache Impala One King’s Lane Vertica Mode Tableau Jupyter Notebooks Redshift Snowflake PyTorch Podcast.__init__

Hadoop 100

Hadoop Data Pipeline BI Data 100

Scott Logic

NOVEMBER 6, 2023

Everyone from Vertica to Snowflake to Google is offering some form of machine learning capabilities within their main data offerings. Be aware that the flexibility and maturity and programming interfaces will differ so not all will be equal for a given use case.

Data Lake 52

Data Lake Kafka BI Unstructured Data 52

Data Engineering Podcast

JULY 8, 2019

Contact Info Robert LinkedIn hodgesrm on GitHub Alexander alex-zaitsev on GitHub LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Data Warehouse 100

Data Warehouse MySQL Data Lake Hadoop 100

ProjectPro

OCTOBER 3, 2016

News on Hadoop-September 2016 HPE adapts Vertica analytical database to world with Hadoop, Spark.TechTarget.com,September 1, 2016. To compete in a field of diverse data tools, Vertica 8.0 Vertical analytic platform could access hadoop data before but with Vertica 8.0 Broadwayworld.com, September 13,2016.

Hadoop 52

Hadoop Database-centric Pipeline-centric Big Data 52

Rockset

MAY 23, 2019

It should be no surprise that column-oriented storage is used by some of the most successful data warehousing solutions, such as Snowflake, Amazon Redshift, Google's BigQuery, or Vertica. Search Indexing Search indexing is a technique that makes search-like queries fast.

Database 52

Database Datasets Media Algorithm 52

ProjectPro

FEBRUARY 1, 2017

The data architecture is based on open source standards Pentaho and is used for managing, preparing and integrating data that runs through their environments including Cloudera Hadoop Distribution , HP Vertica, Flume and Kafka. Source : [link] How Hadoop helps Experian crunch credit reports.

Hadoop 52

Hadoop MongoDB Big Data Kafka 52

AltexSoft

SEPTEMBER 19, 2023

To stay ahead of rivals, Agoda employed Vertica Analytics Platform (now owned by OpenText.) “Customers will stick with us if we provide high-quality products and a streamlined experience, and accommodation owners will offer optimized pricing if we give them the best marketplace,” Idan Zalzberg, VP Data at Agoda, explains.

Hospitality 52

Hospitality Machine Learning Data Governance BI 52

Rockset

OCTOBER 4, 2022

This is also a design that has been used by well-known data warehouses like Teradata and Vertica. This helps reduce contention and improve performance because each node in the cluster processes the data in its local storage.

MySQL 52

MySQL Kafka Aggregated Data Architecture 52

Maxime Beauchemin

JANUARY 20, 2017

Also note that support for encoding and compression in serialization formats like Parquet or ORC, or in database engines like Vertica, address most of the performance loss that would normally be associated with denormalization. Those systems have been taught to normalize the data for storage on their own.

Data Engineering 130

Data Engineering Data Engineer Engineering ETL Tools 130

Dataquest

OCTOBER 16, 2019

Of course, a data engineer doesn’t have to know all of these, but this list illustrates just how much there is to do in the world of data engineering. Once you’ve got the skills to get jobs, you’ve got a lot of freedom to choose what you’re working on and what tools you’re working with.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Science 52

Monte Carlo

FEBRUARY 6, 2023

and later) Snowflake (version 3) Teradata (version 13 and later) Vertica (version 7.2 AWS SCT, can currently convert the following data warehouse schemas to Amazon Redshift: Amazon Redshift Azure Synapse Analytics (version 10) Greenplum Database (version 4.3 and later) Microsoft SQL Server (version 2008 and later) Netezza (version 7.0.3

Data Warehouse 52

Data Warehouse AWS Data Validation Data 52

ProjectPro

AUGUST 26, 2015

said Chris Lynch, the ex CEO of Vertica. "Big data is at the foundation of all of the megatrends that are happening today, from social to mobile to the cloud to gaming."- ”- Atul Butte, Stanford With the big data hype all around, it is the fuel of the 21 st century that is driving all that we do.

Big Data 40

Big Data Unstructured Data Hadoop NoSQL 40

ProjectPro

JUNE 26, 2015

The collected big data is then fed into the HP Vertica platform which analyses the readings precisely to find out regions or locations of endangered species.This helps the conservation department invest time and money in specific regions to save the endangered species.

Big Data 40

Big Data Food Unstructured Data Retail 40

ProjectPro

MAY 11, 2015

The skill MapReduce in Java is an additional plus but not required. Here is another image which shows a job posting on Dice.com for the designation of a Big Data Engineer- The job description clearly underlines the minimum required skills for this role as Java, Linux and Hadoop.

Java 40

Java Hadoop Programming Language Bytes 40

Uber Engineering

AUGUST 3, 2018

From driver and rider locations and destinations, to restaurant orders and payment transactions, every interaction on Uber’s transportation platform is driven by data.

Metadata 110

Metadata Big Data Transportation Data 110