Monte Carlo

OCTOBER 12, 2023

Users can now opt to have this data stored within a separate S3 or GCS bucket hosted within their AWS or GCP environment for complete control without having to host an agent. They may have a desire or requirement for this type of sampling data to persist within their clouds, but they would rather not deploy and manage an agent.

Cloud 52

Cloud AWS Metadata Architecture 52

KDnuggets

NOVEMBER 2, 2021

Want three reasons to avoid the cloud and host your own analytics platform? More data, more control, more secure.

Cloud 90

Cloud Data Data Analytics Data Science 90

KDnuggets

JULY 15, 2022

How can you showcase your data scientist skills and abilities? The answer to this question is online platforms where you can publish your portfolio and seize opportunities.

Portfolio 126

Portfolio Data Science Data 126

KDnuggets

MAY 18, 2022

5 Free Hosting Platform For Machine Learning Applications; Data Mesh Architecture: Reimagining Data Management; Popular Machine Learning Algorithms; Reinforcement Learning for Newbies ; Deep Learning For Compliance Checks: What's New?

Machine Learning 99

Machine Learning Architecture Data Management Deep Learning 99

KDnuggets

NOVEMBER 18, 2022

Anaconda is incredibly excited to announce the release of a brand-new suite of products on the Anaconda Nucleus platform: Anaconda Notebooks and Anaconda Learning.

Data Science 77

Data Science Cloud Data 77

Data Engineering Podcast

APRIL 21, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Email hosts@dataengineeringpodcast.com ) with your story. Go to dataengineeringpodcast.com/dagster today to get started.

Data Lake 173

Data Lake High Quality Data Data Pipeline Machine Learning 173

Data Engineering Podcast

FEBRUARY 18, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Email hosts@dataengineeringpodcast.com ) with your story. Go to dataengineeringpodcast.com/dagster today to get started.

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

Data Engineering Podcast

APRIL 14, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Email hosts@dataengineeringpodcast.com ) with your story. Go to dataengineeringpodcast.com/dagster today to get started.

Non-relational Database 147

Non-relational Database Relational Database Database Designing 147

Data Engineering Podcast

APRIL 7, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Email hosts@dataengineeringpodcast.com ) with your story. Go to dataengineeringpodcast.com/dagster today to get started.

Data Lake 162

Data Lake High Quality Data BI Data Workflow 162

Data Engineering Podcast

MARCH 24, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Email hosts@dataengineeringpodcast.com ) with your story. Go to dataengineeringpodcast.com/dagster today to get started.

Data Lake 162

Data Lake High Quality Data Hadoop Data Pipeline 162

Data Engineering Podcast

MARCH 3, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Email hosts@dataengineeringpodcast.com ) with your story. Go to dataengineeringpodcast.com/dagster today to get started.

Programming 162

Programming Data Lake High Quality Data Data Pipeline 162

Data Engineering Podcast

MARCH 17, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Email hosts@dataengineeringpodcast.com ) with your story. Go to dataengineeringpodcast.com/dagster today to get started.

Database 147

Database Data Lake High Quality Data Data Workflow 147

Data Engineering Podcast

FEBRUARY 25, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Email hosts@dataengineeringpodcast.com ) with your story. Go to dataengineeringpodcast.com/dagster today to get started.

Database 162

Database Technology Data Lake High Quality Data 162

Data Engineering Podcast

MARCH 10, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Email hosts@dataengineeringpodcast.com ) with your story. Go to dataengineeringpodcast.com/dagster today to get started.

Data Lake 147

Data Lake High Quality Data Data Pipeline Architecture 147

Data Engineering Podcast

FEBRUARY 4, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Email hosts@dataengineeringpodcast.com ) with your story. Email hosts@dataengineeringpodcast.com ) with your story.

SQL 173

SQL Data Lake High Quality Data Data Pipeline 173

Data Engineering Podcast

MARCH 31, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Email hosts@dataengineeringpodcast.com ) with your story. Go to dataengineeringpodcast.com/dagster today to get started.

Project 130

Project Data Lake High Quality Data Data Workflow 130

Data Engineering Podcast

FEBRUARY 11, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Email hosts@dataengineeringpodcast.com ) with your story. Email hosts@dataengineeringpodcast.com ) with your story.

Data Lake 147

Data Lake High Quality Data Government Data Pipeline 147

Data Engineering Podcast

APRIL 23, 2023

Sign up free at dataengineeringpodcast.com/rudderstack Your host is Tobias Macey and today I'm interviewing DeVaris Brown about the impact of real-time data on business opportunities and risk profiles Interview Introduction How did you get involved in the area of data management? Email hosts@dataengineeringpodcast.com ) with your story.

Data Lake 277

Data Lake Kafka Machine Learning Data Warehouse 277

DoorDash Engineering

MARCH 27, 2024

To distinguish which sandbox environment an event is directed toward, we incorporate route information to map a production service application name to a sandbox host. A unique host label is generated upon sandbox deployment. The host label varies between deployments but remains consistent among all pods within the same deployment.

Kafka 103

Kafka Architecture Algorithm Systems 103

Data Engineering Podcast

JUNE 25, 2023

Sign up free at dataengineeringpodcast.com/rudderstack - Your host is Tobias Macey and today I'm interviewing Toby Mao about SQLMesh, an open source DataOps framework designed to scale data transformations with ease of collaboration and validation built in Interview Introduction How did you get involved in the area of data management?

Data Engineering 225

Data Engineering Data Engineer Python Engineering 225

Data Engineering Podcast

DECEMBER 24, 2023

Your host is Tobias Macey and today I'm interviewing Elad Eldor about operating Kafka in production and how to keep your clusters stable and performant Interview Introduction How did you get involved in the area of data management? Email hosts@dataengineeringpodcast.com ) with your story. Want to see Starburst in action?

Kafka 245

Kafka Data Lake High Quality Data SQL 245

Analytics Vidhya

MARCH 24, 2023

That’s why we at Analytics Vidhya host a series of informative and interactive webinars designed to help you enhance your skills and expand your knowledge of data tech […] The post Don’t Miss Out: Last Few and Exciting DataHour of March appeared first on Analytics Vidhya.

Data Science 215

Data Science Designing Data Machine Learning 215

Data Engineering Podcast

MAY 14, 2023

In this episode the host Tobias Macey shares his reflections on recent experiences where the abstractions leaked and some observances on how to deal with that situation in a data platform architecture. Email hosts@dataengineeringpodcast.com ) with your story. Email hosts@dataengineeringpodcast.com ) with your story.

Data Lake 147

Data Lake Machine Learning Data Warehouse AWS 147

Christophe Blefari

MARCH 8, 2024

Ghost — My blog is hosted on ghost.org , I really like Ghost because it's open-source (but I use the paid hosted version) and give me the possibility to extend the blog with custom code. The Django app uses a Postgres as a database and a bucket to host a few static files.

Data 130

Data Algorithm Database Education 130

Data Engineering Podcast

JANUARY 28, 2024

Your host is Tobias Macey and today I'm interviewing Cliff Crosland about Scanner, a security data lake platform for analyzing security logs and identifying issues quickly and cost-effectively Interview Introduction How did you get involved in the area of data management? Email hosts@dataengineeringpodcast.com ) with your story.

Data Lake 147

Data Lake Building High Quality Data AWS 147

Data Engineering Podcast

JANUARY 7, 2024

Your host is Tobias Macey and today I'm interviewing Jignesh Patel about the research that he is conducting on technical scalability and user experience improvements around data management Interview Introduction How did you get involved in the area of data management? Email hosts@dataengineeringpodcast.com ) with your story.

Data Process 147

Data Process Process Data Lake High Quality Data 147

Data Engineering Podcast

AUGUST 27, 2023

In the era of the cloud most developers rely on hosted services to manage their databases, but what if you are a cloud service? What do you have planned for the future of Postgres hosting at Cloudflare? Email hosts@dataengineeringpodcast.com ) with your story. When is an internal database as a service the wrong choice?

Database 130

Database Building PostgreSQL BI 130

Netflix Tech

MARCH 7, 2024

Data: Fast Data Our main data lake is hosted on S3, organized as Apache Iceberg tables. We use Apache Arrow to decode Parquet and to host an in-memory representation of data. Deployment: Metaflow Hosting For deployments that require an API and real-time evaluation, we provide an integrated model hosting service, Metaflow Hosting.

Systems 90

Systems Media Machine Learning Data Warehouse 90

Data Engineering Podcast

JANUARY 21, 2024

Your host is Tobias Macey and today I'm interviewing Tasso Argyros about the role of a customer data platform in the context of the modern data stack Interview Introduction How did you get involved in the area of data management? Email hosts@dataengineeringpodcast.com ) with your story.

Data Lake 147

Data Lake High Quality Data NoSQL Data Warehouse 147

Knowledge Hut

JANUARY 12, 2024

Docker is a tool that enables developers, system administrators, and others to easily deploy their applications in a sandbox (referred to as containers) to run on the host operating system. VMs run applications inside a guest Operating System powered by the server's host OS. The server host runs on virtual hardware.

Systems 97

Systems MySQL Architecture Certification 97

Knowledge Hut

JANUARY 18, 2024

Host: These competitions are held by Machine Hack on their official website. Host: It is hosted by Google and challenges participants to solve a set of data science problems. Host : Are you a data scientist looking to sharpen your skills? In this competition, you will be able to work on real-world data problems.

Data Science 98

Data Science Recruitment Big Data Machine Learning 98

Pinterest Engineering

NOVEMBER 22, 2023

Initial Architecture For Goku Short Term Ingestion Figure 1: Old push based ingestion pipeline into GokuS At Pinterest, we have a sidecar metrics agent running on every host that logs the application system metrics time series data points (metric name, tag value pairs, timestamp and value) into dedicated kafka topics.

Database 93

Database Bytes Kafka Architecture 93

Engineering at Meta

DECEMBER 19, 2023

It is built from the ground up to leverage Meta’s infrastructure, and keyspaces hosted on it can be flexibly placed across any number of data centers. Any keyspace hosted on it can be scaled up and down with relative ease.

Programming Language 141

Programming Language Engineering Database Coding 141

Data Engineering Podcast

SEPTEMBER 10, 2023

Your host is Tobias Macey and today I'm welcoming back Nick Schrock to talk about the state of the ecosystem for data orchestration Interview Introduction How did you get involved in the area of data management? Email hosts@dataengineeringpodcast.com ) with your story. Email hosts@dataengineeringpodcast.com ) with your story.

BI 208

BI SQL Data Machine Learning 208

Data Engineering Podcast

MAY 28, 2023

Sign up free at dataengineeringpodcast.com/rudderstack Your host is Tobias Macey and today I'm interviewing Ghalib Suleiman about challenges and strategies for building data teams in a startup Interview Introduction How did you get involved in the area of data management? Email hosts@dataengineeringpodcast.com ) with your story.

Data Lake 162

Data Lake Machine Learning Data Warehouse Education 162

Engineering at Meta

MARCH 18, 2024

Logarithm is a hosted, serverless, multitenant service, used only internally at Meta, that consumes and indexes these logs and provides an interactive query interface to retrieve and view logs. Users can query using regular expressions on log lines, arbitrary metadata fields attached to logs, and across log files of hosts and services.

Engineering 89

Engineering Metadata Architecture Designing 89