Remove Data Architecture Remove Data Engineer Remove Data Pipeline Remove Data Programming
article thumbnail

The State of Data Engineering in 2023: Does Your Data Program Stack Up?

Ascend.io

This means not only understanding where you stand, but also recognizing how the evolving patterns in the broader industry might align with or diverge from your own data programs. Over the past four years, we have conducted an industry-wide DataAware Pulse Survey to capture the current state of data teams. Tools or Hindrances?:

article thumbnail

Build Maintainable And Testable Data Applications With Dagster

Data Engineering Podcast

In this episode he explains his motivation for creating a product for data management, how the programming model simplifies the work of building testable and maintainable pipelines, and his vision for the future of data programming. Raghu Murthy, founder and CEO of Datacoral built data infrastructures at Yahoo!

Building 100
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Designing For Data Protection

Data Engineering Podcast

Even if you aren’t subject to specific rules regarding data protection it is definitely worth listening to get an overview of what you should be thinking about while building and running data pipelines. Raghu Murthy, founder and CEO of Datacoral built data infrastructures at Yahoo!

Designing 100
article thumbnail

Fast Analytics On Semi-Structured And Structured Data In The Cloud

Data Engineering Podcast

In this episode CEO Venkat Venkataramani and SVP of Product Shruti Bhat explain the origins of Rockset, how it is architected to allow for fast and flexible SQL analytics on your data, and how their serverless platform can save you the time and effort of implementing portions of your own infrastructure. search, graph, timeseries, etc.)?

article thumbnail

Automating Your Production Dataflows On Spark

Data Engineering Podcast

Summary As data engineers the health of our pipelines is our highest priority. Unfortunately, there are countless ways that our dataflows can break or degrade that have nothing to do with the business logic or data transformations that we write and maintain. Visit dataengineeringpodcast.com today to find out more.

article thumbnail

Keeping Your Data Warehouse In Order With DataForm

Data Engineering Podcast

In this episode CTO and co-founder of Dataform Lewis Hemens joins the show to explain his motivation for creating the platform and company, how it works under the covers, and how you can start using it today to get your data warehouse under control. They provide an AWS-native, serverless, data infrastructure that installs in your VPC.

article thumbnail

Data Orchestration For Hybrid Cloud Analytics

Data Engineering Podcast

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Cloud 100