Data Engineering Podcast

OCTOBER 1, 2023

In this episode Jay Mishra shares his experiences and insights building ETL pipelines with the help of generative AI. RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. With Materialize, you can!

Building 162

Building BI SQL Machine Learning 162

Snowflake

MAY 1, 2024

Its Volumetric and Surface-Level Discrete Global Grid System (DGGS), which manages surface-level, subsurface and aerial data, supports the integration of diverse data forms, including 2D and 3D data, and facilitates dynamic interactions with spatial data. We are pleased to announce that BigGeo, Scientific Financial Systems and SignalFlare.ai

Media 104

Media Building Data Warehouse Technology 104

Striim

APRIL 3, 2024

This service caters to a wide range of connectors, including HubSpot, Stripe, and Zendesk, supporting diverse data analytics and AI use cases. This service caters to a wide range of connectors, including HubSpot, Stripe, and Zendesk, supporting diverse data analytics and AI use cases. Enterprises in the U.S.

Google Cloud 52

Google Cloud Transportation Data Integration Aggregated Data 52

Striim

APRIL 1, 2024

Focused on delivering real-time intelligence for AI and leveraging change data capture (CDC) from databases, Striim’s approach addresses the urgent need for thorough data integration, emphasizing the critical role of connecting disparate applications to fully realize their potential. What is Striim Cloud for Application Integration?

Hospitality 52

Hospitality Transportation Google Cloud Cloud 52

Data Engineering Podcast

MARCH 10, 2023

Summary With the rise of the web and digital business came the need to understand how customers are interacting with the products and services that are being sold. Product analytics has grown into its own category and brought with it several services with generational differences in how they approach the problem.

Data Warehouse 130

Data Warehouse Data Lake Machine Learning Data Science 130

Snowflake

NOVEMBER 1, 2023

Through these new offerings, any user can incorporate LLMs into analytical processes in seconds; developers can create GenAI-powered apps in minutes, or within hours execute powerful workflows, like fine-tuning foundation models on enterprise data — all within Snowflake’s security perimeter. All within the boundary of their Snowflake account.

Government 106

Government SQL AWS Database 106

Cloudera

MAY 13, 2024

Businesses today face unique challenges, whether it’s with hybrid cloud, AI, data analytics, or all of the above. Each of these women play an integral role in fostering Cloudera’s partner ecosystem and delivering on the most pressing customer needs.

Programming 94

Programming Government Cloud Technology 94

Knowledge Hut

MAY 2, 2024

Most cutting-edge technology organizations like Netflix, Apple, Facebook, and Uber have massive Spark clusters for data processing and analytics. Big data sets are generally huge – measuring tens of terabytes – and sometimes crossing the threshold of petabytes. It is surprising to know how much data is generated every minute.

Scala 96

Scala Hadoop Datasets Java 96

Data Engineering Podcast

DECEMBER 28, 2022

And don't forget to thank them for their continued support of this show! Modern data teams are dealing with a lot of complexity in their data pipelines and analytical code. Datafold built automated regression testing to help data and analytics engineers deal with data quality in their pull requests.

Data Lake 130

Data Lake Data Warehouse Data Pipeline MongoDB 130

Knowledge Hut

DECEMBER 22, 2023

Smart devices, Netflix recommendations, Amazon’s Alexa Google Home have transformed the way we live in the digital age. This can be greatly beneficial for companies to improve their offerings and customer experience. The global augmented analytics market size is projected to reach $29,856 million by 2025. billion by 2025.

Data Science 98

Data Science Deep Learning Healthcare Business Intelligence 98

Snowflake

FEBRUARY 12, 2024

“The industry is at an inflection point where platforms and gen AI technology meet to truly transform telecom operations and rapidly deliver solutions to real-world problems. . This year’s event will be electric, and I couldn’t be more excited to be at the epicenter of it,” says Phil Kippen, Global Industry Leader, Telecom, Snowflake.

Python 83

Python Manufacturing Cloud Government 83

Snowflake

JANUARY 17, 2024

Over the next year, they anticipate generative AI will transform the industry by improving operational efficiency, customer satisfaction and more. Customer complaints, reorder logs and more can be evaluated for better inventory management. Telecom providers will also use data to mitigate supply chain issues.

Telecommunication 97

Telecommunication Medical Pharmaceutical Entertainment 97

Knowledge Hut

DECEMBER 28, 2023

By grasping the landscape of AI platforms, one can identify the best options for their specific requirements and leverage the power of AI. The company's groundbreaking research in these domains supports these tools and resources. Generative AI : Transform content creation using AI-generated images, text, and videos.

Amazon Web Services 64

Amazon Web Services Machine Learning Medical Deep Learning 64

Precisely

APRIL 8, 2024

Ostensibly this data enables you to ship items or send mail to customers and prospects, to correspond with suppliers, and to communicate with a network of distributors or other partners. Late deliveries lead to unhappy customers, and canceled orders cost much money. trillion on digital transformation in 2023.

Food 62

Food Retail Data Integration Data 62

Cloudera

OCTOBER 24, 2023

The AI technologies of today—including not just large language models (LLMs) but also deep learning, reinforcement learning, and natural-language processing (NLP) tools—will equip telcos with powerful new automation and analytics capabilities. AI-powered automation is already driving significant margin growth by reducing costs.

Government 79

Government Deep Learning Finance Data Governance 79

Snowflake

MAY 1, 2023

Data teams can organize analytics into manageable and reusable blocks of knowledge supporting every data flow; users can consume them via SQL, Tableau, Looker, Python, or dbt. We leverage Snowflake’s core compute and storage capabilities to make the single source of data into a single source of business logic.”

Insurance 102

Insurance Unstructured Data Python Building 102

Snowflake

OCTOBER 31, 2023

Successful MDR providers are finding new ways to protect customers and grow their profits by leveraging advances in data and artificial intelligence. On the surface, this seems tempting for customers who already rely on these vendors for endpoint security. Here are just three of the reasons why.

Management 88

Management Data Science Cloud Data Storage 88

Cloudera

SEPTEMBER 7, 2023

ChatGPT, Bard, LLaMa, and BloombergGPT rely on a new type of neural network architecture, called a transformer model , which uses a special form of weighting to capture relationships and context across different parts of a sentence or sequence. But these measures alone may not be sufficient to protect proprietary information.

Insurance 81

Insurance Finance Portfolio Government 81

Snowflake

JANUARY 23, 2024

Many customers have already seen the performance benefits of Snowpark ML, including Spark New Zealand , and Swire Coca Cola, USA. Many developers and enterprises looking to use machine learning (ML) to generate insights from data get bogged down by operational complexity.

Machine Learning 120

Machine Learning Metadata Python Telecommunication 120

Striim

APRIL 22, 2024

Discovery Health, originating in South Africa, has transcended borders to extend its services to over 40 million customers across more than 40 global markets, encompassing regions in Asia, EMEA, and the Americas. Endorsed by Oracle, Striim provided reliability and scalability while leveraging expertise in logical database replication.

Healthcare 52

Healthcare Insurance Portfolio Banking 52

The Modern Data Company

JULY 24, 2023

Understanding Chaining Data Products Chaining data products refers to the process of integrating and interconnecting multiple data products to create a data ecosystem that supports complex use cases. In the modern data-driven landscape, organizations are constantly seeking ways to extract valuable insights from their data assets.

Data Lake 85

Data Lake Transportation Data Algorithm 85

Knowledge Hut

MARCH 26, 2024

An essential position in IT is that of a solution architect who develops and deploys technological solutions that are customized to satisfy certain business requirements. Digital Transformation: Many businesses are undergoing digital transformation initiatives to stay competitive.

Amazon Web Services 52

Amazon Web Services Google Cloud Computer Science AWS 52

Striim

APRIL 4, 2024

The integration of siloed business applications into a cohesive digital ecosystem presents one of the most significant challenges in this transformation. This underscores the necessity for innovative, seamless integration solutions that can bridge the gap between various data sources and analytical tools.

Transportation 40

Transportation Google Cloud Aggregated Data Cloud 40

Cloudera

SEPTEMBER 15, 2023

With some Cloudera customers ingesting multiple petabytes of data every single day — that’s multiple thousands of terabytes! For example in retail, connections between customers and stores/distribution centers allow the businesses within the ecosystem to understand who’s shopping, where they are shopping and what they are buying.

Telecommunication 79

Telecommunication AWS Retail Amazon Web Services 79

ThoughtSpot

JULY 18, 2023

At ThoughtSpot, we believe making data accessible to every knowledge worker requires human-centered technology—an analytics experience that bridges the “language” barrier between technology and people. And as generative AI takes the world by storm, we’re ready to help our customers take full advantage.

Google Cloud 84

Google Cloud Cloud BI Data Security 84

Towards Data Science

FEBRUARY 2, 2024

For example, how do you capture the value of: A customer churn dashboard A dataset that supports ad hoc queries of engagement behaviors A migration to a new data stack that supports faster, more scalable compute Increasing data adoption by 30% as a result of a data quality initiative It’s not easy! Image by author.

Data 89

Data Aggregated Data Machine Learning Data Mining 89

Striim

FEBRUARY 8, 2024

This blog delves into the transformative role real-time data analytics plays in streamlining ground operations, reducing delays, and boosting overall efficiency in the aviation industry. Any delay in these processes can cause a ripple effect, leading to flight delays, increased costs, and customer dissatisfaction.

MongoDB 52

MongoDB Data Analytics Data Data Integration 52

Data Engineering Weekly

MAY 5, 2024

link] Sponsored: Navigating Aquaculture with Embedded Analytics How Scoot Science Charted Its Journey with a Universal Semantic Layer Learn how Scoot Science optimized their embedded aquaculture analytics platform through a universal semantic layer in our upcoming webinar on May 15th at 9 AM PT / 12 PM ET.

Data Engineering 67

Data Engineering Data Engineer Engineering Google Cloud 67

Rockset

OCTOBER 26, 2023

JetBlue is the data leader in the airline industry using data to offer industry-leading customer experiences and disruptive low fares to popular destinations around the world. BlueML has been central to supporting LLM-based applications and JetBlue’s AI & ML real-time products.

Machine Learning 64

Machine Learning Data Science Architecture Data Warehouse 64

Knowledge Hut

JANUARY 24, 2024

Are you ready to unlock my data potential and master advanced analytics! The thing about Power BI is that it supports different data sources. Programming Support Compared to Power BI, Tableau integrates much better with R. Power BI supports Data Analysis Expression and the M language for data manipulation and modeling.

BI 98

BI Business Intelligence Non-relational Database Data Analysis 98

ThoughtSpot

APRIL 28, 2023

The companies, products, and services that compose the modern data stack play an essential role in delivering the modern data experience—allowing businesses to collect, process, store, and analyze data at cloud speed and scale. Register now to join the virtual Beyond 2023 experience for free.

Google Cloud 70

Google Cloud BI Consulting Cloud 70

ThoughtSpot

SEPTEMBER 6, 2023

The pathway from ETL to actionable analytics can often feel disconnected and cumbersome, leading to frustration for data teams and long wait times for business users. Our new SpotApp integration allows users to launch a Fivetran connector and a corresponding ThoughtSpot analytics template in a single workflow. What is a SpotApp?

Data Workflow 91

Data Workflow Raw Data Data Lake Business Intelligence 91

Lyft Engineering

NOVEMBER 29, 2023

Introduction At Lyft, we have used systems like Apache ClickHouse and Apache Druid for near real-time and sub-second analytics. For our customers, this means faster analytics on near real-time data and decision making. Overall, these systems allow us to make timely decisions for the business with accurate predictions.

Kafka 104

Kafka Data Ingestion Datasets Architecture 104

Knowledge Hut

MAY 23, 2024

Data science has become the fastest-growing field and a buzzword that every industry knows and leverages. Freshers and even seasoned professionals can get a basic idea of what the data wants to say before getting into high-end analytics. This vast stream of interdisciplinary domains deals with data in different ways.

Data Science 52

Data Science MongoDB Programming Language Unstructured Data 52

Cloudera

AUGUST 17, 2021

When we announced the GA of Cloudera Data Engineering back in September of last year, a key vision we had was to simplify the automation of data transformation pipelines at scale. It’s included at no extra cost, customers only have to pay for the associated compute infrastructure. CDP Airflow operators.

Data Pipeline 112

Data Pipeline Management BI Python 112

Cloudera

JUNE 27, 2023

During the COVID-19 pandemic, telcos made unprecedented use of data and data-driven automation to optimize their network operations, improve customer support, and identify opportunities to expand into new markets. Offload data from legacy, on-premises analytic platforms and appliances.

Data Architecture 62

Data Architecture Architecture Data Governance Government 62

Cloudera

JULY 29, 2022

Many organizations are hoping to leverage these massive amounts of data by investing heavily in big data solutions – solutions that they hope can meet business goals such as increasing customer satisfaction, uncovering alternative revenue streams, or improving operational efficiency. Fail to plan, plan to fail.

Data Architecture 86

Data Architecture Architecture Unstructured Data Government 86