Data Engineering Podcast

SEPTEMBER 17, 2023

Summary A significant amount of time in data engineering is dedicated to building connections and semantic meaning around pieces of information. Linked data technologies provide a means of tightly coupling metadata with raw information. What is the level of native support/compatibiliity that you see for JSON-LD in data systems?

Building 189

Building BI SQL Python 189

Knowledge Hut

NOVEMBER 16, 2023

The best part to jump on the bandwagon of information technology or IT is, there is an enormous possibility for an individual if he or she starts studying for a diploma or a degree, does either a master's degree or a research course. JSP certification JSP is a Web page-building tool that allows for dynamic content.

Technology 98

Technology MySQL MongoDB Google Cloud 98

Data Engineering Podcast

JANUARY 21, 2019

Summary Building internal expertise around big data in a large organization is a major competitive advantage. They discuss the challenges of being at global scale from the start, hiring and training talented engineers, prototyping and deploying new systems in the cloud, and what they have learned in the process.

Big Data 100

Big Data Systems Building Hadoop 100

Data Engineering Podcast

OCTOBER 15, 2023

Summary Building streaming applications has gotten substantially easier over the past several years. Decodable was built with a mission of eliminating all of the painful aspects of developing and deploying stream processing systems for engineering teams. How can you get the best results for your use case?

Process 182

Process Building SQL BI 182

Knowledge Hut

MARCH 22, 2024

I have comprehensively analyzed the area of physical security, particularly the ongoing discussion surrounding fail safe vs fail-safe secure electric strike locking systems. These two distinct approaches offer unique strategies for securing buildings and valuables. What are Fail-Safe Door Locks?

Systems 105

Systems Electronics Hospitality Architecture 105

Data Engineering Podcast

DECEMBER 19, 2021

Summary Building a well managed data ecosystem for your organization requires a holistic view of all of the producers, consumers, and processors of information. The team at Metaphor are building a fully connected metadata layer to provide both technical and social intelligence about your data. No more scripts, just SQL.

Systems 100

Systems Building Metadata Data Warehouse 100

Data Engineering Podcast

JULY 27, 2020

Summary A majority of the scalable data processing platforms that we rely on are built as distributed systems. Kyle Kingsbury created the Jepsen framework for testing the guarantees of distributed data processing systems and identifying when and why they break. What are the pros and cons of using Clojure for building Jepsen?

Systems 100

Systems Building Scala Java 100

Data Engineering Podcast

JANUARY 28, 2024

Summary Monitoring and auditing IT systems for security events requires the ability to quickly analyze massive volumes of unstructured log data. Contact Info LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? When is Scanner the wrong choice?

Data Lake 147

Data Lake Building High Quality Data AWS 147

Precisely

JANUARY 18, 2024

Mainframes make up some of the most formidable computing power in the world , delivering security, scalability, and reliability that make these systems ideal for intensive mission-critical workloads. After all, mainframe technology was firmly established long before many of today’s modern innovations emerged on the scene.

Technology 52

Technology AWS Cloud Computing Data Lake 52

Knowledge Hut

JULY 7, 2023

Sun Microsystems, the original makers of Java which Oracle later acquired, have kept pace with the advancement in the field of technology and the developers' needs to release new versions and introduce new features. However, some believe some emerging technologies might replace Java in the future.

Java 97

Java Technology Scala Programming Language 97

Knowledge Hut

DECEMBER 28, 2023

The information system is a very vast concept that encompasses several aspects like database management, the communication system, various devices, several connections, the internet, collection, organization, and storing data and other information-related applications that are typically used in a business forum.

Systems 52

Systems Telecommunication Technology Certification 52

Data Engineering Podcast

SEPTEMBER 11, 2022

Summary Data engineering systems are complex and interconnected with myriad and often opaque chains of dependencies. Prefect is the modern Dataflow Automation platform for the modern data stack, empowering data practitioners to build, run and monitor robust pipelines at scale. Can you describe what Schemata is and the story behind it?

Systems 100

Systems Metadata Building MongoDB 100

Data Engineering Podcast

FEBRUARY 26, 2023

Jean-Georges Perrin was tasked with designing a new data platform implementation at PayPal and wound up building a data mesh. It's supposed to make building smarter, faster, and more flexible data infrastructures a breeze. What are the technical systems that you are relying on to power the different data domains?

Building 147

Building Metadata Machine Learning Data Integration 147

Knowledge Hut

JANUARY 23, 2024

Blockchain technology in agriculture improves food safety by allowing information to be traced across the food supply chain. The capacity of blockchain to store and manage data enables traceability, which is utilized to aid in creating and implementing technologies for intelligent farming and index-based crop insurance.

Technology 52

Technology Food Insurance Data Collection 52

Data Engineering Podcast

AUGUST 27, 2023

Summary Data persistence is one of the most challenging aspects of computer systems. RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. Why Postgres? Closing Announcements Thank you for listening!

Database 130

Database Building PostgreSQL BI 130

Knowledge Hut

DECEMBER 26, 2023

By facilitating collaboration and value exchange amongst users of the same platform but with no other connections, blockchain technology takes it to a new level. The main benefits and drawbacks of blockchain technology will be covered in this blog. Distributed ledger technology, which manages its decentralized database, is used (DLT).

Technology 52

Technology Food Manufacturing Banking 52

Knowledge Hut

DECEMBER 27, 2023

The job of a business systems analyst is a uniquely cross-functional one that plays a critical role in improving a company’s processes for better operational efficiency. What is Business Systems Analyst? Business systems analyst duties also include writing instruction manuals and analyzing costs and benefits related to technology.

Systems 52

Systems Business Analyst Consulting Certification 52

Data Engineering Podcast

NOVEMBER 20, 2022

In this episode Ian Schweer shares his experiences at Riot Games supporting player-focused features such as machine learning models and recommeder systems that are deployed as part of the game binary. The biggest challenge with modern data systems is understanding what data you have, where it is located, and who is using it.

Systems 130

Systems Metadata Data Pipeline MongoDB 130

Snowflake

OCTOBER 2, 2023

The case for business continuity is particularly compelling for a company such as The Depository Trust & Clearing Corporation (DTCC) , which is designated as a systemically important financial market utility (SIFMU), a U.S. We have conducted at least 15 disaster recovery exercises using Snowgrid technology for business continuity.

AWS 86

AWS Technology Data Cloud 86

Edureka

MAY 5, 2023

MERN Stack Technology is one of the most important and latest technology stack that developers and programmers use today to build high end applications and websites. In this blog we are going to learn about MERN Stack, its benefits and why today developers require MERN Stack Technologies. MERN Stack MEAN Stack MEVN Stack.

Technology 52

Technology MongoDB Programming Language Database 52

Knowledge Hut

NOVEMBER 19, 2023

With advances in technology, wearable devices do provide some trace of your health. Furthermore, Data Scientists analyze this data, build reports and train ML models on top of it. Imagine an industrial system where Temperature and Humidity need to be within a range and any potential anomaly needs to be detected and flagged.

Data Science 52

Data Science Technology Machine Learning Big Data 52

Data Engineering Podcast

DECEMBER 25, 2022

Recognizing this shortcoming and the capabilities that could be unlocked by a robust solution Rishabh Poddar helped to create Opaque Systems as an outgrowth of his PhD studies. RudderStack helps you build a customer data platform on your warehouse or data lake. Sign up free at dataengineeringpodcast.com/rudder Build Data Pipelines.

Machine Learning 130

Machine Learning Systems Data Lake Data Warehouse 130

Data Engineering Podcast

JANUARY 15, 2023

Summary The modern data stack has made it more economical to use enterprise grade technologies to power analytics at organizations of every scale. In this episode Srujan Akula explains how the system is implemented and how you can start using it today with your existing data systems.

Coding 130

Coding Building PostgreSQL Data Lake 130

Snowflake

MAY 8, 2023

Along with our Snowflake technology partners (with similar examples of innovation early last year ), we will demonstrate how they use the new get_query_operator_stats function within their respective products and further empower all of our customers for ongoing success with Snowflake.

Technology 111

Technology SQL BI Utilities 111

Rockset

SEPTEMBER 2, 2022

I recently had the good fortune to host a small-group discussion on personalization and recommendation systems with two technical experts with years of experience at FAANG and other web-scale companies. Nikhil Garg is CEO and co-founder of Fennel AI , a startup working on building the future of real-time machine learning infrastructure.

Systems 52

Systems Building Machine Learning NoSQL 52

Data Engineering Podcast

JUNE 11, 2023

Summary Data engineering is all about building workflows, pipelines, systems, and interfaces to provide stable and reliable data. In this episode Gleb Mezhanskiy shares some valuable advice and insights into how you can build reliable and well-tested data assets with dbt and data-diff.

Project 130

Project Building Data Lake Machine Learning 130

Data Engineering Podcast

FEBRUARY 20, 2022

Summary The life sciences as an industry has seen incredible growth in scale and sophistication, along with the advances in data technology that make it possible to analyze massive amounts of genomic information. Go to dataengineeringpodcast.com/linode today and get a $100 credit to try out a Kubernetes cluster of your own.

Systems 100

Systems Software Engineer Software Engineering Data Warehouse 100

Knowledge Hut

DECEMBER 5, 2023

If you have a passion for information technology (IT) and dream of turning it into a fulfilling career, ponder the path of a systems engineer. Join us on a detailed exploration of who can pursue a career as a systems engineer and the steps to become one in the year 2024. Who is a System Engineer, and What Do They Do?

Systems 52

Systems Engineering Recruitment Electronics 52

Data Engineering Podcast

APRIL 16, 2023

As the capabilities of these systems has improved and become more accessible, the target of what self-serve means changes. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management RudderStack helps you build a customer data platform on your warehouse or data lake. Who are the target users?

Business Intelligence 147

Business Intelligence Building Data Lake BI 147

Knowledge Hut

JUNE 16, 2023

Blockchain technology is largely responsible for cryptocurrencies' success, and since then, demand has increased. There are plenty of career opportunities in blockchain technology. This manual will take you through careers in blockchain technology that will help you advance in this popular field. What is Blockchain?

Technology 52

Technology Programming Language Finance Computer Science 52

Precisely

JANUARY 19, 2023

The security, scalability, and reliability of these systems makes them ideal for intensive mission-critical workloads. After all, mainframe technology was firmly established long before many of today’s modern innovations emerged on the scene. The mainframe is alive and well, and it’s not going anywhere anytime soon.

Technology 52

Technology AWS Cloud Computing Data Lake 52

Towards Data Science

FEBRUARY 9, 2024

How to build a modern, scalable data platform to power your analytics and data science projects (updated) Table of Contents: What’s changed? Orchestration I mentioned modularity as a core concept of building a modern data platform in my 2021 article, but I failed to emphasize the importance of data orchestration.

Building 82

Building Transportation Data Lake Metadata 82

DoorDash Engineering

APRIL 23, 2024

Product attributes allow DoorDash to group products based on commonalities, building a product profile for each customer around their affinities to certain attributes. These are the building blocks for providing highly relevant and personalized shopping recommendations. Better personalization.

Building 91

Building Retail Manufacturing Unstructured Data 91

Data Engineering Podcast

DECEMBER 2, 2018

Summary Distributed systems are complex to build and operate, and there are certain primitives that are common to a majority of them. Rather then re-implement the same capabilities every time, many projects build on top of Apache Zookeeper. What are the distributed systems primitives that are built into Zookeeper?

Systems 100

Systems Building Kafka Java 100

The Modern Data Company

APRIL 20, 2023

What is a data operating system? On the surface, it’s an operating system designed specifically for managing and processing large amounts of data. Many products and services have claimed to offer a data operating system in recent years.

Systems 95

Systems Entertainment Government Big Data 95

Knowledge Hut

NOVEMBER 16, 2023

Azure for Data Science: Overview Azure, a cloud computing service created by Microsoft for building, testing, deploying, and managing applications and services through Microsoft-managed service centres is an excellent choice for your data science needs. Why Use Azure for Data Science? Data Science is heavily reliant on computing resources.

Data Science 52

Data Science Technology Programming Language Cloud Computing 52