Simon Späti

APRIL 6, 2022

With burnout and mental stress at every level of our lives, I find my Personal Knowledge Management (PKM) system even more valuable. As a human, I forget lots of things. As a dad, I have more responsibilities with remembering all things related to my kid. As a developer and knowledge worker, I re-use code snippets or create new things. That’s why a PKM system such as a Second Brain to store all of it in a sustainable way is crucial to me.

Management 189

Management Coding Systems IT 189

Start Data Engineering

APRIL 12, 2022

Introduction Data lakes and data warehouses Data lake Data warehouse Criteria to choose lake and warehouse tools Conclusion Further reading References Introduction With the data ecosystem growing fast, new terms are coming up every week. Some of the most popular ones include “data lakes” and “data warehouses” If you are Trying to understand the differences between a data lake and a data warehouse Frustrated by vendor marketing content aimed at selling their lake/warehouse

Data Lake 130

Data Lake Data Warehouse Data 130

Marc Lamberti

APRIL 4, 2022

DAG Dependencies in Apache Airflow might be one of the most popular topics. I received countless questions about DAG dependencies, is it possible? How? What are the best practices? and the list goes on. It’s funny because it comes naturally to wonder how to do that even when we are beginners. Do we like to complexify things by nature? Maybe, but that’s another question 😉 At the end of this article, you will be able to spot when you need to create DAG Dependencies, which metho

Metadata 130

Metadata IT Coding Process 130

KDnuggets

APRIL 21, 2022

Understanding the fundamentals of statistics is a core capability for becoming a Data Scientist. Review these essential ideas that will be pervasive in your work and raise your expertise in the field.

Data Science 160

Data Science Data 160

Advertisement

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

Database

Jesse Anderson

APRIL 13, 2022

Data mesh is quickly becoming a way for companies to roll out their data strategy. If you haven’t already learned about data mesh , I suggest doing so. It comes with organizational and technical changes. I think a crucial part of your data mesh revolves around the choice of publish/subscribe technologies. At the crux of data mesh is a desire for flexibility.

Kafka 124

Kafka Data Cloud Technology 124

Cloudera

APRIL 22, 2022

This blog post was written by Dean Bubley , industry analyst, as a guest author for Cloudera. . Communications service providers (CSPs) are rethinking their approach to enterprise services in the era of advanced wireless connectivity and 5G networks, as well as with the continuing maturity of fibre and Software-Defined Wide Area Network (SD-WAN) portfolios. .

Data Solutions 134

Data Solutions Amazon Web Services Data Storage Google Cloud 134

Data Engineering Podcast

APRIL 24, 2022

Summary There are very few tools which are equally useful for data engineers, data scientists, and machine learning engineers. WhyLogs is a powerful library for flexibly instrumenting all of your data systems to understand the entire lifecycle of your data from source to productionized model. In this episode Andy Dang explains why the project was created, how you can apply it to your existing data systems, and how it functions to provide detailed context for being able to gain insight into all o

Machine Learning 100

Machine Learning Systems Data Lake Metadata 100

AltexSoft

APRIL 12, 2022

“AI systems (will) take decisions that have ethical grounds and consequences.”. Prof. Dr. Virginia Dignum from Umeå University. On March 23, 2016, Microsoft released its AI-based chatbot Tay via Twitter. The bot was trained to generate its responses based on interactions with users. But there was a catch. Various users started posting offensive tweets toward the bot, resulting in Tay making replies in the same language.

Insurance 98

Insurance Recruitment Government Algorithm 98

KDnuggets

APRIL 15, 2022

Data is the bread and butter of a Data Scientist, so knowing many approaches to loading data for analysis is crucial. Here, five Python techniques to bring in your data are reviewed with code examples for you to follow.

Python 160

Python Data Coding 160

Teradata

APRIL 13, 2022

Digitization is necessary, but not sufficient to meet evolving customer demands & create the bank of the future. Use data analytics to help customers achieve their goals not deliver better apps.

Banking 98

Banking Data Analytics Data 98

Speaker: Scott Sehlhorst

We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.

Certification

Cloudera

APRIL 13, 2022

The term “AI-first” has received its share of attention lately, especially in the boardroom where strategies to gain a competitive advantage are always welcome. But before a company embarks on an AI-first strategy, it pays to understand what it is and how it will transform the organization. If you’re AI-first, that means you have figured out how to leverage artificial intelligence to boost organizational agility so you can continuously adapt operational processes to deliver the right business ou

Data Collection 107

Data Collection Algorithm Machine Learning Education 107

Confluent

APRIL 4, 2022

Our everyday digital experiences are in the midst of a revolution. Customers increasingly expect their online experiences to be interactive, immersive, and real time by default. The need to satisfy […].

Building 122

Building Cloud Programming 122

Data Engineering Podcast

APRIL 16, 2022

Summary Putting machine learning models into production and keeping them there requires investing in well-managed systems to manage the full lifecycle of data cleaning, training, deployment and monitoring. This requires a repeatable and evolvable set of processes to keep it functional. The term MLOps has been coined to encapsulate all of these principles and the broader data community is working to establish a set of best practices and useful guidelines for streamlining adoption.

Data Engineering 100

Data Engineering Data Engineer Engineering IT 100

Rockset

APRIL 28, 2022

It is often said time flies when you are having fun and I couldn't agree more. I have been at Rockset for almost three years now and it is still so interesting to me. On one hand, I am just getting started and have so much more to do and on the other, I am so proud of the distance we have covered in the last few years! Photo by Daoudi Aissa on Unsplash Our customers tell us that the work we are doing matters to them: Rockset made me a hero on day three of my new job.

Medical 52

Medical Data Pipeline Designing Database 52

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

Data Science

KDnuggets

APRIL 27, 2022

Solving the Python coding interview questions is the best way to get ready for an interview. That’s why we’ll lead you through 15 examples and five concepts these questions cover.

Coding 159

Coding Python Data Science Data 159

Teradata

APRIL 26, 2022

Managing the new class of emerging risks requires infusing the principles of resiliency and efficient risk analytics into traditional risk management frameworks.

Systems 97

Systems Management 97

Cloudera

APRIL 6, 2022

This blog post was written by Elizabeth Howell, Ph.D as a guest author for Cloudera. . At a distance of a million miles from Earth, the James Webb Space Telescope is pushing the edge of data transfer capabilities. The observatory launched Dec. 25 2021 on a mission to look at the early universe, at exoplanets, and at other objects of celestial interest.

Big Data 98

Big Data Machine Learning Medical Insurance 98

Confluent

APRIL 5, 2022

We’re pleased to share a new multi-year partnership between Confluent and Microsoft to accelerate enterprises’ journey to cloud data streaming on Azure. Today’s announcement builds upon the partnership agreement we […].

Cloud 109

Cloud Data Building Programming 109

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

Building

Data Engineering Podcast

APRIL 10, 2022

Summary Any time that you are storing data about people there are a number of privacy and security considerations that come with it. Privacy engineering is a growing field in data management that focuses on how to protect attributes of personal data so that the containing datasets can be shared safely. In this episode Gretel co-founder and CTO John Myers explains how they are building tools for data engineers and analysts to incorporate privacy engineering techniques into their workflows and val

Engineering 100

Engineering Data Lake Data Engineering Data Engineer 100

Monte Carlo

APRIL 28, 2022

Most data pros know Snowflake’s pricing model is consumption based–you pay for what you use. What many don’t know is Snowflake actually WANTS you to optimize your costs and has provided helpful features to rightsize your consumption. Waste isn’t good for anyone. Instead of spinning cycles on deteriorated SQL queries, the data cloud provider would rather have you focus those Snowflake credits toward projects like building data apps.

Data Warehouse 52

Data Warehouse Bytes SQL AWS 52

KDnuggets

APRIL 8, 2022

Naïve Bayes is a probabilistic machine learning algorithm based on the Bayes Theorem, used in a wide variety of classification tasks. In this article, we will understand the Naïve Bayes algorithm and all essential concepts so that there is no room for doubts in understanding.

Algorithm 160

Algorithm Machine Learning 160

Teradata

APRIL 29, 2022

Find out why data analytics and connectivity will be the difference between retailing taking off and being grounded.

Retail 98

Retail Data Analytics Data 98

Advertisement

Outdated or absent analytics won’t cut it in today’s data-driven applications – not for your end users, your development team, or your business. That’s what drove the five companies in this e-book to change their approach to analytics. Download this e-book to learn about the unique problems each company faced and how they achieved huge returns beyond expectation by embedding analytics into applications.

Building

Cloudera

APRIL 20, 2022

The pandemic changed our healthcare behaviors. Planned hospital and doctor visits were reduced while telemedicine, for physical and mental health, increased. As healthcare providers and insurers /payers worked through mass amounts of new data, our health insurance practice was there to help. I have noticed a growing excitement with health insurers around the world exploring these data driven types of capabilities, and I am looking forward to experiencing more of this in my personal life while I

Healthcare 96

Healthcare Insurance Hospitality Medical 96

Confluent

APRIL 25, 2022

Data streaming is a new category of technology that is reshaping the way businesses operate, but there hasn’t been a place for everyone in the ecosystem to come together and […].

Kafka 104

Kafka Technology Data 104

Data Engineering Podcast

APRIL 3, 2022

Summary Building a data platform for your organization is a challenging undertaking. Building multiple data platforms for other organizations as a service without burning out is another thing entirely. In this episode Brandon Beidel from Red Ventures shares his experiences as a data product manager in charge of helping his customers build scalable analytics systems that fit their needs.

Designing 100

Designing Data Warehouse Data Engineering Data Engineer 100

Rockset

APRIL 26, 2022

As Kafka Summit is in full swing in London this week and the topic of event streaming is all over my Linkedin feed, I saw a post asking " Is streaming dead? " referring to CNN+ being shut down. In the last few days, Netflix took a once-in-a-lifetime beating in the stock market , and CNN redefined fail fast ( pioneered by Silicon Valley ) when it announced the breaking news that it will shut down CNN+ just weeks after a very splashy debut.

Kafka 52

Kafka Data Warehouse Database Data 52

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

Engineering

KDnuggets

APRIL 19, 2022

Approaches to data sampling, modeling, and analysis can vary based on the distribution of your data, and so determining the best fit theoretical distribution can be an essential step in your data exploration process.

Python 160

Python Data Process 160

Teradata

APRIL 11, 2022

Agility & innovation are the primary benefits enabled by a move to the cloud, but the initial focus is often on reducing the total cost of ownership. But this is only the first stage!

Cloud 75

Cloud 75

Cloudera

APRIL 7, 2022

As a public sector leader, you don’t need the value of data explained to you. You already understand its importance to your vital missions. . The challenge, rather, lies in locating data, streaming it, enriching it, and serving it, and then running analytics to maximize the value of the data that agencies already have — and the massive amount of new data generated every day from a wide variety of structured and unstructured sources.

Government 90

Government Data Governance Machine Learning Cloud 90

Confluent

APRIL 27, 2022

It’s official: Kafka Summit is back! Technically, it never went away—it just went online. But this week in London, Kafka Summit returned in all its glory to welcome over 1,200 […].

Kafka 104

Kafka IT 104

Speaker: David Bard, Principal at VP Product Coaching

In the fast-paced world of digital innovation, success is often accompanied by a multitude of challenges - like the pitfalls lurking at every turn, threatening to derail the most promising projects. But fret not, this webinar is your key to effective product development! Join us for an enlightening session to empower you to lead your team to greater heights.

Certification