Data Engineering Podcast
MARCH 3, 2024
Summary Artificial intelligence technologies promise to revolutionize business and produce new sources of value. In order to make those promises a reality there is a substantial amount of strategy and investment required. Colleen Tartow has worked across all stages of the data lifecycle, and in this episode she shares her hard-earned wisdom about how to conduct an AI program for your organization.
Christophe Blefari
MARCH 2, 2024
Mistral ( credits ) Hello all, this is the Data News, this week edition might be smaller than usual in term of comments as I'm working on a Data News related project that takes me a bit of time, which will probably lead to a series of articles. Before I forget I've appeared on The Joe Reis Show , we chatted with Joe about data engineering teaching, why it is hard and about generative AI that will change education for ever.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Confessions of a Data Guy
MARCH 4, 2024
You probably think this is another internet clickbait title uh? Just trying to get you to clickty clickty and sell you some Google Ads. Two problems. I don’t have Google Ads, and I know a small percentage of people will actually listen to this advice. Whatever. There is a reason some developers struggle to move […] The post The Best Piece of Software Engineering Advice appeared first on Confessions of a Data Guy.
Waitingforcode
MARCH 5, 2024
I'm writing this unexpected blog post because I got stuck with watermarks and checkpoints and felt that I was missing some basics. Even though this introduction is a bit negative, the exploration for the data reading enabled my other discoveries.
Advertisement
Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.
Engineering at Meta
MARCH 6, 2024
To comply with a new EU law, the Digital Markets Act (DMA), which comes into force on March 7th, we’ve made major changes to WhatsApp and Messenger to enable interoperability with third-party messaging services. We’re sharing how we enabled third-party interoperability (interop) while maintaining end-to-end encryption (E2EE) and other privacy guarantees in our services as far as possible.
Christophe Blefari
MARCH 8, 2024
We all need recommendations ( credits ) When I started writing this newsletter nearly three years ago, I never imagined that the words I write on my keyboard would take such an important place in my life. All the interactions I have with you, whether online or offline, are always amazing and give me wings. Today I want to introduce a new feature in the Data News galaxy.
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
KDnuggets
MARCH 5, 2024
This article introduces six top-notch, free data science resources ideal for aspiring data analysts, data scientists, or anyone aiming to enhance their analytical skills.
Jesse Anderson
MARCH 4, 2024
I had the pleasure of being one of the speakers at GOTO Amsterdam 2023 where I talked about Why Most Data Projects Fail & How to Avoid It and I can’t wait to share this talk with you! Abstract: Unfortunately, the majority of data projects fail. Yet, they fail for the same reasons. Most management and data teams don’t know the reasons a project succeeds or fails.
Robinhood
MARCH 7, 2024
Today, Robinhood and KLUTCH Sports Group unveiled a new strategic partnership that will see KLUTCH Sports Group and its Property Sales division serve as Robinhood’s agency of record for partnerships in the sports and entertainment sectors. In addition, Rich Paul, the Founder and CEO of KLUTCH Sports Group, was named a strategic brand advisor at Robinhood.
Confessions of a Data Guy
MARCH 8, 2024
I recently did a challenge. The results were clear. DuckDB CANNOT handle larger-than-memory datasets. OOM Errors. See link below for more details. … DuckDB vs Polars – Thunderdome. 16GB on 4GB machine Challenge. The post DuckDB has MAJOR Problems! OOM Errors. appeared first on Confessions of a Data Guy.
Speaker: Scott Sehlhorst
We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.
KDnuggets
MARCH 5, 2024
Looking to learn SQL and databases to level up your data science skills? Learn SQL, database internals, and much more with these free university courses.
Snowflake
MARCH 5, 2024
As Large Language Models are revolutionizing natural language prompts, Large Vision Models (LVMs) represent another new, exciting frontier for AI. An estimated 90% of the world’s data is unstructured, much of it in the form of visual content such as images and videos. Insights from analyzing this visual data can open up powerful new use cases that significantly boost productivity and efficiency, but enterprises need sophisticated computer vision technologies to achieve this.
Robinhood
MARCH 6, 2024
On our busiest days, as much as 25% of the total daily trading volume has come from outside of traditional market hours Last year, Robinhood became the first US retail brokerage to offer 24/5 trading of single name stocks when we launched the Robinhood 24 Hour Market. The news cycle, world events, and market moving events like earnings often happen outside of US East Coast business hours.
Tweag
MARCH 6, 2024
Three years ago, a blog post introduced destination-passing style (DPS) programming in Haskell, focusing on array processing, for which the API was made safe thanks to Linear Haskell. Today, I’ll present a slightly different API to manipulate arbitrary data types in a DPS fashion, and show why it can be useful for some parts of your programs. The present blog post is mostly based on my recent paper Destination-passing style programming: a Haskell implementation , published at JFLA 2024.
Speaker: Timothy Chan, PhD., Head of Data Science
Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.
KDnuggets
MARCH 7, 2024
Ready to start a career in data science? Put your commitment hat on because I found 4 courses you need to become a master in a year!
databricks
MARCH 4, 2024
StreamNative, a leading Apache Pulsar-based real-time data platform solutions provider, and Databricks, the Data Intelligence Platform, are thrilled to announce the enhanced Pulsar-Spark.
Cloudera
MARCH 6, 2024
As we enter into a new month, the Cloudera team is getting ready to head off to the Gartner Data & Analytics Summit in Orlando, Florida for one of the most important events of the year for Chief Data Analytics Officers (CDAOs) and the field of data and analytics. We’re at a crucial point in time where the excitement and potential surrounding AI has elevated the importance of improving access to the mission-critical data that helps organizations implement it at scale.
Knowledge Hut
MARCH 7, 2024
In the digital era, the demand for cloud computing has increased like never before. It has brought about significant transformations in how businesses store, access, and share information. It allows organizations to carry out various tasks through the internet. Increased security, scalability, reduced costs, and better collaboration are a few benefits of cloud computing.
Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage
Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.
KDnuggets
MARCH 4, 2024
Transform your understanding of current and future tech with these top 5 AI reads to explore the minds shaping our future.
ThoughtSpot
MARCH 5, 2024
Managing complex data pipelines is a major challenge for data-driven organizations looking to accelerate analytics initiatives. While AI-powered, self-service BI platforms like ThoughtSpot can fully operationalize insights at scale by delivering visual data exploration and discovery, it still requires robust underlying data management. Now, that’s changing.
Netflix Tech
MARCH 5, 2024
The surprising and not so surprising benefits of generations in the Z Garbage Collector. By Danny Thomas, JVM Ecosystem Team The latest long term support release of the JDK delivers generational support for the Z Garbage Collector. More than half of our critical streaming video services are now running on JDK 21 with Generational ZGC, so it’s a good time to talk about our experience and the benefits we’ve seen.
Knowledge Hut
MARCH 7, 2024
The year 2024 saw some enthralling changes in volume and variety of data across businesses worldwide. The surge in data generation is only going to continue. Foresighted enterprises are the ones who will be able to leverage this data for maximum profitability through data processing and handling techniques. With the rise in opportunities related to Big Data, challenges are also bound to increase.
Advertisement
Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.
KDnuggets
MARCH 5, 2024
An in-depth overview of extractive text summarization, how state-of-the-art NLP models like BERT can enhance it, and a coding tutorial for using BERT to generate extractive summaries.
Snowflake
MARCH 6, 2024
Cyberattacks are devastating, especially when they derail real-world critical services like healthcare. An especially troubling attack field is ransomware: In 2022 , 66% of U.S. hospitals were targeted in ransomware attacks, an increase of almost 50% from 2021, and 289 hospitals were affected by successful ransomware attack incidents. Healthcare organizations paid the ransom in about 61% of ransomware incidents, the highest rate of any industry.
Netflix Tech
MARCH 7, 2024
David J. Berg , Romain Cledat , Kayla Seeley , Shashank Srikanth , Chaoying Wang , Darin Yu Netflix uses data science and machine learning across all facets of the company, powering a wide range of business applications from our internal infrastructure and content demand modeling to media understanding. The Machine Learning Platform (MLP) team at Netflix provides an entire ecosystem of tools around Metaflow , an open source machine learning infrastructure framework we started, to empower data sc
Knowledge Hut
MARCH 7, 2024
Business Analysts play a pivotal role in digital transformation projects carried out by organizations. BAs are thus expected to have knowledge about key concepts of business analysis and be skilled in using different tools and techniques for eliciting, analyzing, and managing requirements. In order to facilitate the five core responsibilities of a business analyst and communicate requirements, and in evaluating solutions, the BA is expected to have a set of competencies.
Speaker: Anne Steiner and David Laribee
As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.
KDnuggets
MARCH 8, 2024
Anthropic has released a new series of large language models and an updated Python API to access them.
Rock the JVM
MARCH 7, 2024
1. Introduction Kotlin is an amazing programming language. At the time of writing, Kotlin is the second most popular language on the JVM (behind Java of course), the language of choice for writing Android applications — which covers about 70% of the mobile market — and it’s opening new doors to other compilation targets (WASM, native) as well as multiplatform projects, targeting server-side, mobile (both iOS and Android) and the web.
Cloudera
MARCH 5, 2024
Artificial Intelligence (AI) is primed to reshape the way just about every business operates. Cloudera research projected that more than one third (36%) of organizations in the U.S. are in the early stages of exploring the potential for AI implementation. But even with its rise, AI is still a struggle for some enterprises. AI, and any analytics for that matter, are only as good as the data upon which they are based.
Knowledge Hut
MARCH 6, 2024
Training and development are critical for any professional. It helps you improve your performance and helps your organization meet its business goals. Building new skills makes an individual more efficient at a job or capable of handling different responsibilities and challenges. Developing skills is possible at the place of work or away from employment.
Speaker: Margaret-Ann Seger, Head of Product, Statsig
Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating
Expert insights. Personalized for you.
162 
Let's personalize your content