Christophe Blefari

JANUARY 7, 2024

This edition of Data News will focus on the end of 2023 with a good retrospective about me and my activities—content and freelancing. My only target is, to be honest, to grow my blog, having 4000 people who trusted my enough to enter their email and validate the subscription is just crazy. Something I should change maybe.

Data 130

Data SQL Python Data Engineering 130

Workfall

DECEMBER 12, 2023

In Part 2 of this blog, we will do step-by-step implementation on how to build AI apps with Amazon PartyRock and Amazon Bedrock. In this blog, we will cover: From Bedrock to PartyRock: A Seamless Transition What is Amazon Bedrock? Functionalities of Amazon Bedrock What is Amazon PartyRock? What is Amazon Bedrock?

AWS 86

AWS Food Accessible Accessibility 86

Data Engineering Podcast

JUNE 19, 2022

Summary Metadata is the lifeblood of your data platform, providing information about what is happening in your systems. In order to level up their value a new trend of active metadata is being implemented, allowing use cases like keeping BI reports up to date, auto-scaling your warehouses, and automated data governance.

Metadata 130

Metadata MongoDB Scala MySQL 130

Knowledge Hut

APRIL 25, 2024

What Is Media Literacy? What Is Media Literacy? In essence, media literacy may assist someone in critically thinking about what they read, see, or hear in the media. What Is Media and Information Literacy? Whether the news comes from reliable sources or not, it is important to consider who and what to believe critically.

Media 98

Media Education Digital Media Utilities 98

Cloudera

MARCH 25, 2024

What is one goal you hope to accomplish in your new role? This messaging should highlight how we help large organizations solve some of the most complex data challenges and strengthen their business operations. What is an underrated quality or skill in the communications field to have?

Manufacturing 80

Manufacturing Retail Cloud Computing Technology 80

Data Engineering Weekly

FEBRUARY 4, 2024

RudderStack is the Warehouse Native CDP, built to help data teams deliver value across the entire data activation lifecycle, from collection to unification and activation. Joe Reis: Definition of Data Modeling & What Data Modeling Is not Joe raised a very fundamental question in data engineering.

Data Engineering 62

Data Engineering Data Engineer Engineering PostgreSQL 62

Towards Data Science

APRIL 30, 2024

Balancing correctness, latency, and cost in unbounded data processing Image created by the author. Intro Google Dataflow is a fully managed data processing service that provides serverless unified stream and batch data processing. Moreover, they want to run offline experiments over large amounts of historical data.

Google Cloud 64

Google Cloud Process Cloud Lambda Architecture 64

Zalando Engineering

NOVEMBER 8, 2023

Introduction This blog post describes a recent contribution from Zalando to the Postgres JDBC driver to address a long-standing issue with the driver’s integration with Postgres’ logical replication that resulted in runaway Write-Ahead Log (WAL) growth. So what is happening at a low level during this event-streaming process?

PostgreSQL 139

PostgreSQL Java Database Bytes 139

Data Engineering Podcast

NOVEMBER 20, 2022

Summary The majority of blog posts and presentations about data engineering and analytics assume that the consumers of those efforts are internal business users accessing an environment controlled by the business. Atlan is the metadata hub for your data ecosystem.

Systems 130

Systems Metadata Data Pipeline MongoDB 130

Cloudera

FEBRUARY 1, 2024

Delivering transformational innovation and accurate business decisions requires harnessing the full potential of your organization’s entire data ecosystem. Ultimately, this boils down to how reliable and trustworthy the underlying data that feeds your insights and applications is. How does Cloudera support Day 2 operations?

Cloud 81

Cloud Architecture Utilities Designing 81

Cloudera

MARCH 6, 2024

As we enter into a new month, the Cloudera team is getting ready to head off to the Gartner Data & Analytics Summit in Orlando, Florida for one of the most important events of the year for Chief Data Analytics Officers (CDAOs) and the field of data and analytics. Add a Human To The Loop: An Introduction to RLHF & DPO.

Data Analytics 103

Data Analytics Data Technology Data Engineering 103

Data Engineering Weekly

FEBRUARY 11, 2024

RudderStack is the Warehouse Native CDP, built to help data teams deliver value across the entire data activation lifecycle, from collection to unification and activation. Editors Note: A Survey on the current state of Data Products. What do you think of Data Products? Let me know in the comments.

Data Engineering 62

Data Engineering Data Engineer Engineering SQL 62

Knowledge Hut

APRIL 23, 2024

So, what exactly is the RAT? In this blog post, we'll dive into everything you need to know about RATs – What is Remote Access Trojan (RAT) in cybersecurity, their functionality, risks and dangers, common uses, and targets, as well as how to detect and prevent them from infecting your device.

Accessible 52

Accessible Accessibility Banking Programming 52

DareData

JANUARY 13, 2024

Continuing the Pytorch series, in this post we’ll learn about how non-linearities help solve complex problems in the context of neural networks In the last blog posts of the PyTorch Introduction series, we spoke about introduction to tensor objects and building a simple linear model using PyTorch. Let’s start!

Datasets 52

Datasets Deep Learning Architecture Algorithm 52

Data Engineering Weekly

MARCH 3, 2024

RudderStack is the Warehouse Native CDP, built to help data teams deliver value across the entire data activation lifecycle, from collection to unification and activation. Editor’s Note: Chennai, India Meetup - March-08 Update We are thankful to Ideas2IT to host our first Data Hero’s meetup.

Data Engineering 67

Data Engineering Data Engineer Pipeline-centric Engineering 67

Data Engineering Weekly

DECEMBER 3, 2023

RudderStack is the Warehouse Native CDP, built to help data teams deliver value across the entire data activation lifecycle, from collection to unification and activation. Github writes an excellent blog to capture the current state of the LLM integration architecture. Visit rudderstack.com to learn more.

Data Engineering 70

Data Engineering Data Engineer Engineering Bytes 70

Workfall

JANUARY 2, 2024

Reading Time: 9 minutes Navigating the complexities of state management is pivotal for controlling an application’s data, user interactions, and overall behavior. In this blog, we will explore step-by-step implementation of how to seamlessly manage state across multiple components by integrating Redux with React. What is Redux?

Management 88

Management Coding AWS Building 88

Knowledge Hut

MARCH 27, 2024

In this blog, that’s what my main motive is–to make you aware of black hat hackers and how you can prevent yourself from falling under the traps of one. What is Black Hat Hacking? Well, what is a black hat hacker? It is a person involved in practicing illegal cyber activities such as phishing, cyber-attacks, etc.

Retail 52

Retail Government Consulting Accessible 52

Netflix Tech

MARCH 7, 2023

These media focused machine learning algorithms as well as other teams generate a lot of data from the media files, which we described in our previous blog , are stored as annotations in Marken. Instead our challenge was to implement this feature on top of Cassandra and ElasticSearch databases because that’s what Marken uses.

Data Ingestion 105

Data Ingestion Management Algorithm Media 105

DoorDash Engineering

APRIL 23, 2024

When a merchant comes onboard at DoorDash, we add their internal SKU data — raw merchant data — to our retail catalog. SKU data from different merchants come in varying formats and quality; they may, for example, have missing or incorrect attribute values. Better personalization.

Building 84

Building Retail Manufacturing Unstructured Data 84

Robinhood

MARCH 26, 2024

Professional research from Morningstar and Level II market data from Nasdaq. Ten years in, Robinhood Presents: The New Gold Standard is yet another step forward in our company’s mission to democratize finance for all as we unveil our first credit card–the Robinhood Gold Card. Over 80% of U.S. Bigger instant deposits–up to $50K per day.

Banking 115

Banking Insurance Finance Programming 115

Knowledge Hut

APRIL 29, 2024

Organizations may face major losses not just in their profits but also loss of reputation, data, and customers. Therefore, almost all organizations want to keep their data and privacy of their customers safe from cyber criminals. This has made the role of the ethical hacker among the most important job roles in these times.

Certification 52

Certification Media Programming Government 52

Knowledge Hut

APRIL 29, 2024

In this blog, we look at the various characteristics and benefits of network diagrams in project management. What is a Project Network? A project network, also called project activity network, is a graphical description of the sequence in which the terminal events or milestones of a project must be completed.

Project 52

Project Management Certification Designing 52

Towards Data Science

JUNE 6, 2023

Fitbit activity analysis with DuckDB Photo by Jake Hills on Unsplash Wearable fitness trackers have become an integral part of our lives, collecting and tracking data about our daily activities, sleep patterns, location, heart rate, and much more. What insights are buried within my archive of personal fitness activity data?

Data Warehouse 93

Data Warehouse Data SQL Data Analysis 93

Pinterest Engineering

NOVEMBER 7, 2023

Jeff Xiang | Software Engineer, Logging Platform Vahid Hashemian | Software Engineer, Logging Platform Jesus Zuniga | Software Engineer, Logging Platform At Pinterest, data is ingested and transported at petabyte scale every day, bringing inspiration for our users to create a life they love.

Kafka 98

Kafka Java Software Engineer Software Engineering 98

Pinterest Engineering

MAY 9, 2023

Erika Sun ML Engineer | Advertiser Growth Modeling Team; Ogheneovo Dibie Engineering Manager | Advertiser Growth Modeling Team Photo by Jason Blackeye on Unsplash Summary In this blog post, we describe a Machine Learning (ML) powered proactive churn prevention solution that was prototyped with our small & medium business (SMB) advertisers.

Consulting 80

Consulting Data Science Architecture Engineering 80

DoorDash Engineering

SEPTEMBER 19, 2023

As a tech company, it’s our products and platform – and the engineers that build them – that power what DoorDash is able to offer our Consumers, Dashers, and Merchants every day. see this blog post for how we think about great engineering management). Business Outcome comprises two subcategories: Delivery and Direction.

Engineering 88

Engineering Recruitment Certification Data Analysis 88

Towards Data Science

JULY 10, 2023

Not the exact steps to take in the tool — that is all covered in innumerable blogs and tutorials. Many other fields have faced similar challenges and have created their own frameworks and processes that I can leverage when thinking about how to approach data modeling. I mean how do you know the right design?

Designing 98

Designing Electronics Coding Engineering 98

ThoughtSpot

OCTOBER 4, 2023

This blog is part of our ongoing ‘Why I joined ThoughtSpot’ series, where we profile Spotters from around the world to learn who they are and why they chose a career at ThoughtSpot. Here’s what he has to say about #LifeAtThoughtSpot. What were your top reasons for joining ThoughtSpot? How did you hear about ThoughtSpot?

Hospitality 90

Hospitality Technology Programming Cloud 90

Snowflake

APRIL 29, 2024

Here, we’ll cover what DORA is, why it matters and how Snowflake can help support your DORA compliance obligations. Identification of potential threats through data analysis and risk assessment processes to shift toward more proactive risk management. or better) for data in transit. How can Snowflake Help?

Transportation 79

Transportation Data Governance Government Consulting 79

Snowflake

APRIL 18, 2024

Legacy security information and event management (SIEM) solutions, like Splunk, are powerful tools for managing and analyzing machine-generated data. This model can force security teams to make difficult decisions on what data to ingest. But what if security teams didn’t have to make tradeoffs?

Data Lake 73

Data Lake Data Ingestion Bytes Cloud Computing 73

Data Engineering Weekly

OCTOBER 1, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. What is the data behavior? See how it works today. Dropbox: Is this a date?

Data Engineering 52

Data Engineering Data Engineer Engineering Data Pipeline 52

Engineering at Meta

OCTOBER 17, 2023

Systematic Code and Asset Removal Framework (SCARF) is Meta’s unused code and data deletion framework. So, how did we efficiently and safely remove all of the code and data related to Moments without adversely affecting Meta’s other products and services? In the last year, it has removed petabytes of unused data across 12.8M

Coding 112

Coding Engineering Portfolio Data Schemas 112

Cloudera

JANUARY 19, 2024

As described in our recent blog post , an SQL AI Assistant has been integrated into Hue with the capability to leverage the power of large language models (LLMs) for a number of SQL tasks. This is a real game-changer for data analysts on all levels and will make SQL development faster, easier, and less error-prone.

SQL 71

SQL Data Warehouse AWS Architecture 71

Edureka

MARCH 4, 2024

Today, I’m sharing with you an informative blog on how to Introduce Yourself in an Interview. This blog will guide you through some tricks and tips to start your interview confidently. By the end of this blog, you will learn to answer this question confidently. For example, “Hi, my name is Maria.

Computer Science 52

Computer Science Education Project Data Analysis 52

Knowledge Hut

APRIL 25, 2024

Even analyzing consumer data or live streaming social media plays a vital role in Information Technology. It is a staple in our day-to-day activities. It will surely help you reach great heights in your career, and you will understand what is information technology in depth along with the scope and benefits of Information Technology.

Technology 52

Technology Recruitment Media Cloud Computing 52

Knowledge Hut

APRIL 29, 2024

What are the fields that machine learning extends into? What is Model Deployment? When a model is deployed, it is fully equipped with training and it knows what are the inputs to be taken by the model and what are the outputs given out in return. Machine Learning is no longer just the latest buzzword.

Machine Learning 52

Machine Learning Python Datasets Coding 52