The Pragmatic Engineer

AUGUST 10, 2023

Stack Overflow shares website data with some of its most active members with reputations higher than 25,000. I’d like to call out how neat this approach is and how it contributes to transparency, even when the data isn’t flattering. However, the traffic data turned out to not account for a Google Analytics change.

Retail 171

Retail Utilities Software Engineer Software Engineering 171

Christophe Blefari

APRIL 5, 2024

Lost between ideas ( credits ) Hey, new Data News edition. MDS Fest is a free virtual 5 days conference about Modern Data Stack topics, a lot of awesome speakers, there are a few talks I can't wait to watch. It shows a few RAGs, Agents and parsers on documents to retrieve the data you need. But here we are.

SQL 130

SQL Data Python Datasets 130

Snowflake

JANUARY 4, 2024

Your company collects huge amounts of data about everything from customer transactions to supplier contracts to system performance. External data sources can fill that gap, which is why there’s a huge market for intelligence from third parties like government agencies, international organizations, open source platforms and nonprofits.

SQL 102

SQL Retail Data Government 102

Christophe Blefari

JANUARY 14, 2024

Back to the usual Data News—with a little delay, I'm sorry. It's a subject close to my heart and I was very happy to share it with you, because I never thought that Data News would become such a big part of my life. I actually cover data engineering and how to put data stuff into production.

Google Cloud 130

Google Cloud Data SQL Python 130

Towards Data Science

FEBRUARY 6, 2024

This generalisation makes their data models complex and cryptic and require domain expertise. Even harder to manage, a common setup within large organisations is to have several instances of these systems with some underlaying processes in charge of transmitting data among them, which could lead to duplications, inconsistencies, and opacity.

Systems 83

Systems Raw Data Metadata Data Cleanse 83

Engineering at Meta

DECEMBER 19, 2023

On July 5, 2023, Meta launched Threads, the newest product in our family of apps, to an unprecedented success that saw it garner over 100 million sign ups in its first five days. The seamless scale that people experienced as they signed up by the millions came on the shoulders of over a decade of infrastructure and product development.

Programming Language 142

Programming Language Engineering Database Coding 142

Snowflake

MAY 1, 2024

by Extropy360 will advance to the Snowflake Startup Challenge finale and compete for the opportunity to receive a share of up to $1 million in investments from Snowflake Ventures, plus exclusive mentorship and visibility opportunities from NYSE. BigGeo Crunching vast amounts of geospatial data is an intimidating, resource-consuming task.

Media 104

Media Building Data Warehouse Technology 104

Snowflake

APRIL 8, 2024

The list of Top 10 semi-finalists is a perfect example: we have use cases for cybersecurity, gen AI, food safety, restaurant chain pricing, quantitative trading analytics, geospatial data, sales pipeline measurement, marketing tech and healthcare. Our sincere thanks go out to everyone who participated in this year’s competition.

Pipeline-centric 126

Pipeline-centric Food Healthcare Unstructured Data 126

Snowflake

SEPTEMBER 25, 2023

Digital advancements such as smart manufacturing and automation through AI, machine learning (ML), robotics, and IoT require a connected value chain ecosystem with a secure, scalable, and flexible data platform. Easy data sharing and collaboration A key feature of Snowflake is the ability to share and collaborate on data.

Manufacturing 87

Manufacturing Cloud Electronics BI 87

Knowledge Hut

APRIL 29, 2024

People are being laid-off from work due to companies suffering from financial and production losses. GoTo Meeting, Zoom Meetings, and Cisco WebEx are some of the platforms that enable video conferencing, video chat, live and private chat, streaming, and screen sharing. Flexibility and improvisation are the gifts imparted to humans.

Project 98

Project Portfolio Cloud Data Storage 98

Snowflake

FEBRUARY 5, 2024

And it’s no wonder — this new technology has the potential to revolutionize the industry by augmenting the value of employee work, driving organizational efficiencies, providing personalized customer experiences, and uncovering new insights from vast amounts of data. One potential source is data sharing.

Unstructured Data 100

Unstructured Data Banking Government Insurance 100

Snowflake

APRIL 17, 2024

In today’s data-driven world, developer productivity is essential for organizations to build effective and reliable products, accelerate time to value, and fuel ongoing innovation. This allows your applications to handle large data sets and complex workflows efficiently.

Data Pipeline 107

Data Pipeline Python Data Engineering Data Engineer 107

Engineering at Meta

SEPTEMBER 12, 2023

Meta’s Native Assurance team regularly performs manual code reviews as part of our ongoing commitment to improve the security posture of Meta’s products. In 2021, we discovered a vulnerability in the Meta Quest 2’s Android-based OS that never made it to production but helped us find new ways to improve the security of Meta Quest products.

Bytes 131

Bytes Coding Programming Process 131

Towards Data Science

AUGUST 2, 2023

A Step-by-Step Guide to Building an Effective Data Quality Strategy from Scratch How to build an interpretable data quality framework based on user expectations Photo by Rémi Müller on Unsplash As data engineers, we are (or should be) responsible for the quality of the data we provide. Where do I start?

Building 98

Building Data Consolidation Data Datasets 98

Netflix Tech

MARCH 7, 2024

Berg , Romain Cledat , Kayla Seeley , Shashank Srikanth , Chaoying Wang , Darin Yu Netflix uses data science and machine learning across all facets of the company, powering a wide range of business applications from our internal infrastructure and content demand modeling to media understanding.

Systems 90

Systems Media Machine Learning Data Warehouse 90

Netflix Tech

DECEMBER 14, 2023

Engineers from across the company came together to share best practices on everything from Data Processing Patterns to Building Reliable Data Pipelines. The result was a series of talks which we are now sharing with the rest of the Data Engineering community!

Data Engineering 103

Data Engineering Data Engineer Engineering Metadata 103

Engineering at Meta

FEBRUARY 6, 2023

At the time, News Feed’s data models were backed by Apple’s default framework for managing data models: Core Data. Objects in Core Data are mutable, and that did not lend itself well to News Feed’s multithreaded architecture. Ultimately, the choice to replace the UI and data layer with custom infra was a trade-off.

Architecture 142

Architecture Coding Engineering Systems 142

Data Engineering Weekly

FEBRUARY 18, 2024

RudderStack is the Warehouse Native CDP, built to help data teams deliver value across the entire data activation lifecycle, from collection to unification and activation. Our hope is only with the amazing community of data practitioners who constantly support us. We are so over the Big Data Era to Modern Data Stack.

Data Engineering 62

Data Engineering Data Engineer Engineering Data 62

Snowflake

SEPTEMBER 13, 2023

Building your data product is only the beginning. Or maybe you just have some really unique data that you think might be of use to someone. Once you’ve determined your first “P” (the product), it’s time to think about the remaining three “Ps” of the famous four Ps of marketing : place, promotion and pricing.

Food 101

Food Retail Hospitality Data 101

Snowflake

SEPTEMBER 12, 2023

The White House recently released the first National Cybersecurity Strategy , which among other things, holds the stewards of data accountable and shifts liability for insecure software products and services away from end users and toward vendors that are capable of taking actions to prevent bad outcomes.

Designing 84

Designing Accessible Accessibility Building 84

Cloudera

MARCH 6, 2024

As we enter into a new month, the Cloudera team is getting ready to head off to the Gartner Data & Analytics Summit in Orlando, Florida for one of the most important events of the year for Chief Data Analytics Officers (CDAOs) and the field of data and analytics.

Data Analytics 107

Data Analytics Data Technology Data Engineering 107

Snowflake

OCTOBER 31, 2023

Successful MDR providers are finding new ways to protect customers and grow their profits by leveraging advances in data and artificial intelligence. The enormity of security data volume further complicates matters, with reports suggesting that cloud infrastructures are up to 10 times chattier than their on-premise counterparts.

Management 87

Management Data Science Cloud Data Storage 87

Data Engineering Weekly

APRIL 7, 2024

Poor data quality and unlcear data ownership remains the top challenges for the data teams. Data Mesh continuously gaining popularity among the enterprises. It is a stark difference from the Gartner report about data mesh. I guess only the time will tell who wins in the data mesh vs data fabric war.

Data Engineering 70

Data Engineering Data Engineer Engineering Unstructured Data 70

Data Engineering Weekly

MARCH 17, 2024

Compliance is mandatory, with strict penalties for violations, emphasizing the importance of data scientists familiarizing themselves with the law to avoid prohibited AI uses and ensure ethical, safe AI development. It discusses the significance of data governance, sharing history, and generative AI's impact on data economy standards.

Data Engineering 70

Data Engineering Data Engineer Engineering Data Governance 70

Engineering at Meta

SEPTEMBER 7, 2023

It would have all the features people expect from a text-based conversations app, but with one very key, distinctive goal – being an app that would allow people to share their content across multiple platforms. Engineers from all parts of the Infrastructure team, the product teams, as well as on-call engineers were pulled in.

Media 143

Media Engineering Coding Python 143

Lyft Engineering

APRIL 24, 2024

At Lyft, data scientists tackle challenging technical problems every day. To support and empower our data scientists, Lyft’s Technical Learning Council (TLC) provides diverse and high-quality continuous learning opportunities to hone their technical skills. Written by Shumpei Goke and Jinshu Niu Why Technical Learning?

Data Science 66

Data Science Building Computer Science Software Engineer 66

LinkedIn Engineering

DECEMBER 19, 2023

Co-authors: Max Kanat-Alexander and Grant Jenks Today we are open-sourcing the LinkedIn Developer Productivity & Happiness Framework (DPH Framework) - a collection of documents that describe the systems, processes, metrics, and feedback systems we use to understand our developers and their needs internally at LinkedIn.

Data Schemas 121

Data Schemas Software Engineer Software Engineering Data Pipeline 121

Snowflake

MARCH 28, 2023

But one area that has consistently remained resilient is investments in data and analytics technologies. And, that requires better insights from more data and from diverse data. Decision-makers know that their own internal data is not enough. Bottom line: Data ecosystems are growing. Can they keep up with requests?

Finance 93

Finance Data Governance Data Retail 93

Snowflake

FEBRUARY 19, 2024

In 2024, the retail and consumer goods industry is expected to experience massive upheaval due to the proliferation of generative AI (gen AI) tools as well as changes in customer engagement and the general manner in which products are now sold. For their full insights, read the new report, Retail Data + AI Predictions 2024.

Retail 73

Retail Media Data Government 73

Cloudera

APRIL 23, 2024

The Hackathon was intended to provide data science experts with access to Cloudera machine learning to develop their own Accelerated Machine Learning Project (AMP) focused on solving one of the many environmental challenges facing the world today.

Machine Learning 88

Machine Learning Data Science Retail Consulting 88

Scott Logic

MARCH 27, 2024

Industry leaders are shifting their focus towards bringing new differentiated, highly personalised products and services to their customers. The key strategic building blocks for winning ecosystems are customer research, partnerships and data. APIs enable data sets (e.g. APIs enable data sets (e.g.

Insurance 52

Insurance Banking Retail Education 52

ThoughtSpot

NOVEMBER 6, 2023

As we expand our reach into new and existing markets across products and segments, Kelley will play an important role in driving revenue growth, productivity, and operational effectiveness throughout the organization. Honestly, I did not know much about ThoughtSpot when I was approached about the role.

Accessible 84

Accessible Accessibility IT Data 84

ThoughtSpot

JUNE 27, 2023

We don’t have to make any assumptions to answer this question, because we have the data. Your passion continually shapes and inspires us on our journey to make a more accessible ThoughtSpot that empowers everyone to derive valuable insights from their data. But the benefits don’t stop there.

Programming 82

Programming Data Science Data Analytics Process 82

Knowledge Hut

JANUARY 18, 2024

Through this meticulous process of continuously grooming and prioritizing backlog items, I have seen teams transform their workflow, achieving higher productivity and better alignment with project goals. In this article, I aim to share my personal insights and professional experiences in this realm. What is Backlog Refinement?

Project 98

Project Certification Management Process 98