DoorDash Engineering

APRIL 23, 2024

Product attributes allow DoorDash to group products based on commonalities, building a product profile for each customer around their affinities to certain attributes. These are the building blocks for providing highly relevant and personalized shopping recommendations. Better personalization.

Building 91

Building Retail Manufacturing Unstructured Data 91

Towards Data Science

FEBRUARY 9, 2024

How to build a modern, scalable data platform to power your analytics and data science projects (updated) Table of Contents: What’s changed? The Platform Integration Data Store Transformation Orchestration Presentation Transportation Observability Closing What’s changed?

Building 82

Building Transportation Data Lake Metadata 82

Data Engineering Podcast

FEBRUARY 27, 2022

Summary There are a wealth of options for managing structured and textual data, but unstructured binary data assets are not as well supported across the ecosystem. Contact Info LinkedIn @cloudKrishna on Twitter Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Unstructured Data 100

Unstructured Data Cloud Management Metadata 100

Snowflake

MARCH 19, 2024

Since the explosion of interest in generative AI and large language models (LLMs), that is more true than ever, with business leaders discussing how quickly they should adopt these technologies to stay competitive. Strong data governance is essential to meet security and compliance obligations, but it is often regarded as a hindrance.

Data Governance 116

Data Governance Government Unstructured Data Programming Language 116

Data Engineering Podcast

JUNE 26, 2022

In this episode Isaac Brodsky explains how the Unfolded platform is architected, their experience joining the team at Foursquare, and how you can start using it for analyzing your spatial data today. Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows.

Datasets 130

Datasets Unstructured Data Metadata MongoDB 130

Snowflake

APRIL 8, 2024

In 2020, Snowflake announced a new global competition to recognize the work of early-stage startups building their apps — and their businesses — on Snowflake, offering up to $250,000 in investment as the top prize. In fact, 8 of the 10 startups in our semi-finalist list plan to use one or both of these technologies in their offerings.

Pipeline-centric 126

Pipeline-centric Food Healthcare Unstructured Data 126

Snowflake

MARCH 18, 2024

By 2025 it’s estimated that there will be 7 petabytes of data generated every day compared with “just” 2.3 And it’s not just any type of data. The majority of it (80%) is now estimated to be unstructured data such as images, videos, and documents — a resource from which enterprises are still not getting much value.

Unstructured Data 85

Unstructured Data Government Data Pipeline Cloud 85

Snowflake

NOVEMBER 1, 2023

That’s why we created Snowflake Cortex (in private preview), Snowflake’s new, intelligent, fully managed service that enables organizations to quickly analyze data and build AI applications — all within Snowflake. This means anyone who knows Python can securely build powerful LLM apps in minutes or hours, not days or weeks.

Unstructured Data 104

Unstructured Data SQL Python Accessible 104

Snowflake

MAY 9, 2024

From its start with efficient batch processing with data warehouses for descriptive analytics, and the inclusion of streaming data in real time to build recommendations, we find ourselves at the forefront of a new stage of evolution: generative AI (gen AI). It’s already having a real-world impact. “It’s

Unstructured Data 92

Unstructured Data Manufacturing Retail Data Warehouse 92

Knowledge Hut

APRIL 25, 2024

Big data vs machine learning is indispensable, and it is crucial to effectively discern their dissimilarities to harness their potential. Big data revolves around extensive volumes of structured and unstructured data originating from diverse sources. It focuses on collecting, storing, and processing extensive datasets.

Machine Learning 52

Machine Learning Big Data Unstructured Data Data Mining 52

Rockset

APRIL 18, 2023

Join me and Rockset VP of Engineering Louis Brandy for a tech talk, From Spam Fighting at Facebook to Vector Search at Rockset: How to Build Real-Time Machine Learning at Scale , on May 17th at 9am PT/ 12pm ET. Due to these difficulties, unstructured data has remained largely underutilized. Why use vector search?

Unstructured Data 105

Unstructured Data Metadata Machine Learning SQL 105

Knowledge Hut

APRIL 23, 2024

They also facilitate historical analysis, as they store long-term data records that can be used for trend analysis, forecasting, and decision-making. Big Data In contrast, big data encompasses the vast amounts of both structured and unstructured data that organizations generate on a daily basis.

Data Warehouse 52

Data Warehouse Big Data Unstructured Data Hadoop 52

Snowflake

SEPTEMBER 19, 2023

With all the hoopla around AI, there’s a lot to get up to speed on—especially the implications this technology has for data analytics. Ahmad has not only witnessed the emergence of AI in the data space but helped shape it throughout his career. AI unlocks new data use cases. Some takeaways?

Machine Learning 94

Machine Learning Unstructured Data Data Analytics Government 94

Snowflake

MARCH 7, 2024

In this blog post, we’ll walk through what the actual capabilities of LLMs are, and the steps financial organizations should take to harness this technology effectively and safely. The smoothness of the transition, therefore, depends on maturity or, as AI research Ashok Goel describes it, “muscle-building.”

Unstructured Data 81

Unstructured Data Government Data Architecture Architecture 81

Monte Carlo

AUGUST 19, 2023

A comprehensive data platform solution powers data acquisition, storage, preparation, delivery, governance, and even the robust security needs of users and applications. In today’s data-driven landscape, building a data platform is no longer a nice-to-have, but a necessity for most organizations. It depends.

Building 52

Building BI Data Lake Data Governance 52

Knowledge Hut

APRIL 23, 2024

For an organization, it is essential to know the difference between business intelligence and data science to make fair use of both and ensure significant growth. Data Science is the field that focuses on gathering data from multiple sources using different tools and techniques. This domain is limited to the business domain.

Business Intelligence 52

Business Intelligence Data Science BI Unstructured Data 52

Snowflake

JANUARY 8, 2024

As an industry built on data, financial services has always been an early adopter of AI technologies. Now, generative AI (gen AI) has supercharged its importance and organizations have begun heavily investing in this technology. Having a technology platform that allows for high capacity and flexibility is critical.

Unstructured Data 82

Unstructured Data Government Portfolio Insurance 82

Data Engineering Podcast

JUNE 19, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Metadata 130

Metadata Unstructured Data MongoDB MySQL 130

Snowflake

NOVEMBER 2, 2023

Over the years, the technology landscape for data management has given rise to various architecture patterns, each thoughtfully designed to cater to specific use cases and requirements. Use cases change, needs change, technology changes – and therefore data infrastructure should be able to scale and evolve with change.

Data Lake 89

Data Lake Data Warehouse Cloud Unstructured Data 89

Precisely

MAY 13, 2024

Key Takeaways: Data integration is vital for real-time data delivery across diverse cloud models and applications, and for leveraging technologies like generative AI. The right data integration solution helps you streamline operations, enhance data quality, reduce costs, and make better data-driven decisions.

Data Integration 52

Data Integration Metadata Amazon Web Services Data Governance 52

Snowflake

OCTOBER 11, 2023

As technological landscapes shift, startups are seeing new paradigms emerge that hold enormous potential for future growth. The growing role of data science in the modern business Today’s businesses are facing an unprecedented expansion of unstructured data that can permeate every department in an organization.

Unstructured Data 102

Unstructured Data Cloud Data Science Finance 102

Knowledge Hut

MAY 3, 2024

Spark offers over 80 high-level operators that make it easy to build parallel apps and one can use it interactively from the Scala, Python, R, and SQL shells. Optionally, knowing any cloud technology like AWS. Analytics - Spark can be very useful when building real-time analytics from a stream of incoming data.

Scala 98

Scala Hadoop Healthcare Big Data 98

AltexSoft

MAY 12, 2022

But acoustic signals can tell us even more if analyze them using modern technologies. Aiming at understanding sound data, it applies a range of technologies, including state-of-the-art deep learning algorithms. Audio data file formats. Building an app for snore and teeth grinding detection. Voice recognition.

Machine Learning 122

Machine Learning Building Datasets Healthcare 122

Knowledge Hut

APRIL 23, 2024

When it comes to big data vs data mining, big data focuses on managing large-scale data. In contrast, data mining goes beyond that by actively seeking patterns and extracting valuable insights. Big Data online can help you leverage big data skills and build a robust skill-set.

Data Mining 52

Data Mining Big Data Database-centric Unstructured Data 52

Cloudera

MARCH 17, 2023

I love the enthusiasm surrounding ChatGPT and the eagerness to learn about modern data architectures such as data lakehouses, data meshes, and data fabrics. ChatGPT is an excellent resource for gaining high-level insights and building awareness of any technology.

Education 61

Education Unstructured Data Data Lake Data Warehouse 61

Data Engineering Podcast

JUNE 12, 2022

Summary Building a well rounded and effective data team is an iterative process, and the first hire can set the stage for future success or failure. Trupti Natu has been the first data hire multiple times and gone through the process of building teams across the different stages of growth.

Metadata 100

Metadata Unstructured Data Business Intelligence MongoDB 100

Knowledge Hut

MARCH 19, 2024

The following are some steps a data scientist can take to become a machine learning engineer: What Does a Data Scientist Do? The broad discipline of data science is concerned with applying different scientific methods and techniques to analyze both organized and unstructured data.

Software Engineer 52

Software Engineer Software Engineering Engineering IT 52

Knowledge Hut

APRIL 26, 2024

Datasets are often related to a particular type of problem and machine learning models can be built to solve those problems by learning from the data. Many datasets are available online for learners who are starting off on building machine learning models. A technology has no significance without data.

Datasets 98

Datasets Machine Learning Deep Learning Finance 98

Monte Carlo

MAY 31, 2022

onFailure(funcName, qe, exception)) } } Spline provided a head-start in building Spark lineage. Instead of building a series of listeners from scratch, we decided to take advantage of that open source technology, Spline. A good engineer can build solutions for hard problems. It’s a really elegant solution….here’s

Data Lake 52

Data Lake Building Scala Metadata 52

Snowflake

JANUARY 18, 2024

A robust, flexible architecture Snowflake’s unique architecture is designed to handle the full volume, velocity and variety of data without making manufacturers deal with downtime for upgrades or compute changes. Built-in automation eliminates the need for customers to build indexes or do housekeeping.

Manufacturing 86

Manufacturing Unstructured Data Cloud Architecture 86

Knowledge Hut

DECEMBER 26, 2023

It is simply the study of mathematics, statistics, and computer science to extract information from structured and unstructured data. Data science, which solves problems by connecting relevant data for later use, aids these emerging technologies.

Data Science 52

Data Science Unstructured Data Medical Healthcare 52

Monte Carlo

AUGUST 25, 2023

With pre-built functionalities and robust SQL support, data warehouses are tailor-made to enable swift, actionable querying for data analytics teams working primarily with structured data. Commonly, you’ll find data formats such as JSON, Apache Parquet, and Apache Avro in these environments.

Data Lake 52

Data Lake Data Warehouse Unstructured Data Raw Data 52

Monte Carlo

NOVEMBER 9, 2023

Still, it’s one thing to show your boss a cool demo of a data discovery tool or text-to-SQL generator – it’s another thing to use it with your company’s proprietary data, or even more concerning, customer data. Remember NFTs?). Think: SecOps for AI. We shouldn’t treat AI applications any differently.

Unstructured Data 86

Unstructured Data Database Data Pipeline Architecture 86

Monte Carlo

JANUARY 25, 2023

In an evolving data landscape, the explosion of new tooling solutions—from cloud-based transforms to data observability —has made the question of “build versus buy” increasingly important for data leaders. Hint: it’s not a one-size-fits-all answer, but answering a few critical questions can help. Let’s jump in!

Data Warehouse 40

Data Warehouse Building Data Lake Data Storage 40

Snowflake

JANUARY 25, 2024

It’s essential for organizations to leverage vast amounts of structured and unstructured data for effective generative AI (gen AI) solutions that deliver a clear return on investment. Introducing new technologies is integral to solving these staffing and operational inefficiency challenges.

Healthcare 87

Healthcare Hospitality Electronics Medical 87

The Modern Data Company

JANUARY 22, 2024

The Modern Story: Navigating Complexity and Rethinking Data in The Business Landscape Enterprises face a data landscape marked by the proliferation of IoT-generated data, an influx of unstructured data, and a pervasive need for comprehensive data analytics.

Data Integration 98

Data Integration Metadata Government Unstructured Data 98

Towards Data Science

AUGUST 10, 2023

While their estimates varied from 50 to 20% on the “how much of generative AI is hype” spectrum, every panelist agreed this transformational technology had practical applications today and held tremendous potential. There’s plenty of unstructured data in the world. So let’s take a look at some of the recurring themes.

IT 82

IT Unstructured Data SQL BI 82