KDnuggets

MARCH 9, 2020

Finding good datasets to work with can be challenging, so this article discusses more than 20 great datasets along with machine learning project ideas for you to tackle today. Upgrading your machine learning, AI, and Data Science skills requires practice. To practice, you need to develop models with a large amount of data.

Machine Learning 143

Machine Learning Datasets Project Data Science 143

ArcGIS

FEBRUARY 27, 2023

you can use the Append tool to upsert (update and insert) a target dataset with data from a new or updated dataset. In ArcGIS Pro 3.1,

Datasets 104

Datasets Data Data Management Government 104

Medium Data Engineering

MARCH 9, 2023

Spark has two notions of structured collections — DataSets and DataFrames. Both are distributed collection of objects as rows with well… Continue reading on Medium »

Datasets 52

Datasets Data Engineering Data Engineer Engineering 52

Medium Data Engineering

MAY 15, 2023

Programmatically list all datasets and tables using BigQuery API and Python Continue reading on Towards Data Science »

Datasets 97

Datasets Python Data Science Data 97

ArcGIS

NOVEMBER 8, 2023

Terrain datasets as ground—Create scenes in ArcGIS Pro and publish to ArcGIS Online

Datasets 67

Datasets Analytics Architecture Data Management Architecture 67

KDnuggets

JULY 17, 2023

Use ChatGPT to explore a dataset, generate visualizations, and gain insights. A guide to using ChatGPT for exploratory data analysis.

Datasets 81

Datasets Data Data Analysis Data Science 81

Towards Data Science

MAY 15, 2023

Programmatically list all datasets and tables using BigQuery API and Python Continue reading on Towards Data Science »

Datasets 95

Datasets Python Data Science Data 95

KDnuggets

JANUARY 15, 2022

In our first weekly roundup of data science nuggets from around the web, check out a list of curated articles on Kaggle datasets, Python debugging tools, what it is data scientists do, an overview of YOLO, 2-dimensional PyTorch tensors, and the secrets of machine learning deployment.

Data Science 142

Data Science Datasets Python Data 142

KDnuggets

SEPTEMBER 28, 2022

We explain how choosing a small, representative dataset from a large population can improve model training reliability.

Datasets 145

Datasets Machine Learning 145

Medium Data Engineering

NOVEMBER 6, 2023

In Apache Spark, when one of the RDD (Resilient Distributed Dataset) partitions or stages of a job fails, the Spark framework has built-in… Continue reading on Medium »

Datasets 52

Datasets Big Data Data Engineering Data Engineer 52

Medium Data Engineering

SEPTEMBER 1, 2023

Tracking versions and historical changes in training dataset is instrumental in building a robust data engine for machine learning at an… Continue reading on Medium »

Datasets 52

Datasets Deep Learning Machine Learning Data Engineering 52

Medium Data Engineering

MAY 20, 2023

But what happens when you have a small dataset, especially when dealing with images? Data is the lifeblood of machine learning. The answer… Continue reading on Medium »

Datasets 52

Datasets Machine Learning Data Data Engineering 52

ArcGIS

AUGUST 15, 2023

Esri provides deprecation notice of shapefile network datasets from the ArcGIS Pro 3.2 Support for this file format is ending.

Datasets 52

Datasets 52

Ascend.io

MAY 23, 2023

A prime example of such patterns is orphaned datasets. These are datasets that exist in a database or data storage system but no longer have a relevant link or relationship to other data, to any of the analytics, or to the main application — making them a deceptively challenging issue to tackle. But what if there was a better way?

Datasets 52

Datasets Data Pipeline Metadata Data Engineering 52

LinkedIn Engineering

JUNE 15, 2023

To remove this bottleneck, we built AvroTensorDataset , a TensorFlow dataset for reading, parsing, and processing Avro data. Today, we’re excited to open source this tool so that other Avro and Tensorflow users can use this dataset in their machine learning pipelines to get a large performance boost to their training workloads.

Datasets 104

Datasets Bytes Process Data 104

Medium Data Engineering

MARCH 21, 2023

Help yourself making good choice between RDD, Dataframe and Datasets by leaning about these Spark APIs Continue reading on Medium »

Datasets 52

Datasets Data Engineering Data Engineer Engineering 52

ArcGIS

NOVEMBER 9, 2023

2023 Release 2 dataset. Prerequisite steps to complete prior to setting up local U.S.

Datasets 62

Datasets Business Analyst 62

Medium Data Engineering

OCTOBER 2, 2023

In the dynamic world of big data processing, Apache Spark has emerged as a powerful tool for handling vast amounts of information with… Continue reading on Medium »

Datasets 52

Datasets Big Data Data Process Data 52

Analytics Vidhya

JULY 6, 2023

Building an accurate machine learning and AI model requires a high-quality dataset. Introduction In this era of Generative Al, data generation is at its peak.

Datasets 237

Datasets Machine Learning Data Building 237

Medium Data Engineering

JULY 24, 2023

Resilient Distributed Datasets (RDDs) are a fundamental data structure that holds data in Apache Spark. For example: Take the data structure LIST. It is stored in one machine. Assume RDD as a similar…

Datasets 52

Datasets Data Engineering Data Engineer Data 52

Medium Data Engineering

MARCH 11, 2023

Apache Spark provides three abstractions for distributed data processing: RDD (Resilient Distributed Dataset), Dataset, and DataFrame… Continue reading on Medium »

Datasets 40

Datasets Data Process Data Process 40

Medium Data Engineering

FEBRUARY 16, 2023

Handle Grouping Large Datasets and Keep Your Sanity with Spark Continue reading on Medium »

Datasets 52

Datasets Big Data Data Engineering Data Engineer 52

InData Labs

APRIL 4, 2022

RDD (Resilient Distributed Dataset). Запись Converting Spark RDD to DataFrame and Dataset впервые появилась InData Labs. First, we will provide you with a holistic view of all of them in one place. Second, we will explore each option with examples. The main approach to work with unstructured data.

Datasets 52

Datasets Unstructured Data Data Data Engineering 52

KDnuggets

MARCH 23, 2022

Create, version-control, query, and visualize image, audio, and video datasets using Hub 2.0 by Activeloop.

Datasets 93

Datasets Deep Learning Management Machine Learning 93

Databand.ai

SEPTEMBER 12, 2022

How to analyze dataset performance and schema changes in Databand Eric Jones 2022-09-12 13:06:42 “Why did my dataset schema change?” Databand helps fix this problem by capturing the metadata from your datasets and then alerting you when dataset operations change unexpectedly. Yeah, we hear this question a lot too.

Datasets 52

Datasets Data Engineering Data Engineer Metadata 52

KDnuggets

FEBRUARY 28, 2022

Datasets - properly curated and labeled - remain a scarce resource. What can be done about this?

Datasets 93

Datasets Machine Learning 93

Medium Data Engineering

MAY 30, 2023

Introduction: When working with large datasets, it is often essential to gain insights into the data’s characteristics. One important… Continue reading on Medium »

Datasets 52

Datasets Data Data Engineering Data Engineer 52

AltexSoft

OCTOBER 18, 2022

In this post, we’ll briefly discuss challenges you face when working with medical data and make an overview of publucly available healthcare datasets, along with practical tasks they help solve. At the same time, de-identification only encrypts personal details and hides them in separate datasets. Medical datasets comparison chart .

Datasets 52

Datasets Machine Learning Medical Healthcare 52

KDnuggets

JANUARY 22, 2020

This post is about explaining the various techniques you can use to handle imbalanced datasets.

Datasets 122

Datasets Python 122

Data Engineering Podcast

JUNE 26, 2022

What (if any) are the datasets or analyses that you are consciously not investing in supporting? What (if any) are the datasets or analyses that you are consciously not investing in supporting? What are some of the sources that organizations rely on for collecting or generating those data sets?

Datasets 130

Datasets Unstructured Data Metadata Machine Learning 130

databricks

OCTOBER 17, 2023

Introduction Large Language Models (LLMs) have given us a way to generate text, extract information, and identify patterns in industries from healthcare to.

Datasets 95

Datasets Healthcare Data 95

Netflix Tech

OCTOBER 16, 2019

By Ammar Khaku Introduction In a microservice architecture such as Netflix’s, propagating datasets from a single source to multiple downstream destinations can be challenging. One example displaying the need for dataset propagation: at any given time Netflix runs a very large number of A/B tests.

Datasets 75

Datasets Metadata Machine Learning Data 75

ProjectPro

JANUARY 15, 2021

And honestly, there are a lot of real-world machine learning datasets around you that you can opt to start practicing your fundamental data science and machine learning skills, even without having to complete a comprehensive data science or machine learning course. Table of Contents What is a dataset in machine learning?

Machine Learning 40

Machine Learning Datasets Data Science Retail 40

ArcGIS

NOVEMBER 8, 2023

Surfaces in a centralized location

Datasets 67

Datasets Analytics Architecture Data Management Architecture 67

Analytics Vidhya

JUNE 12, 2023

Tajinder’s passion for unraveling hidden patterns in complex datasets has driven impactful outcomes, transforming raw data into actionable intelligence. Introduction Meet Tajinder, a seasoned Senior Data Scientist and ML Engineer who has excelled in the rapidly evolving field of data science.

Machine Learning 230

Machine Learning Engineering Raw Data Data 230

Medium Data Engineering

FEBRUARY 26, 2023

Ray provides the ability to manage distributed tasks, real-time data streams, and large-scale machine learning models. It provides APIs to… Continue reading on Medium »

Datasets 52

Datasets Data Process Machine Learning 52

Analytics Vidhya

FEBRUARY 23, 2023

Introduction Big Data is a large and complex dataset generated by various sources and grows exponentially. It is so extensive and diverse that traditional data processing methods cannot handle it. The volume, velocity, and variety of Big Data can make it difficult to process and analyze.

Big Data Tools 236

Big Data Tools Big Data Data Datasets 236