KDnuggets

JANUARY 15, 2022

In our first weekly roundup of data science nuggets from around the web, check out a list of curated articles on Kaggle datasets, Python debugging tools, what it is data scientists do, an overview of YOLO, 2-dimensional PyTorch tensors, and the secrets of machine learning deployment.

Datasets 158

Datasets Data Science Python Machine Learning 158

KDnuggets

JULY 17, 2023

Use ChatGPT to explore a dataset, generate visualizations, and gain insights. A guide to using ChatGPT for exploratory data analysis.

Datasets 101

Datasets Data Analysis Data Data Science 101

KDnuggets

SEPTEMBER 28, 2022

We explain how choosing a small, representative dataset from a large population can improve model training reliability.

Datasets 160

Datasets Machine Learning 160

ArcGIS

FEBRUARY 27, 2023

you can use the Append tool to upsert (update and insert) a target dataset with data from a new or updated dataset. In ArcGIS Pro 3.1,

Datasets 103

Datasets Data Data Management Government 103

Towards Data Science

MAY 15, 2023

Programmatically list all datasets and tables using BigQuery API and Python Continue reading on Towards Data Science »

Datasets 88

Datasets Python Data Science Google Cloud 88

KDnuggets

MARCH 23, 2022

Create, version-control, query, and visualize image, audio, and video datasets using Hub 2.0 by Activeloop.

Datasets 109

Datasets Deep Learning Management Machine Learning 109

Ascend.io

MAY 23, 2023

A prime example of such patterns is orphaned datasets. These are datasets that exist in a database or data storage system but no longer have a relevant link or relationship to other data, to any of the analytics, or to the main application — making them a deceptively challenging issue to tackle. But what if there was a better way?

Datasets 52

Datasets Data Pipeline Metadata Database 52

KDnuggets

FEBRUARY 28, 2022

Datasets - properly curated and labeled - remain a scarce resource. What can be done about this?

Datasets 111

Datasets Machine Learning 111

ArcGIS

AUGUST 15, 2023

Esri provides deprecation notice of shapefile network datasets from the ArcGIS Pro 3.2 Support for this file format is ending.

Datasets 52

Datasets 52

KDnuggets

JANUARY 22, 2020

This post is about explaining the various techniques you can use to handle imbalanced datasets.

Datasets 147

Datasets Python 147

InData Labs

APRIL 4, 2022

RDD (Resilient Distributed Dataset). Запись Converting Spark RDD to DataFrame and Dataset впервые появилась InData Labs. First, we will provide you with a holistic view of all of them in one place. Second, we will explore each option with examples. The main approach to work with unstructured data.

Datasets 52

Datasets Unstructured Data Data IT 52

ArcGIS

NOVEMBER 8, 2023

Terrain datasets as ground—Create scenes in ArcGIS Pro and publish to ArcGIS Online

Datasets 64

Datasets Analytics Architecture Data Management Architecture 64

Databand.ai

SEPTEMBER 12, 2022

How to analyze dataset performance and schema changes in Databand Eric Jones 2022-09-12 13:06:42 “Why did my dataset schema change?” Databand helps fix this problem by capturing the metadata from your datasets and then alerting you when dataset operations change unexpectedly. Yeah, we hear this question a lot too.

Datasets 52

Datasets Metadata Data Engineering Data Engineer 52

AltexSoft

OCTOBER 18, 2022

In this post, we’ll briefly discuss challenges you face when working with medical data and make an overview of publucly available healthcare datasets, along with practical tasks they help solve. At the same time, de-identification only encrypts personal details and hides them in separate datasets. Medical datasets comparison chart .

Medical 52

Medical Datasets Machine Learning Hospitality 52

ArcGIS

JANUARY 2, 2024

Learn how to create cloud free image cubes from imagery in the cloud using STAC

Datasets 80

Datasets Cloud 80

databricks

OCTOBER 17, 2023

Introduction Large Language Models (LLMs) have given us a way to generate text, extract information, and identify patterns in industries from healthcare to.

Datasets 93

Datasets Healthcare Data 93

ArcGIS

NOVEMBER 9, 2023

2023 Release 2 dataset. Prerequisite steps to complete prior to setting up local U.S.

Business Analyst 60

Business Analyst Datasets 60

KDnuggets

SEPTEMBER 18, 2023

Using exploratory data analysis to wnderstand missing data gaps.

Datasets 119

Datasets Data Analysis Data Data Science 119

Analytics Vidhya

JULY 6, 2023

Building an accurate machine learning and AI model requires a high-quality dataset. Introduction In this era of Generative Al, data generation is at its peak.

Datasets 236

Datasets Machine Learning Building Algorithm 236

ArcGIS

NOVEMBER 8, 2023

Surfaces in a centralized location

Datasets 64

Datasets Analytics Architecture Data Management Architecture 64

Towards Data Science

MAY 28, 2023

Clean, process and tokenise texts in milliseconds using in-built Polars string expressions Continue reading on Towards Data Science »

Datasets 68

Datasets Process Data Science Data 68

KDnuggets

NOVEMBER 8, 2021

With a lot of excitement and research around NLP, there are growing opportunities to apply these technologies to real-world scenarios. It's not trivial to become familiar with NLP and these open-source data sets can help you increase your skills.

Datasets 123

Datasets Process Technology IT 123

KDnuggets

JANUARY 2, 2023

This рареr attempts to exploit primarily twо flaws in the Infо-GАN рареr while retаining the оther good qualities improvements.

Datasets 108

Datasets Machine Learning 108

KDnuggets

OCTOBER 2, 2019

Applying a clustering algorithm is much easier than selecting the best one. Each type offers pros and cons that must be considered if you’re striving for a tidy cluster structure.

Algorithm 121

Algorithm Datasets 121

KDnuggets

JANUARY 11, 2022

Finding the data you need is hard. So why not fake it?

Datasets 160

Datasets IT Data Data Science 160

Confessions of a Data Guy

APRIL 19, 2024

The idea was to see if the two tools could process “larger than memory” datasets with lazy execution. Back in March, I did a writeup and experiment called DuckDB vs Polars, Thunderdom, 16GB on 4GB machine challenge. Polars worked fine, DuckDB failed in spectacular fashion.

IT 140

IT Datasets Process Data 140

Waitingforcode

APRIL 11, 2024

Doing that with a batch is relatively easy due to the static nature of the dataset. Data enrichment is a crucial step in making data more usable by the business users. When it comes to streaming, the task is more challenging.

Datasets 130

Datasets Data IT 130

KDnuggets

SEPTEMBER 19, 2019

While mature algorithms and extensive open-source libraries are widely available for machine learning practitioners, sufficient data to apply these techniques remains a core challenge. Discover how to leverage scikit-learn and other tools to generate synthetic data appropriate for optimizing and fine-tuning your models.

Machine Learning 92

Machine Learning Datasets Algorithm Data 92

databricks

MARCH 26, 2023

In today's business landscape, secure and cost-effective data sharing is more critical than ever for organizations looking to optimize their internal and external.

Datasets 75

Datasets Data 75

Knowledge Hut

APRIL 25, 2024

Recognizing the difference between big data and machine learning is crucial since big data involves managing and processing extensive datasets, while machine learning revolves around creating algorithms and models to extract valuable information and make data-driven predictions.

Machine Learning 52

Machine Learning Big Data Unstructured Data Data Mining 52

Confessions of a Data Guy

MARCH 8, 2024

DuckDB CANNOT handle larger-than-memory datasets. I recently did a challenge. The results were clear. OOM Errors. See link below for more details. … DuckDB vs Polars – Thunderdome. 16GB on 4GB machine Challenge. The post DuckDB has MAJOR Problems! OOM Errors. appeared first on Confessions of a Data Guy.

Datasets 130

Datasets Data 130

Christophe Blefari

FEBRUARY 2, 2024

In their datasets product when looking at a dataset you can full text search or see distributions (with bars at the top of columns) and this is powered with DuckDB. Lastly they pre-compute statistics on datasets with DuckDB. HuggingFace is using DuckDB in multiples features to power data exploration in the frontend.

Datasets 130

Datasets Data Lake SQL Algorithm 130

Christophe Blefari

APRIL 19, 2024

It was trained on a large dataset containing 15T tokens (compared to 2T for Llama 2). Theseus] " prefer to operate when queries exceed 100TBs" 😅 Polars new benchmarks — Polars released new benchmarks about the TPC-H dataset. Llama has a larger tokeniser and the context window grew to 8192 tokens as input.

MySQL 130

MySQL Data Datasets SQL 130

KDnuggets

SEPTEMBER 13, 2019

I am a Git god, why do I need another version control system for Machine Learning Projects?

Machine Learning 110

Machine Learning Datasets Data Science Project 110

Analytics Vidhya

JUNE 12, 2023

Tajinder’s passion for unraveling hidden patterns in complex datasets has driven impactful outcomes, transforming raw data into actionable intelligence. Introduction Meet Tajinder, a seasoned Senior Data Scientist and ML Engineer who has excelled in the rapidly evolving field of data science.

Machine Learning 228

Machine Learning Engineering Raw Data Data Science 228

Knowledge Hut

APRIL 23, 2024

It involves processing and analyzing massive datasets that cannot be managed with traditional data processing techniques. It involves working with datasets that can be managed using standard hardware and software without the need for complex infrastructure.

Big Data 52

Big Data Datasets Data Analysis Media 52

Knowledge Hut

FEBRUARY 29, 2024

Then, based on this information from the sample, defect or abnormality the rate for whole dataset is considered. Hypothesis testing is a part of inferential statistics which uses data from a sample to analyze results about whole dataset or population. While using Amazon SageMaker datasets are quick to access and load.

Data Science 98

Data Science Datasets Database Design Machine Learning 98