Medium Data Engineering

AUGUST 9, 2023

What’s with Data Storage Continue reading on Medium »

Data Storage 52

Data Storage Database Data Data Engineering 52

Medium Data Engineering

MAY 3, 2023

Data is an essential asset for businesses of all sizes. Here is an explanation of the 5 main data storage types and when to use each one … Continue reading on Medium »

Data Storage 52

Data Storage Data Cloud Computing Data Engineering 52

Medium Data Engineering

OCTOBER 3, 2023

In the digital age, data is the lifeblood of modern businesses and organizations. The ability to efficiently and securely store, manage… Continue reading on Medium »

Data Storage 52

Data Storage Data Engineering Data Engineer AWS 52

Medium Data Engineering

MARCH 19, 2023

Today’s digital world is all about data. Every day, businesses produce enormous volumes of data, making efficient data storage solutions… Continue reading on Medium »

Data Storage 40

Data Storage Data Engineering Data Engineer Data 40

Medium Data Engineering

NOVEMBER 27, 2023

· A Data Warehouse is like a central storage space where data from different sources is stored in an organized and structured format.     ·… Continue reading on Medium »

Data Warehouse 52

Data Warehouse Data Lake Data Data Storage 52

Monte Carlo

AUGUST 15, 2023

Imagine you’ve been building houses with a hammer and nails for most of your career, and I gave you a nail gun. But instead of pressing it to the wood and pulling the trigger, you turn it sideways and hit the nail with the gun as if it were a hammer.

Data Storage 88

Data Storage Cloud Data Metadata 88

Medium Data Engineering

AUGUST 5, 2023

Hey there, data lovers! I’m thrilled to kick off my blogging adventure by diving deep into the world of data lakes and data warehouses… Continue reading on Medium »

Data Storage 52

Data Storage Data Lake Data Warehouse Data 52

Analytics Vidhya

FEBRUARY 27, 2023

Due to its lack of POSIX conformance, some believe it to be data storage instead. Introduction The Hadoop Distributed File System (HDFS) is a Java-based file system that is Distributed, Scalable, and Portable. HDFS and […] The post Top 10 Hadoop Interview Questions You Must Know appeared first on Analytics Vidhya.

Hadoop 234

Hadoop Java Data Storage Systems 234

Medium Data Engineering

AUGUST 31, 2023

Strategies for Storing DataFrames and Leveraging Spark Tables Continue reading on Medium »

Data Storage 52

Data Storage Data Data Engineering Data Engineer 52

Analytics Vidhya

MARCH 7, 2023

Introduction Apache Flume is a tool/service/data ingestion mechanism for gathering, aggregating, and delivering huge amounts of streaming data from diverse sources, such as log files, events, and so on, to centralized data storage. Flume is a tool that is very dependable, distributed, and customizable.

Data Ingestion 217

Data Ingestion Data Storage Data Hadoop 217

Medium Data Engineering

JULY 10, 2023

So many to choose from… Databases, Data Warehouses, Data Lakes, Delta Lakes Continue reading on Data Engineer Things »

Data Storage 40

Data Storage Data Lake Data Data Warehouse 40

Analytics Vidhya

FEBRUARY 2, 2023

Introduction In this constantly growing era, the volume of data is increasing rapidly, and tons of data points are produced every second. Now, businesses are looking for different types of data storage to store and manage their data effectively.

Data Lake 203

Data Lake Data Warehouse Data Data Storage 203

KDnuggets

OCTOBER 30, 2023

A comparative overview of data warehouses, data lakes, and data marts to help you make informed decisions on data storage solutions for your data architecture.

Data Lake 108

Data Lake Data Warehouse Data Data Storage 108

Medium Data Engineering

AUGUST 20, 2023

Greetings, data enthusiasts! 🚀 As we continue our data journey, it’s crucial to have a pit stop and discuss where our cleaned and… Continue reading on Medium »

Data Storage 52

Data Storage Data Python Data Engineering 52

Data Engineering Podcast

JUNE 3, 2018

How does the underlying engine store the data to allow for the different ways of viewing it? What are some of the benefits of multi-model data storage? For users who are accustomed to a relational engine, how do they need to adjust their approach to data modeling when working with Arango? How is ArangoDB constructed?

Data Storage 100

Data Storage PostgreSQL Data Database 100

Medium Data Engineering

MAY 7, 2023

Lost in Cloud Storage Options? Let’s Find Your Way Through the Cloud Jungle! Continue reading on Medium »

Data Storage 59

Data Storage Cloud Storage Cloud Data 59

Medium Data Engineering

AUGUST 18, 2023

When running a data science company, particularly one that crafts machine learning models for clients, choosing the right storage solution… Continue reading on Medium »

Machine Learning 52

Machine Learning Data Storage Data Data Science 52

KDnuggets

FEBRUARY 15, 2022

From Oracle, to NoSQL databases, and beyond, read about data management solutions from the early days of the RBDMS to those supporting AI applications.

Database 96

Database Data Storage NoSQL Data 96

Medium Data Engineering

MAY 4, 2023

Data is one of the most important assets for any organization, and storing it properly is essential for effective data management. There… Continue reading on brainwinds »

Data Storage 52

Data Storage Data Data Management Management 52

Medium Data Engineering

APRIL 24, 2023

Data warehousing is the process of collecting, storing, and managing data from multiple sources in a single location for efficient… Continue reading on Medium »

Data Storage 52

Data Storage Data Systems Designing 52

KDnuggets

NOVEMBER 9, 2021

In this article we are discussing that HDF5 is one of the most popular and reliable formats for non-tabular, numerical data. This article suggests what kind of ML native data format should be to truly serve the needs of modern data scientists. But this format is not optimized for deep learning work.

Deep Learning 105

Deep Learning Data Storage Data Python 105

Medium Data Engineering

JULY 7, 2023

Hello and welcome back to our exciting journey through the world of NoSQL databases! In our previous blog post, we described the principles…

NoSQL 52

NoSQL Database Data Storage Big Data 52

Medium Data Engineering

MARCH 22, 2023

Karpathy’s data engine concept is a data management strategy designed to simplify the process of working with large and complex datasets… Continue reading on Medium »

Machine Learning 52

Machine Learning Data Storage Data Data Engineering 52

Medium Data Engineering

MARCH 17, 2023

In the world of data engineering, different processes and methodologies are used to transform raw data into valuable information and store… Continue reading on Medium »

Data Engineering 40

Data Engineering Data Engineer Data Storage Engineering 40

Medium Data Engineering

MAY 10, 2023

Designing Data-Intensive Applications, Martin Kleppmann, 2017- A Review Continue reading on Medium »

Data Storage 52

Data Storage Data Designing Relational Database 52

Medium Data Engineering

JUNE 10, 2023

Introduction Continue reading on Medium »

Data Storage 52

Data Storage Data Data Analysis Data Engineering 52

Medium Data Engineering

NOVEMBER 18, 2023

In this blog, I am going to talk about data storage in data science pipelines or big data pipelines. How we make use of it  What are Data… Continue reading on Medium »

Data Lake 52

Data Lake Data Warehouse Data Data Pipeline 52

Medium Data Engineering

NOVEMBER 16, 2023

MongoDB is a popular NoSQL database that allows for flexible and scalable data storage. In this guide, we’ll explore how to interact with… Continue reading on Level Up Coding »

MongoDB 52

MongoDB NoSQL Python Data Storage 52

Medium Data Engineering

AUGUST 25, 2023

Introduction: In the era of data-driven decision-making, time series data has emerged as a critical asset for businesses across various… Continue reading on Medium »

Data Storage 40

Data Storage Data Data Engineering Data Engineer 40

Medium Data Engineering

NOVEMBER 10, 2023

Performing market data analysis requires a data storage equipped with features to handle the complexities of financial information. Time… Continue reading on Medium »

Data Analysis 52

Data Analysis Data Storage Data Data Architecture 52

Medium Data Engineering

APRIL 18, 2023

Diving into the data waters. Continue reading on Medium »

Data Lake 52

Data Lake Data Warehouse Data Storage Data 52

Seattle Data Guy

DECEMBER 19, 2022

Whether its helping increase revenue by finding new customers or reducing costs, all of it starts with data.

Data Lake 130

Data Lake Data Warehouse Database Data 130

Hevo

AUGUST 17, 2023

Businesses often rely on multiple data storage and processing services to meet their diverse requirements. Google Sheets and Azure Synapse are well-known choices used for storing data. While Google Sheets offer a cost-effective data storage facility, Azure Synapse provides data warehousing and advanced analytics capabilities.

Data Storage 52

Data Storage Data Process Data Integration 52

Start Data Engineering

OCTOBER 22, 2021

Data modeling 2.1.1. Data storage 2.2. Data transformation 2.2.1. Data pipeline 2.4. Data analytics 3. Introduction 2. SQL skills 2.1. Gathering requirements 2.1.2. Exploration 2.1.3. Modeling 2.1.4. Transformation types 2.2.1.1. Narrow transformations 2.2.1.2. Wide transformations 2.2.2. Practice 4.

SQL 130

SQL Data Engineering Data Engineer Engineering 130

Medium Data Engineering

JUNE 11, 2023

Discover the latest trends in big data technology and explore solutions for data scheduling, data lake construction, and data storage… Continue reading on Medium »

Big Data 52

Big Data Data Lake Data Storage Data 52

Medium Data Engineering

OCTOBER 15, 2023

In the world of data engineering, SQL (Structured Query Language) is a fundamental tool. It’s the bridge that connects data storage and… Continue reading on Medium »

Data Engineering 52

Data Engineering Data Engineer SQL Engineering 52

Medium Data Engineering

FEBRUARY 15, 2023

Concepts, theory, and functionalities of this modern data storage framework Continue reading on Towards Data Science »

Data Storage 98

Data Storage Data Science Data Data Lake 98