ArcGIS

SEPTEMBER 19, 2023

In collaboration with NOAA, we used the Presence-Only Prediction (Maxent) tool to predict snow crab habitat under changing climate conditions.

Machine Learning 129

Machine Learning 129

KDnuggets

SEPTEMBER 19, 2023

Explore the unsupervised learning paradigm. Familiarize yourself with the key concepts, techniques, and popular unsupervised learning algorithms.

Algorithm 108

Algorithm Machine Learning 108

databricks

SEPTEMBER 19, 2023

“Supply chains compete, not companies” — Martin Christopher No two supply chains are identical - the unique combination of products, industries, and geographic locat.

Manufacturing 98

Manufacturing 98

KDnuggets

SEPTEMBER 19, 2023

Complete the last quarter of the year and improve your skills to get you kickstarted for 2024’s self-development plan with these FREE courses.

Data Science 99

Data Science Data 99

Advertisement

Generative AI is upending the way product developers & end-users alike are interacting with data. Despite the potential of AI, many are left with questions about the future of product development: How will AI impact my business and contribute to its success? What can product managers and developers expect in the future with the widespread adoption of AI?

Data

Snowflake

SEPTEMBER 19, 2023

Why AI has everyone’s attention, what it means for different data roles, and how Alteryx and Snowflake are bringing AI to data use cases There’s a llama on the loose! Well, more specifically, LLaMA (Large Language Model Meta AI), along with other large language models (LLMs) that have suddenly become more open and accessible for everyday applications.

Machine Learning 90

Machine Learning Unstructured Data Data Analytics Government 90

Cloudera

SEPTEMBER 19, 2023

Perhaps your C-suite is already a bit crowded. The typical hierarchy will include a CEO, COO, CFO, CTO, CMO, CIO, and a few more. Adding another position may not be terribly appealing, but there is one C-suite role every company should consider—chief data and analytics officer (CDO or CDAO). The CDO is the point person for your data strategy: the leader who oversees how data is collected, managed, and put to use to improve the organization; the person who ensures that wherever there are opportun

IT 74

IT Data Governance Data Architecture Government 74

KDnuggets

SEPTEMBER 19, 2023

Cracking the code of activation functions: Demystifying their purpose, selection, and timing.

Coding 93

Coding Machine Learning 93

Confluent

SEPTEMBER 19, 2023

Discover the top 5 best practices for building event-driven architectures using Confluent and AWS Lambda. Learn how to optimize your architecture for scalability, reliability, and performance.

AWS 67

AWS Architecture Building 67

Rockset

SEPTEMBER 19, 2023

As a search and analytics database, Rockset powers many personalization, anomaly detection, AI, and vector applications that need fast queries on real-time data. Rockset maintains inverted indexes for data, enabling it to efficiently run search queries without scanning over all of the data. We also maintain column stores that allow efficient analytic queries.

Utilities 59

Utilities Database Accessible Accessibility 59

Scott Logic

SEPTEMBER 19, 2023

This year I’m attending the Linux Foundation Europe Summit, a sizable event bringing together 1,000s of people involved in open source. I typically take extensive notes of the sessions I attend, so thought I’d share them here on our blog. It’s only day one, but I’ve already attended some fascinating sessions including OSPOs, SBOM security, the legal implications of AI and blockchain.

Coding 59

Coding Architecture Datasets Python 59

Advertisement

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

Database

Confluent

SEPTEMBER 19, 2023

Learn how a grocery delivery company guarantees same day delivery with Confluent as the backbone of their data streaming infrastructure.

Cloud 62

Cloud Data 62

Cloudyard

SEPTEMBER 19, 2023

Read Time: 2 Minute, 55 Second In this post, we will explore the process of splitting a large file into smaller ones based on the data count. Recently, we encountered a file in our Blob storage area that contained approximately 20 million records. The client’s requirement is to process this file in Snowflake. While it’s possible to process this file as-is in Snowflake using the COPY command, it’s important to note that doing so may lead to performance issues due to the fileR

AWS 52

AWS Utilities Process Accessible 52

Monte Carlo

SEPTEMBER 19, 2023

Has your data been looking a little grimy lately? Data quality issues marring its once lustrous shine? Well, before you throw out that dirty dataset, why not try to assess and improve its quality with PySpark data quality checks? PySpark is the Python API used for Apache Spark , but you don’t need to have your data stored in Spark to use PySpark data quality checks.

Datasets 52

Datasets Data Python Coding 52

phData: Data Engineering

SEPTEMBER 19, 2023

With the amount of data companies are using growing to unprecedented levels, organizations are grappling with the challenge of efficiently managing and deriving insights from these vast volumes of structured and unstructured data. Data lakes have emerged as a popular solution, offering the flexibility to store and analyze diverse data types in their raw format.

Data Lake 52

Data Lake Process Metadata Data Warehouse 52

Advertisement

Start-ups & SMBs launching products quickly must bundle dashboards, reports, & self-service analytics into apps. Customers expect rapid value from your product (time-to-value), data security, and access to advanced capabilities. Traditional Business Intelligence (BI) tools can provide valuable data analysis capabilities, but they have a barrier to entry that can stop small and midsize businesses from capitalizing on them.

Data Analysis

Monte Carlo

SEPTEMBER 19, 2023

Sponsored by Snowflake , Databricks , Omni , and Workstream.io. The data space is evolving at break-neck speed, and IMPACT: The Data Observability Summit is returning to bring clarity to the chaos. That’s right, data leaders! IMPACT will return for its third year on November 8, 2023 , and this time we’re bringing together data and AI leaders from inside and outside the space to share their perspectives.

Insurance 52

Insurance Software Engineer Software Engineering Data 52

AltexSoft

SEPTEMBER 19, 2023

In the continuously changing travel industry, data-driven insights are revolutionizing decision-making processes. Beyond its fundamental role in elevating customer experience, travel analytics has a valuable impact on revenue growth and cultivating a competitive edge. This article explores the influence of analytics on marketing strategies, revenue management, guest personalization, and other aspects of the travel industry.

Hospitality 52

Hospitality Machine Learning Data Governance BI 52

Acceldata

SEPTEMBER 19, 2023

Learn how data engineering professionals can leverage innovations in AI, but also how they must ensure data reliability and data quality in order for AI to work effectively.

Data Engineering 40

Data Engineering Data Engineer Engineering Data 40

The Pragmatic Engineer

SEPTEMBER 19, 2023

👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. In every issue, I cover topics related to Big Tech and startups through the lens of engineering managers and senior engineers. In this article, we cover one out of seven topics from today’s subscriber-only issue on How Big Tech does QA. To get full issues twice a week, subscribe here.

Software Engineer 285

Software Engineer Software Engineering Coding Engineering 285

Speaker: Scott Sehlhorst

We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.

Certification

Rock the JVM

SEPTEMBER 19, 2023

By Riccardo Cardin It’s time to end our journey on functional error handling in Kotlin with the new features introduced by the Arrow library in version 1.2.0, which previews the significant rewrite we’ll have in version 2.0.0. We’ll mainly focus on the Raise DSL, a new way to handle typed errors using Kotlin contexts. This article is part of a series.

Software Engineer 68

Software Engineer Software Engineering Database Coding 68

DoorDash Engineering

SEPTEMBER 19, 2023

As a tech company, it’s our products and platform – and the engineers that build them – that power what DoorDash is able to offer our Consumers, Dashers, and Merchants every day. We thrive on tackling challenging technical problems and creating opportunities for customers, and take a lot of pride in what we do (and, as regular readers know, periodically share details about our work on this blog).

Engineering 88

Engineering Recruitment Certification Data Analysis 88

Data Science Blog: Data Engineering

SEPTEMBER 19, 2023

In the contemporary age of Big Data, Data Warehouse Systems and Data Science Analytics Infrastructures have become an essential component for organizations to store, analyze, and make data-driven decisions. With the evolution of cloud computing, many organizations are now migrating their Data Warehouse Systems to the cloud for better scalability, flexibility, and cost-efficiency.

Data Warehouse 52

Data Warehouse Coding Systems Cloud 52

DoorDash Engineering

SEPTEMBER 19, 2023

As an Engineering org, we are tremendously proud of our accomplishments throughout the history of DoorDash, particularly in recent years as we’ve grown and scaled in service of our customers. This success has been heavily influenced by the strength and leadership of our Eng management team; great companies are built by great people who have great managers.

Management 81

Management Engineering Programming Technology 81

Advertisement

While data platforms, artificial intelligence (AI), machine learning (ML), and programming platforms have evolved to leverage big data and streaming data, the front-end user experience has not kept up. Holding onto old BI technology while everything else moves forward is holding back organizations. Traditional Business Intelligence (BI) aren’t built for modern data platforms and don’t work on modern architectures.

BI

Ascend.io

SEPTEMBER 19, 2023

In the world of data engineering, the ETL (Extract, Transform, Load) approach has been the cornerstone for managing and processing data. However , the traditional methods of executing ETL are increasingly struggling to meet the escalating demands of today’s data-intensive environments. This growing disconnect between the scale of data and the capability of traditional ETL methods has brought forth the emergence of automated ETL pipelines: automation to supercharge the ETL processes.

ETL Tools 52

ETL Tools ETL Method Utilities Data Engineering 52

Scott Logic

SEPTEMBER 19, 2023

When striving for robust code quality, efficient testing is non-negotiable. Logging metrics from your test suite can provide valuable insights into the performance and reliability of your codebase. In this blog post, we’ll explore a resourceful method to log metrics effectively in Jest test suites using the metricsCollector module. This approach not only keeps your codebase clean and efficient but also allows you to seamlessly incorporate metrics recording into your testing process.

Utilities 52

Utilities Coding Management Data Process 52