The Pragmatic Engineer

MAY 16, 2023

There are a growing number of AI coding tools that are alternatives to Copilot. A list of other popular, promising options.

Coding 306

Coding Computer Science Machine Learning Technology 306

Analytics Vidhya

MAY 17, 2023

How can we sift through many variables to identify the most influential factors for accurate predictions in machine learning? Recursive Feature Elimination offers a compelling solution, and RFE iteratively removes less important features, creating a subset that maximizes predictive accuracy. By leveraging a machine learning algorithm and an importance-ranking metric, RFE evaluates each feature’s impact […] The post Recursive Feature Elimination: Working, Advantages & Examples ap

Machine Learning 174

Machine Learning Algorithm Data Analysis Big Data 174

Christophe Blefari

MAY 19, 2023

TWO YEARS — HAPPY BIRTHDAY 👋 Here is a special edition for me. Exactly 2 years ago, I sent out my first email newsletter. At the time, only 3 people received it. I already told the story in Robin's podcast , here is a written version. In 2021, I was doing Twitch lives twice a week, every Wednesday I was doing a data news round-up.

Data 130

Data Data Engineering Data Engineer Hadoop 130

Waitingforcode

MAY 17, 2023

Finally, the time has come to start the analysis of the new features in Apache Spark. The first of them that grabbed my attention was the Async progress tracking from Structured Streaming.

130

130

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

Data Science

KDnuggets

MAY 16, 2023

AutoGPT has taken the world by storm and has even surpassed ChatGPT itself. So, get ready to dive into the exciting world of Auto-GPT.

Process 151

Process 151

Confluent

MAY 15, 2023

Take a tour of the internals of Confluent’s Apache Kafka® service, powered by Kora: the next-generation, cloud-native streaming engine.Kora.

Kafka 145

Kafka Cloud Engineering 145

Netflix Tech

MAY 19, 2023

Tycho Andersen The Compute team at Netflix is charged with managing all AWS and containerized workloads at Netflix, including autoscaling, deployment of containers, issue remediation, etc. As part of this team, I work on fixing strange things that users report. This particular issue involved a custom internal FUSE filesystem : ndrive. It had been festering for some time, but needed someone to sit down and look at it in anger.

Transportation 111

Transportation Coding Process AWS 111

KDnuggets

MAY 18, 2023

This article discusses the key components that contribute to the successful scaling of data science projects. It covers how to collect data using APIs, how to store data in the cloud, how to clean and process data, how to visualize data, and how to harness the power of data visualization through interactive dashboards.

Cloud Computing 115

Cloud Computing Data Science Cloud Project 115

Data Engineering Weekly

MAY 16, 2023

In the first part of this series, we talked about design patterns for data creation and the pros & cons of each system from the data contract perspective. In the second part, we will focus on architectural patterns to implement data quality from a data contract perspective. Why is Data Quality Expensive? I posted this LinkedIn post that sparked some exciting conversation.

Engineering 110

Engineering Kafka Data Pipeline Data Warehouse 110

databricks

MAY 18, 2023

Today, we are thrilled to announce that serverless compute for Databricks SQL is Generally Available on AWS and Azure! Databricks SQL (DB SQL).

SQL 120

SQL AWS 120

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

Engineering

Hevo

MAY 16, 2023

As the volume of data that businesses collect today increases, the need for tools that can help manage this data also increases. One of the most significant requirements of businesses for managing data is a tool that can seamlessly replicate the high volume of data that has been collected.

Data 97

Data Management Data Warehouse Data Integration 97

KDnuggets

MAY 16, 2023

In today's highly competitive job market, practitioners need every advantage they can get to stand out from the crowd and accelerate in their roles as a high-performing employee. With that in mind, here are 5 reasons why you should earn a SAS certification, and stand out to employers.

Certification 113

Certification 113

ArcGIS

MAY 17, 2023

Learn how to produce a monthly elevation dataset for the Greenland Ice Sheet using Trajectory Dataset

Datasets 119

Datasets Data 119

databricks

MAY 16, 2023

The Databricks Lakehouse Platform provides a unified set of tools for building, deploying, sharing, and maintaining enterprise-grade data solutions at scale. Databricks integrates.

Data Solutions 95

Data Solutions Data Building 95

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

Building

Cloudera

MAY 17, 2023

During Women’s History Month, Cloudera hosted a fantastic fireside chat featuring Irma Laxamana, Chief Legal Officer for Cloudera, and Cloudera’s CHRO, Amy Nelson. The discussion was wide-ranging from reflecting on career lessons learned, to advice on navigating the workplace. Below are the highlights of the chat. About Irma Laxamana Irma is the Chief Legal Officer at Cloudera leading a global team of lawyers and legal professionals supporting all areas of the business.

Building 86

Building Technology IT Systems 86

KDnuggets

MAY 15, 2023

Mojo Lang: The New Programming Language • Stop Doing this on ChatGPT and Get Ahead of the 99% of its Users • 3 Ways to Access GPT-4 for Free • 8 Open-Source Alternative to ChatGPT and Bard • Exploratory Data Analysis Techniques for Unstructured Data

Programming Language 108

Programming Language Programming Unstructured Data Data Analysis 108

ArcGIS

MAY 18, 2023

Part 1 - explains why personal geodatabases are not supported within ArcGIS Pro and begins the quest to migrate data to a mobile geodatabase.

Data 98

Data Data Management Management 98

databricks

MAY 15, 2023

Apache Spark Structured Streaming is the leading open source stream processing platform. It is also the core technology that powers streaming on the.

Technology 99

Technology Process IT Engineering 99

Advertisement

Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.

Project

Workfall

MAY 16, 2023

Reading Time: 5 minutes When Rust compiles code, you get an executable if you created the application using the --bin command. In this blog, we shall look at how we can create a Dockerfile to create an image with this executable. We shall then deploy this image on EC2 using GitHub Actions which will be set on our repository [link] which also has the source code for our web application.

AWS 81

AWS Cloud Computing Coding Cloud 81

KDnuggets

MAY 15, 2023

The road to simpler Data Analysis for data scientists and analysts, powered by OpenAI.

Python 147

Python Data Analysis Data 147

ArcGIS

MAY 18, 2023

This second blog in a series explains how ArcGIS Pro can be used to create an OLE DB connection to a.mdb,accdb, and a MySQL database.

MySQL 97

MySQL Database Data Accessible 97

databricks

MAY 15, 2023

We recently announced our partnership with Databricks to bring multi-cloud data clean room collaboration capabilities to every Lakehouse. Our integration with Databricks combines.

Cloud 76

Cloud Data Entertainment Media 76

Speaker: Margaret-Ann Seger, Head of Product, Statsig

Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating

Building

Snowflake

MAY 18, 2023

Welcome to Snowflake’s Startup Spotlight, where we learn about innovative companies building businesses on Snowflake. In this edition, we’ll hear from Pipedream Co-Founder Dylan Sather about what it takes to build integrations right and how an engaged community becomes a powerful resource. Tell us about yourself. I’m Dylan Sather, co-founder and Software Engineer at Pipedream.

Finance 72

Finance Building SQL Python 72

KDnuggets

MAY 15, 2023

Transitioning your career to DataOps could be just the change you need - not only will it provide the possibility to expand your technical skills, but also a rewarding salary with many job openings.

IT 104

IT Data Engineering Data Engineer Engineering 104

ArcGIS

MAY 17, 2023

This blog shows how to improve your QA/QC workflows in a branch versioning setting by making use of the version properties.

Data 90

Data Data Management Management 90

databricks

MAY 17, 2023

Today, we are excited to announce the general availability of the Variable Explorer for Python in the Databricks Notebook. The Variable Explorer allows.

Python 84

Python 84

Speaker: David Bard, Principal at VP Product Coaching

In the fast-paced world of digital innovation, success is often accompanied by a multitude of challenges - like the pitfalls lurking at every turn, threatening to derail the most promising projects. But fret not, this webinar is your key to effective product development! Join us for an enlightening session to empower you to lead your team to greater heights.

Certification

Towards Data Science

MAY 15, 2023

Programmatically list all datasets and tables using BigQuery API and Python Continue reading on Towards Data Science »

Datasets 88

Datasets Python Data Science Google Cloud 88

KDnuggets

MAY 17, 2023

In this article, I will give you a brief introduction to anomaly detection and I will guide you through the different techniques that you can use to identify anomalies.

Data Science 105

Data Science Data 105

Monte Carlo

MAY 18, 2023

Data lineage tools are like detectives that help data professionals quickly sort through the tangled webs of interdependencies that make up the modern data stack. Whether you’re a data scientist, data engineer, or business analyst, keeping track of your data’s origin, transformation, and movement is crucial for maintaining transparency, enforcing data governance, and ensuring data quality.

Metadata 64

Metadata Data Lake Government Data Governance 64

databricks

MAY 15, 2023

This solution accelerator and blog were created in collaboration with Schneider Electric. We'd like to thank Dan Sabin, a Schneider Electric Distinguished Technical.

Manufacturing 76

Manufacturing 76

Advertisement

“Reimagined: Building Products with Generative AI” is an extensive guide for integrating generative AI into product strategy and careers featuring over 150 real-world examples, 30 case studies, and 20+ frameworks, and endorsed by over 20 leading AI and product executives, inventors, entrepreneurs, and researchers.

Building