Waitingforcode

JUNE 9, 2023

It's time for another part of "What's new on the cloud for data engineers" Let's see what happened in the last 3 months.

Data Engineering 130

Data Engineering Data Engineer Cloud Engineering 130

Waitingforcode

MARCH 20, 2023

Have you missed any cloud data engineering-related news in the last 3 months? No worries, I got you covered with the new part of the "What's new on the cloud for data engineers."

Data Engineering 130

Data Engineering Data Engineer Cloud Engineering 130

Waitingforcode

JUNE 15, 2023

Spark Connect is probably the most expected feature in Apache Spark 3.4.0. It was announced in the Data+AI Summit 2022 keynotes and has a lot of coverage in social media right now. I'll try to add my small contribution to this by showing some implementation details.

Media 130

Media IT Data 130

Waitingforcode

MAY 24, 2023

Apache Spark is infamous for its correctness issue for chained stateful operations. Fortunately things get improved in each release. The most recent one, the 3.4.0, also got some important changes on that field!

IT 130

IT 130

Waitingforcode

MAY 17, 2023

Finally, the time has come to start the analysis of the new features in Apache Spark. The first of them that grabbed my attention was the Async progress tracking from Structured Streaming.

130

130

Waitingforcode

FEBRUARY 3, 2023

As you can guess from the title, it's time to see what changed recently on the cloud from a data engineering perspective! Four months in cloud history is a huge period of time. Even when 2 of the 4 months are the usual "holiday" months.

Data Engineering 130

Data Engineering Data Engineer Cloud Engineering 130

Cloudera

JUNE 7, 2021

Now we are releasing a new version of our product that takes the user experience, technical capabilities, and platform integration to the next level. The post What is new in Cloudera Streaming Analytics 1.4? Feature Highlights. Flink SQL DDL and Catalog support. appeared first on Cloudera Blog.

Kafka 100

Kafka SQL Accessible Accessibility 100

Confluent

SEPTEMBER 21, 2021

I’m pleased to announce the release of Apache Kafka 3.0 on behalf of the Apache Kafka® community. Apache Kafka 3.0 is a major release in more ways than one. Apache […].

Kafka 145

Kafka 145

ArcGIS

NOVEMBER 3, 2023

The November release of ArcGIS Knowledge introduces provenance, the new ArcGIS Knowledge Studio web application in beta, and more.

64

64

Confluent

APRIL 19, 2021

release contains many new features and improvements. I’m proud to announce the release of Apache Kafka 2.8.0 on behalf of the Apache Kafka® community. This blog post highlights […].

Kafka 138

Kafka 138

Waitingforcode

FEBRUARY 3, 2023

It's the last update on the data engineering news on the cloud this year. There are a lot of things coming out. Especially for the streaming processing!

Data Engineering 100

Data Engineering Data Engineer Cloud Engineering 100

databricks

MAY 2, 2023

We are excited to announce that we will be releasing a new UI that will make it easier for you to navigate Databricks.

IT 82

IT 82

KDnuggets

MARCH 19, 2020

I’ll review the evidence, discuss the other strategies and their consequences, and then discuss what can be done. Furthermore, this appears to be a radically superior strategy where it can be deployed.

IT 141

IT 141

Preset

MAY 7, 2023

Learn about new features available in Preset!

52

52

Preset

FEBRUARY 5, 2023

Learn about new features available in Preset!

52

52

Confluent

NOVEMBER 6, 2020

Today, the ability to capture and harness the value of data in real time is critical for businesses to remain competitive in a data-driven world. Apache Kafka®, a scalable, open-source, […].

Cloud 52

Cloud Kafka Project Data 52

Data Engineering Weekly

JULY 5, 2023

On DEW #132, we selected the following article Cowboy Ventures: The New Generative AI Infra Stack Generative AI has taken the tech industry by storm. link] Matt Palmer: What's the hype behind DuckDB? In Q1 2023, a whopping $1.7B was invested into gen AI startups. So DuckDB, Is it hype?

Management 52

Management Data Warehouse Data Engineering Data Engineer 52

The Pragmatic Engineer

MAY 1, 2024

Subscribe to The Pragmatic Engineer to stay up-to-date on what is happening with software engineering, Big Tech, and startups. There’s been a number of news stories about “AI developers,” recently. What if it’s a well-choreographed show performed out of necessity? My take is a little different.

Software Engineer 181

Software Engineer Software Engineering Programming Language Media 181

The Pragmatic Engineer

MARCH 19, 2024

The company says: “Devin is the new state-of-the-art on the SWE-Bench coding benchmark, has successfully passed practical engineering interviews from leading AI companies, and has even completed real jobs on Upwork. What if it’s a well-choreographed show performed out of necessity? My take is a little different.

Software Engineer 258

Software Engineer Software Engineering Programming Language Media 258

KDnuggets

DECEMBER 27, 2019

What is a Data Scientist Worth?; Google's New Explainable AI Service; The Most In Demand Tech Skills for Data Scientists; The 4 fastest ways NOT to get hired as a data scientist; and KDnuggets Cartoon which was included in a surprising textbook.

Data 46

Data Data Science 46

KDnuggets

AUGUST 27, 2019

Recently, AI researchers from IBM open sourced AI Explainability 360, a new toolkit of state-of-the-art algorithms that support the interpretability and explainability of machine learning models.

Machine Learning 90

Machine Learning Algorithm 90

Christophe Blefari

APRIL 19, 2024

easy ( credits ) Hey, new Friday, new Data News. I'm a bit late with the Recommendations emails, I'm sorry about that I got a few new leads as a freelancer I had to take in priority changing a bit my schedule. AI News 🤖 When do models get the same hype as 2007 iPhone release?

MySQL 130

MySQL Data Datasets SQL 130

Christophe Blefari

APRIL 12, 2024

The fest we deserve ( credits ) I hope this Data News finds you well. But first I want to welcome all the new members joining this week after my new episode on DataGen with Robin Conquet. this week with a lot of new features. Mistral-8x22B is out — a new model that does something probably awesome.

BI 130

BI SQL Data Coding 130

Christophe Blefari

APRIL 5, 2024

Lost between ideas ( credits ) Hey, new Data News edition. Before jumping to the news, I want to let you know that I have improved the Recommendations page and the weekly emails with the recommendation should arrive soon. On my side I'll talk about Apache Superset and what you can do to build a complete application with it.

SQL 130

SQL Data Python Datasets 130

Marc Lamberti

OCTOBER 1, 2023

Well, guess what? That’s precisely what you will discover now. By the way, if you are new to Airflow, check my course here , at a special discount. It will be a nightmare to maintain and you skip what Airflow offers you. So what’s the solution? Airflow Sensors What is a Sensor? Airflow Sensors!

Data Pipeline 243

Data Pipeline SQL Algorithm Coding 243

Waitingforcode

APRIL 18, 2024

After all, sometimes you may need to release a new job package with upgraded dependencies or improved business logic. What happens then? Streaming jobs are supposed to run continuously but it applies to the data processing logic.

Data Process 130

Data Process Process IT Data 130

Christophe Blefari

MARCH 22, 2024

Reading and writing, Friday afternoon I read the articles and remove what I find irrelevant (context, values, quality, etc.), On my side I'll talk about Apache Superset and what you can do to build a complete application with it. Now give me the news. Then I opens the elements saved from LinkedIn.

Electronics 130

Electronics Media Data Python 130

The Pragmatic Engineer

FEBRUARY 29, 2024

” Payment terminals at gas stations stopped working in New Zealand. The New Zealand Herald reports : “Petrol stations around the country are up and running again following a day-long leap-year glitch which saw card payment machines go down for more than 10 hours. New Zealand is two hours ahead of Tasmania.

Software Engineer 206

Software Engineer Software Engineering Banking Engineering 206

KDnuggets

DECEMBER 30, 2019

Also: Let’s Build an Intelligent Chatbot; 10 Best and Free Machine Learning Courses, Online; Build Pipelines with Pandas Using pdpipe; Alternative Cloud Hosted Data Science Environments.

Machine Learning 48

Machine Learning Data Science Cloud Data 48

Knowledge Hut

MAY 1, 2024

Some people are apprehensive about the future, but the opportunities in the field of data science are improving day by day, creating new paths for people to get in and contribute their expertise/experiences. What is D a t a S cience? What would a day in the life of a D ata S cientist look like? What about the salary?

Algorithm 98

Algorithm Raw Data Computer Science Data Science 98

Knowledge Hut

APRIL 25, 2024

What is On-the-Job Training? For example, an organization provides training on-the-job for new employees to get accustomed to specific devices, tools, or equipment needed in the work field. The importance of on-the-job training for new employees is that they get a direct and unmediated experience of the work procedures.

Manufacturing 98

Manufacturing Hospitality Education Programming 98