article thumbnail

Which IDEs do software engineers love, and why?

The Pragmatic Engineer

It’s been nearly 6 months since our research into which AI tools software engineers use, in the mini-series, AI tooling for software engineers: reality check. With that, let’s look at the most popular IDE startups, and why engineers prefer them over established tools like VS Code.

article thumbnail

Builder.ai did not “fake AI with 700 engineers”

The Pragmatic Engineer

Originally published in The Pragmatic Engineer Newsletter. last week, was that the company faked AI with 700 engineers in India: “Microsoft-backed AI startup chatbots revealed to be human employees” – Mashable “Builder.ai Most engineers were based in the UK, with around 3 in India. Source: Builder.ai

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

The Data Engineering Toolkit: Infrastructure, DevOps, and Beyond

Simon Späti

I’d argue that today’s data engineers face similar challenges, but with the added complexity of infrastructure setup. Remember when data scientists spent 80% of their time wrestling with data wrangling instead of building models?

article thumbnail

Top 11 GenAI Powered Data Engineering Tools to Follow in 2025

Analytics Vidhya

What will data engineering look like in 2025? How will generative AI shape the tools and processes Data Engineers rely on today? As the field evolves, Data Engineers are stepping into a future where innovation and efficiency take center stage.

article thumbnail

The Ultimate Guide to Apache Airflow DAGS

With Airflow being the open-source standard for workflow orchestration, knowing how to write Airflow DAGs has become an essential skill for every data engineer. This eBook provides a comprehensive overview of DAG writing features with plenty of example code.

article thumbnail

Love and hate - Excel files and data engineers

Waitingforcode

Even though data engineers enjoy discussing table file formats, distributed data processing, or more recently, small data, they still need to deal with legacy systems. Despite being challenging for data engineers, these formats remain popular among business users.

article thumbnail

On time with data engineering systems - timeline of the data

Waitingforcode

To make it real, data engineers have to be careful about the transformations they make before exposing the dataset to consumers, but they also need to understand the timeline of the data. Timely and accurate data is a Holy Grail for each data practitioner.

article thumbnail

Airflow Best Practices for ETL/ELT Pipelines

Speaker: Kenten Danas, Senior Manager, Developer Relations

ETL and ELT are some of the most common data engineering use cases, but can come with challenges like scaling, connectivity to other systems, and dynamically adapting to changing data sources. Airflow is specifically designed for moving and transforming data in ETL/ELT pipelines, and new features in Airflow 3.0

article thumbnail

A Guide to Debugging Apache Airflow® DAGs

As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. In Airflow, DAGs (your data pipelines) support nearly every use case. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs.

article thumbnail

Apache Airflow® 101 Essential Tips for Beginners

Due to its widespread adoption, Airflow knowledge is paramount to success in the field of data engineering. It is a versatile tool used in companies across the world from agile startups to tech giants to flagship enterprises across all industries.

article thumbnail

Agent Tooling: Connecting AI to Your Tools, Systems & Data

Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage

As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward. There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data.

article thumbnail

Generative AI Deep Dive: Advancing from Proof of Concept to Production

Speaker: Maher Hanafi, VP of Engineering at Betterworks & Tony Karrer, CTO at Aggregage

💡 This new webinar featuring Maher Hanafi, VP of Engineering at Betterworks, will explore a practical framework to transform Generative AI prototypes into impactful products! There's no question that it is challenging to figure out where to focus and how to advance when it’s a new field that is evolving everyday.

article thumbnail

Improving the Accuracy of Generative AI Systems: A Structured Approach

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

Using this case study, he'll also take us through his systematic approach of iterative cycles of human feedback, engineering, and measuring performance. . 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

article thumbnail

LLMs in Production: Tooling, Process, and Team Structure

Speaker: Dr. Greg Loughnane and Chris Alexiuk

Greg Loughnane and Chris Alexiuk in this exciting webinar to learn all about: How to design and implement production-ready systems with guardrails, active monitoring of key evaluation metrics beyond latency and token count, managing prompts, and understanding the process for continuous improvement Best practices for setting up the proper mix of open- (..)

article thumbnail

Monetizing Analytics Features: Why Data Visualizations Will Never Be Enough

Think your customers will pay more for data visualizations in your application? Five years ago they may have. But today, dashboards and visualizations have become table stakes. Discover which features will differentiate your application and maximize the ROI of your embedded analytics. Brought to you by Logi Analytics.