Sat.Apr 06, 2024 - Fri.Apr 12, 2024

article thumbnail

Shutting Down My Job Board for Software Engineering Positions After 2.5 Years

The Pragmatic Engineer

I started The Pragmatic Engineer Job Board in October 2021. 2.5 years later, I am shutting it down permanently, despite a reasonable success in traction. The shutdown was triggered by my vendor – Pallet – discontinuing their job board and talent collective approach. However, I might have eventually come to the same decision myself, even without Pallet making this call.

article thumbnail

Establish A Single Source Of Truth For Your Data Consumers With A Semantic Layer

Data Engineering Podcast

Summary Maintaining a single source of truth for your data is the biggest challenge in data engineering. Different roles and tasks in the business need their own ways to access and analyze the data in the organization. In order to enable this use case, while maintaining a single point of access, the semantic layer has evolved as a technological solution to the problem.

Data Lake 162
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Databricks Doubles Cost. Reddit Explodes. I’m in Trouble!

Confessions of a Data Guy

I recently did a post on Linkedin and Reddit about Databricks removing Standard Tier and forcing folks into Unity Catalog. The post got big traction and blew up, more than I thought. Enough for the Databricks folk to hunt me down at work and tell me I’m naughty. I will be writing a more in-depth […] The post Databricks Doubles Cost. Reddit Explodes.

Data 130
article thumbnail

Data News — Week 24.15

Christophe Blefari

The fest we deserve ( credits ) I hope this Data News finds you well. In today's edition we have a large selection of links, I think you will enjoy it. But first I want to welcome all the new members joining this week after my new episode on DataGen with Robin Conquet. This is an episode in French and we talked mainly about the eventual end of the modern data stack.

BI 130
article thumbnail

The AI Superhero Approach to Product Management

Speaker: Conrado Morlan

In this engaging and witty talk, we’ll explore how artificial intelligence can transform the daily tasks of product managers into streamlined, efficient processes. Using the lens of a superhero narrative, we’ll uncover how AI can be the ultimate sidekick, aiding in decision-making, enhancing productivity, and boosting innovation. Attendees will leave with practical tools and actionable insights, motivated to embrace AI and leverage its potential in their work. 🦸 🏢 Key objectives:

article thumbnail

Weekend maintenance kicks an Italian bank offline for days

The Pragmatic Engineer

👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. In every issue, I cover topics related to Big Tech and startups through the lens of engineering managers and senior engineers. In this article, we cover one out of four topics from today’s subscriber-only The Pulse issue. To get full issues twice a week, subscribe here.

Banking 215
article thumbnail

Data enrichment strategies in Apache Flink

Waitingforcode

Data enrichment is a crucial step in making data more usable by the business users. Doing that with a batch is relatively easy due to the static nature of the dataset. When it comes to streaming, the task is more challenging.

Datasets 130

More Trending

article thumbnail

A Breakthrough AI-Powered SQL Assistant

Snowflake

Data is the lifeblood of modern businesses, but unlocking its true insights often requires complex SQL queries. These queries can be time-consuming to write and challenging to maintain. At Snowflake, we believe in making the power of data accessible to all. That’s why we prioritize simplicity, governance and quality in everything we build – including our AI-powered tools.

SQL 137
article thumbnail

How to JOIN datasets in Polars … compared to Pandas.

Confessions of a Data Guy

It’s been a while since I wrote about Polars on this blog, I’ve been remiss. Some time ago I wrote a very simple comparison of switching from Pandas to Polars, I didn’t put much real effort into it, yet it was popular, so this is my attempt at trying to expand on that topic a […] The post How to JOIN datasets in Polars … compared to Pandas. appeared first on Confessions of a Data Guy.

Datasets 113
article thumbnail

Common Pitfalls of Data Analytics Projects

Seattle Data Guy

Have you ever been part of a data or software project that seems stuck in a loop? Three weeks have passed, and although you arrive at work daily, exhausted, having tackled numerous issues, the project remains stagnant. Why? Then, suddenly, a new engineer or project manager steps in, reorganizes and prioritizes tasks, and just like… Read more The post Common Pitfalls of Data Analytics Projects appeared first on Seattle Data Guy.

article thumbnail

7 Steps to Mastering Data Engineering

KDnuggets

The only data engineering roadmap you need for an introduction to concepts, tools, and techniques to collect, store, transform, analyze, and model data.

article thumbnail

Provide Real Value in Your Applications with Data and Analytics

The complexity of financial data, the need for real-time insight, and the demand for user-friendly visualizations can seem daunting when it comes to analytics - but there is an easier way. With Logi Symphony, we aim to turn these challenges into opportunities. Our platform empowers you to seamlessly integrate advanced data analytics, generative AI, data visualization, and pixel-perfect reporting into your applications, transforming raw data into actionable insights.

article thumbnail

Snowflake Startup Challenge 2024: Announcing the 10 Semi-Finalists

Snowflake

In 2020, Snowflake announced a new global competition to recognize the work of early-stage startups building their apps — and their businesses — on Snowflake, offering up to $250,000 in investment as the top prize. Four years later, the Snowflake Startup Challenge has grown into a premiere showcase for emerging startups, garnering interest from companies in over 100 countries and offering a prize package featuring a portion of up to $1 million in potential investment opportunities and exclusive

article thumbnail

Unapologetically Technical Episode 10 – Michael Drogalis

Jesse Anderson

And just like that, we’re down to the 10th episode of Unapologetically Technical! In this episode, I interview Michael Drogalis, the founder and CEO of ShadowTraffic where we talked about the early Hadoop era and how he saw the need for Kafka in the industry. He shared his journey of starting a new company in his 20s and being acquired by Confluent.

Hadoop 100
article thumbnail

Writing Apache Spark with Rust! Spark Connect Introduced.

Confessions of a Data Guy

I never thought I would live to see the day, it’s crazy. I’m not sure who’s idea it was to make it possible to write Apache Spark with Rust, Golang, or Python … but they are all genius. As of Apache Spark 3.4 it is now possible to use Spark Connect … a thin API […] The post Writing Apache Spark with Rust! Spark Connect Introduced. appeared first on Confessions of a Data Guy.

Python 100
article thumbnail

Export Symbols and Style Items from ArcGIS Pro

ArcGIS

Starting with ArcGIS Pro 3.2, you can export all symbols in the map as style items and save them to a style in a single process.

Process 143
article thumbnail

Entity Resolution: Your Guide to Deciding Whether to Build It or Buy It

Adding high-quality entity resolution capabilities to enterprise applications, services, data fabrics or data pipelines can be daunting and expensive. Organizations often invest millions of dollars and years of effort to achieve subpar results. This guide will walk you through the requirements and challenges of implementing entity resolution. By the end, you'll understand what to look for, the most common mistakes and pitfalls to avoid, and your options.

article thumbnail

Snowflake Ventures Invests in Coda to Turn Data into Action for Business Users

Snowflake

One of our key objectives at Snowflake is to help enterprises fully unlock the value of their data, and an important aspect of that is making data both accessible and actionable to as many people as possible, regardless of their role or technical skill set. We’re announcing a new investment today that will transform how teams across the business work with data in the future.

Finance 111
article thumbnail

7 Things Students Are Missing in a Data Science Resume

KDnuggets

Adding these 7 key elements to your resume will improve your odds of getting an interview call. Remember, after graduating from the university, your full-time job is to find a job, so put some effort into preparing your resume.

article thumbnail

Bringing MegaBlocks to Databricks

databricks

At Databricks, we’re committed to building the most efficient and performant training tools for large-scale AI models. With the recent release of DBRX.

Building 118
article thumbnail

May I Borrow That Idea? – Pasting Feature Layer Properties

ArcGIS

Starting with ArcGIS Pro 3.2, you can copy layer properties from one feature layer and paste them to another.

131
131
article thumbnail

Generative AI Deep Dive: Advancing from Proof of Concept to Production

Speaker: Maher Hanafi, VP of Engineering at Betterworks & Tony Karrer, CTO at Aggregage

Executive leaders and board members are pushing their teams to adopt Generative AI to gain a competitive edge, save money, and otherwise take advantage of the promise of this new era of artificial intelligence. There's no question that it is challenging to figure out where to focus and how to advance when it’s a new field that is evolving everyday. 💡 This new webinar featuring Maher Hanafi, VP of Engineering at Betterworks, will explore a practical framework to transform Generative AI pr

article thumbnail

Project Management Organizational Structure: Types & Examples

Knowledge Hut

Project management plays a significant role in the success of every organization. It ensures that the project is on track, aids in efficient management of resources, and also keeps the stakeholders know what is project and what's happening in it. In this blog, we will look at three different project organizational structures: functional, matrix, and process.

Project 98
article thumbnail

The Case of Homegrown Large Language Models

KDnuggets

Recent developments in building large language models (LLMs) to boost generative AI in local languages have caught everyone’s attention. This post focuses on the needs and challenges of homegrown LLMs amid the fast-evolving technology landscape.

article thumbnail

DSPy on Databricks

databricks

Large language models (LLMs) have generated interest in effective human-AI interaction through optimizing prompting techniques. “Prompt engineering” is a growing methodology for tailoring.

article thumbnail

High resolution data updates to Living Atlas World Elevation Layers (April 2024)

ArcGIS

In April 2024, elevation layers have been updated with high-res datasets of Wales, New Zealand & German states of Bavaria, Saxony and Brandenburg

Datasets 109
article thumbnail

Demystifying DAPs: A Practical Guide to Digital Adoption Success

Speaker: Pulkit Agrawal

Digital Adoption Platforms (DAPs) are revolutionizing the way organizations interact with and optimize their software applications. As digital transformation continues to accelerate, DAPs have become essential tools for enhancing user engagement and software efficiency. This session is your guide into the robust world of DAPs, exploring their origins, evolution, and the current trends shaping their development.

article thumbnail

What is Agile and How Does It Work?

Knowledge Hut

Agile began as an iterative, collaborative, value-driven approach to developing software. It was originally conceived as a framework to help structure work on complex projects with dynamic, unpredictable characteristics. But since then, it has evolved into somewhat of a philosophy or worldview with a set of well-articulated values and principles that it shares with Agmany Agilearieties.

IT 98
article thumbnail

The AI Transformation Strategy in the GenAI Era

KDnuggets

Similar to the iterative nature of AI projects, AI strategy also requires continuous adjustments to bring successful AI transformation.

Project 118
article thumbnail

Snowflake Achieves C5 and TISAX Certifications, Expanding Compliance Scope in Germany

Snowflake

As Snowflake continues to expand our commitment to compliance, we are pleased to announce that we have successfully completed both C5 and TISAX attestations in Germany. Cloud Computing Compliance Controls Catalog (C5) C5 is an audited standard establishing baselines for cloud security. It was initially created for government agencies and organizations that work with the government to ensure security baselines are met by their cloud service providers (CSPs).

article thumbnail

Learn About Cloudera’s Partner Network

Cloudera

Businesses around the world rely on an extensive network of partnerships to deliver quality customer experiences—and it’s no different here at Cloudera. Cloudera is building a robust partner ecosystem to meet the unique needs of its customers, working to provide exceptional and fulfilling experiences that help make Cloudera a leader in the multi-cloud data platform space.

Food 90
article thumbnail

Deliver Mission Critical Insights in Real Time with Data & Analytics

In the fast-moving manufacturing sector, delivering mission-critical data insights to empower your end users or customers can be a challenge. Traditional BI tools can be cumbersome and difficult to integrate - but it doesn't have to be this way. Logi Symphony offers a powerful and user-friendly solution, allowing you to seamlessly embed self-service analytics, generative AI, data visualization, and pixel-perfect reporting directly into your applications.

article thumbnail

Multi-Scale Contour Styling in ArcGIS Pro

ArcGIS

How to configure scale-appropriate contour lines and their labels.

135
135
article thumbnail

5 Free SQL Courses for Data Science Beginners

KDnuggets

Are you looking to make a career in data science? Start by learning SQL with these free courses.

SQL 125
article thumbnail

Celebrating the Women Who Inspire Us

Robinhood

Robinhood was founded on a simple idea: that our financial markets should be accessible to all. With customers at the heart of our decisions, Robinhood is lowering barriers and providing greater access to financial information and investing. Together, we are building products and services that help create a financial system everyone can participate in. … At Robinhood, our Women’s History Month celebrations begin in March and extend beyond, throughout the year.

Finance 80
article thumbnail

Databricks Wins 2024 Google Cloud Partner of the Year Award

databricks

We're excited to announce that Databricks has been honored with the 2024 Google Cloud Technology Partner of the Year award for Data -.

article thumbnail

Get Better Network Graphs & Save Analysts Time

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.