The Pragmatic Engineer
MAY 1, 2024
This article was published on 14 March 2024 in The Pragmatic Engineer, for subscribers. I'm sharing this piece in public more than a month later, as it provides important context and analysis for the AI dev tools space. Subscribe to The Pragmatic Engineer to stay up-to-date on what is happening with software engineering, Big Tech, and startups.
Christophe Blefari
MAY 2, 2024
My personal collection of the best resources to bootstrap a data team and get inspired from what others are doing.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Confessions of a Data Guy
APRIL 28, 2024
A few years ago I wasn’t sure, who was going to win, Golang seemed to be popular, and still is for that matter. When I first wrote a little Golang (~2+ years ago) I was just trying to see what the hype was all about. The funny thing is, at the time, and today, it […] The post Why did Golang lose to Rust for Data Engineering? appeared first on Confessions of a Data Guy.
Seattle Data Guy
APRIL 28, 2024
If you’ve worked in data long enough, then you’ve likely come across the term change data capture. Often called CDC, change data capture involves tracking and recording changes in a database as they happen, and then transmitting these changes to designated targets. This can be crucial because some pipelines, in particular batch pipelines, don’t capture… Read more The post Terms You Should Know If You’re Planning To Use Change Data Capture appeared first on Seattle D
Speaker: John Mansour
If you're looking to advance your career in product management, there are more options than just climbing the management ladder. Join our upcoming webinar to learn about highly rewarding career paths that don't involve management responsibilities. We'll cover both career tracks and provide tips on how to position yourself for success in the one that's right for you.
Confluent
MAY 1, 2024
Confluent Cloud Freight clusters are now available in Early Access. In this blog, learn how Freight clusters can save you up to 90% at GBps+ scale.
Knowledge Hut
MAY 2, 2024
The work scenario today is stretching workplace flexibilities to accommodate the needs of professionals. Globally stationed offices have also made extending flexible workplaces a norm. Working remotely is the new trend that is transcending industries. While working remotely comes with its own set of benefits, it isn’t well-suited for some industries or professions.
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
KDnuggets
APRIL 29, 2024
This article is an overview of a particular subset of data structures useful in machine learning and AI development, along with explanations and example implementations.
Snowflake
MAY 1, 2024
The 2024 Snowflake Startup Challenge began with over 900 applications from startups Powered by Snowflake in more than 100 countries. Our judges narrowed that long list of contenders down to 10, and after much deliberation, they’ve now pared it down to the final three. We are pleased to announce that BigGeo, Scientific Financial Systems and SignalFlare.ai by Extropy360 will advance to the Snowflake Startup Challenge finale and compete for the opportunity to receive a share of up to $1 million in
databricks
APRIL 30, 2024
We are proud to announce that Forrester has recognized Databricks as a Leader with the highest scores in both current offering and strategy.
Knowledge Hut
MAY 2, 2024
Apache Spark is a fast and general-purpose cluster computing system. It provides high-level APIs in Java, Scala, Python, and R and an optimized engine that supports general execution graphs. It also supports a rich set of higher-level tools, including Spark SQL for SQL and structured data processing, MLlib for machine learning, GraphX for graph processing, and Spark Streaming.
Advertisement
Generative AI is upending the way product developers & end-users alike are interacting with data. Despite the potential of AI, many are left with questions about the future of product development: How will AI impact my business and contribute to its success? What can product managers and developers expect in the future with the widespread adoption of AI?
Confessions of a Data Guy
APRIL 28, 2024
I was recently confronted with an interesting conundrum when writing a complex data pipeline. It was an interesting problem that arose from my quest to reduce complexity in part of the design, which found itself creeping into another part, re-enforcing the classic idea of whether you can really make the complexity pea go away, or […] The post If:Else Logic and Complexity – Hiding the Pea. appeared first on Confessions of a Data Guy.
KDnuggets
MAY 1, 2024
Top five mistakes made by AI beginners and practical tips to avoid them, along with an engaging "50-Day Challenge" that you cannot afford to miss.
Snowflake
MAY 2, 2024
To accurately answer business questions using LLMs, companies must augment models with their data. Retrieval Augmented Generation (RAG) is a popular solution to this problem, as it integrates the organization’s factual, real-time data into the prompt for the LLM. While the adoption of RAG has increased, an open question remains: How do enterprises know how effective their system is?
databricks
APRIL 30, 2024
A good benchmark is one that clearly shows which models are better and which are worse. The Databricks Mosaic Research team is dedicated.
Advertisement
Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.
Knowledge Hut
MAY 2, 2024
If you are a machine learning enthusiast and stay in touch with the latest developments, you would have definitely come across the news “Machine learning identifies links between the world's oceans” Wait, we all know how complex it would be to analyse a concept such as oceans and their behaviour which would undoubtedly involve billions of data points associated with many critical parameters such as wind velocities, temperatures, earth’s rotation and many such.
Confessions of a Data Guy
APRIL 30, 2024
The post Reaction to Data Engineering Survey for 2024 appeared first on Confessions of a Data Guy.
KDnuggets
APRIL 30, 2024
Exploring the merits of data science degrees vs courses, this analysis contrasts their depth, prestige, and practicality in job market preparation
Booking.com Engineering
APRIL 29, 2024
On 25 March, Booking.com joined forces with Engflow Inc to organize and host Amsterdam’s first ever first Bazel Community Day. Booking.com’s brand new headquarters welcomed over 70 attendees from different companies and backgrounds, for an afternoon of connection, talks, and an unconference in which 3 topics were discussed. A productive, insightful afternoon, all capped off with a campus tour and drinks overlooking the Amsterdam skyline from Oosterdok Island. 4 keynote speakers took to the stage
Speaker: Timothy Chan, PhD., Head of Data Science
Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.
databricks
MAY 1, 2024
The Databricks Data Intelligence Platform offers unparalleled flexibility, allowing users to access nearly instant, horizontally scalable compute resources. This ease of creation can.
Knowledge Hut
MAY 1, 2024
Data is everywhere, and we have all seen exponential growth in the data that is generated daily. I nformation must be extracted from this data to make sense of it, and we must gain insights from th is information that will help us to understand repeating patterns. Analysing these patterns will help us to know more about consumer s and their behaviour, hence provide services and manufacture products that will benefit both the organization as well as the consumers.
Confessions of a Data Guy
APRIL 30, 2024
What is going on? Is the world coming to an end? I thought Python was going to live forever. Well, apparently not at Google. Recently Google announced it was laying off its entire North American-based Python team that was supporting Google’s special needs with Python, in favor of cheaper offshore workers. Apparently, some of these […] The post Google Fires Python.
KDnuggets
APRIL 30, 2024
Want to build and deploy robust machine learning systems to production? Start learning MLOps today with these courses from Google.
Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage
Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.
Snowflake
MAY 2, 2024
Snowflake Marketplace is designed to give customers and organizations a place to easily find, try and buy data, apps and AI products that help solve their most pressing business problems. We have more than 540 providers, offering over 2,400 live, ready-to-use data products (as of Jan 31, 2024), so there are many options to help you enrich your own data resources, build new data apps and leverage the power of AI on Snowflake.
Uber Engineering
MAY 2, 2024
Learn how Uber improved mobile testing reliability, and increased productivity for thousands of engineers, using machine learning to create DragonCrawl, a highly stable and low-maintenance testing system.
Knowledge Hut
APRIL 29, 2024
The Coronavirus outbreak has put the world into testing times and quite a frustrating one as well. People are being laid-off from work due to companies suffering from financial and production losses. Some still are directed to go to work and risk being infected with this terrible disease. The biggest challenge is companies facing difficulties to keep their projects running during this pandemic, especially with how teams work and communicate.
databricks
MAY 1, 2024
Modern data stacks provide the necessary flexibility and efficiency for analytics and AI. Learn how the Databricks Data Intelligence Platform makes use of them.
Speaker: Scott Sehlhorst
We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.
KDnuggets
MAY 2, 2024
Get up and running with Docker with this tutorial on containerizing Python applications.
Snowflake
APRIL 29, 2024
As the cybersecurity threat landscape continues to evolve globally, organizations operating in the financial sector are seeing regulations shift to address the associated risks, and none may prove more impactful than the European Union’s (EU) Digital Operational Resilience Act (DORA). This regulation aims to strengthen the operational resilience of financial entities (FEs), and their third-party information and communication technology (ICT) providers.
Scott Logic
APRIL 30, 2024
Introduction As part of a project onto the carbon footprint of mobile computing (CFoMC), we required a method to be able to record the energy use of certain computational workloads on differing mobile devices, part of that being Android mobile devices. So we needed a method to accurately measure the energy use on a device. Why measure energy use? The reason why we wanted to measure the energy use was to compare the energy use of the same code / calculations across different devices.
Knowledge Hut
APRIL 29, 2024
Very often, we find that life doesn’t go as planned. There may be sudden changes in employment status, unexpected illness or injury, or even something as unexpected as the novel coronavirus crisis. Several countries around the world have announced nationwide lockdowns and large organizations have set a mandate for their teams to work remotely to combat the spread of COVID-19.
Advertisement
Start-ups & SMBs launching products quickly must bundle dashboards, reports, & self-service analytics into apps. Customers expect rapid value from your product (time-to-value), data security, and access to advanced capabilities. Traditional Business Intelligence (BI) tools can provide valuable data analysis capabilities, but they have a barrier to entry that can stop small and midsize businesses from capitalizing on them.
Expert insights. Personalized for you.
181 
Let's personalize your content