The Pragmatic Engineer

MARCH 19, 2024

👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. In every issue, I cover topics related to Big Tech and startups through the lens of engineering managers and senior engineers. In this article, we cover one out of three topics from last week’s subscriber-only The Pulse issue. Today, full subscribers got access to a comprehensive Senior-and-above tech compensation research.

Software Engineer 263

Software Engineer Software Engineering Programming Language Media 263

Data Engineering Podcast

MARCH 17, 2024

Summary A significant portion of data workflows involve storing and processing information in database engines. Validating that the information is stored and processed correctly can be complex and time-consuming, especially when the source and destination speak different dialects of SQL. In this episode Gleb Mezhanskiy, founder and CEO of Datafold, discusses the different error conditions and solutions that you need to know about to ensure the accuracy of your data.

Database 147

Database Data Lake High Quality Data Data Workflow 147

Christophe Blefari

MARCH 22, 2024

Friday routine ( credits ) It's Friday and it's Data News. I don't go into too much detail about the magic of Data News, but every Friday is the same. At first, I'm: oh s**t, here we go again and 10 minutes later I'm lost in reading the content and picking too many articles to fit into a thousand word edition. Usually all the process takes me a whole Friday.

Electronics 130

Electronics Media Data Python 130

Waitingforcode

MARCH 22, 2024

Apache Spark leverages the observer design pattern for the framework-to-code communication. One of the consumers' implementations is StreamingQueryListener.

Coding 130

Coding Designing 130

Speaker: Conrado Morlan

In this engaging and witty talk, we’ll explore how artificial intelligence can transform the daily tasks of product managers into streamlined, efficient processes. Using the lens of a superhero narrative, we’ll uncover how AI can be the ultimate sidekick, aiding in decision-making, enhancing productivity, and boosting innovation. Attendees will leave with practical tools and actionable insights, motivated to embrace AI and leverage its potential in their work. 🦸 🏢 Key objectives:

Management

KDnuggets

MARCH 20, 2024

Are you curious about what it takes to become a professional data scientist? Look no further! By following these guides, you can transform yourself into a skilled data scientist and unlock endless career opportunities.

Data Analysis 129

Data Analysis SQL Python Data 129

Robinhood

MARCH 20, 2024

Robinhood Wallet is a portal to the world of web3, giving users full ownership and control of their crypto Today, we are excited to release Robinhood Wallet to all eligible Android users globally, expanding on our mission to make Robinhood the most trusted and easiest way to use crypto. All customers who previously joined the waitlist can download and get started today.

Finance 132

Finance Insurance Accessible Accessibility 132

Engineering at Meta

MARCH 21, 2024

Threads has entered the fediverse! As part of our beta experience, now available in a few countries, Threads users aged 18+ with public profiles can now choose to share their Threads posts to other ActivityPub-compliant servers. People on those servers can now follow federated Threads profiles and see, like, reply to, and repost posts from the fediverse.

Media 128

Media Building Government Engineering 128

databricks

MARCH 19, 2024

Today, we are thrilled to announce that Lilac is joining Databricks. Lilac is a scalable, user-friendly tool for data scientists to search, cluster.

Unstructured Data 140

Unstructured Data Data 140

KDnuggets

MARCH 22, 2024

GenAI has enabled new search engine platforms with unique features and advantages, challenging Google's dominance.

Engineering 145

Engineering 145

Snowflake

MARCH 21, 2024

Snowflake is committed to helping our customers unlock the power of artificial intelligence (AI) to drive better decisions, improve productivity and reach more customers using all types of data. Large Language Models ( LLMs ) are a critical component of generative AI applications, and multimodal models are an exciting category that allows users to go beyond text and incorporate images and video into their prompts to get a better understanding of the context and meaning of the data.

Government 118

Government Technology Cloud Building 118

Advertisement

The complexity of financial data, the need for real-time insight, and the demand for user-friendly visualizations can seem daunting when it comes to analytics - but there is an easier way. With Logi Symphony, we aim to turn these challenges into opportunities. Our platform empowers you to seamlessly integrate advanced data analytics, generative AI, data visualization, and pixel-perfect reporting into your applications, transforming raw data into actionable insights.

Raw Data

Cloudera

MARCH 22, 2024

As enterprise AI technologies rapidly reshape our digital environment, the foundation of your cloud infrastructure is more critical than ever. That’s why Cloudera and Red Hat , renowned for their open-source solutions, have teamed up to bring Red Hat Enterprise Linux ( RHEL ) to Cloudera on public cloud as the operating system for all of our public cloud platform images.

Cloud 114

Cloud Certification Systems Architecture 114

Confessions of a Data Guy

MARCH 18, 2024

Want to know how to grow to the Senior Engineering position? Take a look. The post The Path To Senior Engineer appeared first on Confessions of a Data Guy.

Engineering 100

Engineering Data Data Engineering Data Engineer 100

KDnuggets

MARCH 19, 2024

Statistics is a must-have skill for data science. And here are 5 free books that’ll help you learn all the statistics you need as a data professional.

Data Science 121

Data Science Data 121

Snowflake

MARCH 19, 2024

A company’s data strategy is always in motion. Since the explosion of interest in generative AI and large language models (LLMs), that is more true than ever, with business leaders discussing how quickly they should adopt these technologies to stay competitive. Some emerging approaches may be seen in our newly released Snowflake Data Trends 2024 , looking at how users in the Data Cloud are working with their data.

Data Governance 119

Data Governance Government Unstructured Data Programming Language 119

Advertisement

Adding high-quality entity resolution capabilities to enterprise applications, services, data fabrics or data pipelines can be daunting and expensive. Organizations often invest millions of dollars and years of effort to achieve subpar results. This guide will walk you through the requirements and challenges of implementing entity resolution. By the end, you'll understand what to look for, the most common mistakes and pitfalls to avoid, and your options.

IT

Robinhood

MARCH 21, 2024

President and CEO of Americas Society and Council of the Americas joins the Robinhood Board of Directors We’re excited to share that Susan Segal has joined Robinhood Markets’ Board of Directors. “Susan is widely recognized for her work and extensive contributions in Latin America as well as in the financial sector,” said Vlad Tenev, CEO and Co-Founder of Robinhood.

IT 109

IT Banking Finance Accessible 109

Confluent

MARCH 21, 2024

Learn the best practices for using Confluent Schema Registry, including using schema IDs, understanding subjects and versions, using data contracts, pre-registering schemas, and more.

Data 106

Data 106

KDnuggets

MARCH 19, 2024

Check out this beginner’s guide to understanding the role of Large Language Model Operations for seamless user experiences.

127

127

Knowledge Hut

MARCH 22, 2024

When I worked in the hospitality industry, the electricity abruptly went out while we were establishing the network and door locks. To my surprise, the door lock opened like any other door. This was the first time in my life that I had ever seen a fail-safe door lock. I have comprehensively analyzed the area of physical security, particularly the ongoing discussion surrounding fail safe vs fail-safe secure electric strike locking systems.

Systems 105

Systems Electronics Hospitality Architecture 105

Speaker: Maher Hanafi, VP of Engineering at Betterworks & Tony Karrer, CTO at Aggregage

Executive leaders and board members are pushing their teams to adopt Generative AI to gain a competitive edge, save money, and otherwise take advantage of the promise of this new era of artificial intelligence. There's no question that it is challenging to figure out where to focus and how to advance when it’s a new field that is evolving everyday. 💡 This new webinar featuring Maher Hanafi, VP of Engineering at Betterworks, will explore a practical framework to transform Generative AI pr

Data Collection

WeCloudData

MARCH 20, 2024

Machine learning is revolutionizing traffic prediction, enhancing route planning and reducing congestion in urban commuting. Explore advanced algorithms like Uni-LSTM and BiLSTM for accurate forecasts, along with Google Maps' integration of deep learning for improved ETA accuracy. Discover the practical utility of machine learning in everyday life. The post Navigating your way: Traffic Prediction with Machine Learning appeared first on WeCloudData.

Machine Learning 97

Machine Learning Deep Learning Algorithm Utilities 97

databricks

MARCH 21, 2024

We are excited to announce the release of the Databricks AI Security Framework (DASF) version 1.0 whitepaper! The framework is designed to improve.

Designing 106

Designing 106

KDnuggets

MARCH 20, 2024

Learn data science according to your expertise with these 4 different learning roadmaps.

Data Science 147

Data Science Data 147

Knowledge Hut

MARCH 20, 2024

Employees who are in the profession today will change occupations considerably more much of the time than in past time. Thus, you should be aware and proactive in dealing with your profession. Yet, does this mean you need to yield in different parts of your life that are important to you? Our lives are sufficiently occupied balancing work and family without finding time for making out significant profession improvements also.

Utilities 98

Utilities Building Systems Management 98

Speaker: Pulkit Agrawal

Digital Adoption Platforms (DAPs) are revolutionizing the way organizations interact with and optimize their software applications. As digital transformation continues to accelerate, DAPs have become essential tools for enhancing user engagement and software efficiency. This session is your guide into the robust world of DAPs, exploring their origins, evolution, and the current trends shaping their development.

Certification

Engineering at Meta

MARCH 18, 2024

Systems and application logs play a key role in operations, observability, and debugging workflows at Meta. Logarithm is a hosted, serverless, multitenant service, used only internally at Meta, that consumes and indexes these logs and provides an interactive query interface to retrieve and view logs. In this post, we present the design behind Logarithm, and show how it powers AI training debugging use cases.

Engineering 94

Engineering Metadata Architecture Designing 94

databricks

MARCH 21, 2024

Benchmarking for training (dense) models at scale. We demonstrate great performance (very high MFU) and highlight our use of NVIDIA's Transformer Engine, along with PyTorch FSDP and DTensor.

Engineering 94

Engineering 94

KDnuggets

MARCH 21, 2024

MetaGPT's newest agent addition makes running data interpretation and analysis tasks a breeze. Find out more and give it a try for yourself.

Data Solutions 113

Data Solutions Data IT 113

Knowledge Hut

MARCH 19, 2024

Logical thinking skills play a significant role in developing careers because they help you reason through vital decisions, generate creative ideas, set goals, and solve problems. You may encounter multiple challenges in your life when you enter the job industry or advance your career. Therefore, need strong logical reasoning skills to solve your problems.

Education 98

Education Certification Process Programming 98

Advertisement

In the fast-moving manufacturing sector, delivering mission-critical data insights to empower your end users or customers can be a challenge. Traditional BI tools can be cumbersome and difficult to integrate - but it doesn't have to be this way. Logi Symphony offers a powerful and user-friendly solution, allowing you to seamlessly embed self-service analytics, generative AI, data visualization, and pixel-perfect reporting directly into your applications.

Data Analytics

Engineering at Meta

MARCH 20, 2024

At Meta, we support real-time communication (RTC) for billions of people through our apps, including Messenger, Instagram, and WhatsApp. We’ve seen significant benefits by adopting the AV1 codec for RTC. Here’s how we are improving the RTC video quality for our apps with tools like the AV1 codec, the challenges we face, and how we mitigate those challenges.

Algorithm 91

Algorithm Manufacturing Media Coding 91

Robinhood

MARCH 18, 2024

The largest UK brokers typically charge UK investors, with a £10,000 portfolio, an average of £240 per year to invest in US stocks*–Robinhood offers no commission fees and no foreign exchange (FX) fees on trades.** Today, we’ve rolled all eligible customers off our waitlist and Robinhood is now officially available throughout the United Kingdom. With Robinhood, customers simply get more for their money, with no commission fees and no foreign exchange (FX) fees on trades, access to more than 6,00

Insurance 88

Insurance Portfolio Education Banking 88

KDnuggets

MARCH 18, 2024

Learn how to automate machine learning training and evaluation using scikit-learn pipelines, GitHub Actions, and CML.

Machine Learning 126

Machine Learning Programming 126

Knowledge Hut

MARCH 20, 2024

Today, in the growing dynamic environment, definitely the only non-changed thing is changing itself, whatever the driver is from, opportunity or threats from outside or inside your organization… Believing some of you already realized that more and more talents were being required in the market, since most of the developed organizations were investing more and more for building up or upgrading of the organization capability, for catering to the growing dynamic environment, that just is the capabi

Certification 98

Certification Portfolio Finance Programming 98

Advertisement

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

Database