The Pragmatic Engineer
APRIL 21, 2024
See a longer version of this article here: Scaling ChatGPT: Five Real-World Engineering Challenges. Sometimes the best explanations of how a technology solution works come from the software engineers who built it. To explain how ChatGPT (and other large language models) operate, I turned to the ChatGPT engineering team. "How does ChatGPT work, under the hood?
Christophe Blefari
MARCH 15, 2024
Mountains I hope this e-mail finds you well, wherever you are. I'd like to thank you for the excellent comments you sent me last week after the publication of the first version of the Recommendations. This is just the beginning! This week I've added a subscribe button in the Recommendations page in order for you to opt-in for the weekly recommendation email—every Tuesday.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
KDnuggets
MARCH 27, 2024
Learn everything about data science by exploring our curated collection of free courses from top universities, covering essential topics from math and programming to machine learning, and mastering the nine steps to become a job-ready data scientist.
Snowflake
APRIL 24, 2024
Building top-tier enterprise-grade intelligence using LLMs has traditionally been prohibitively expensive and resource-hungry, and often costs tens to hundreds of millions of dollars. As researchers, we have grappled with the constraints of efficiently training and inferencing LLMs for years. Members of the Snowflake AI Research team pioneered systems such as ZeRO and DeepSpeed , PagedAttention / vLLM , and LLM360 which significantly reduced the cost of LLM training and inference, and open sourc
Speaker: John Mansour
If you're looking to advance your career in product management, there are more options than just climbing the management ladder. Join our upcoming webinar to learn about highly rewarding career paths that don't involve management responsibilities. We'll cover both career tracks and provide tips on how to position yourself for success in the one that's right for you.
ArcGIS
MAY 7, 2024
Discover the exciting new features of ArcGIS Pro 3.3. From water flow modeling to direct PDF support, this release has it all. Read our blog to learn more.
Confluent
MAY 1, 2024
Confluent Cloud Freight clusters are now available in Early Access. In this blog, learn how Freight clusters can save you up to 90% at GBps+ scale.
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
Robinhood
MARCH 20, 2024
Robinhood Wallet is a portal to the world of web3, giving users full ownership and control of their crypto Today, we are excited to release Robinhood Wallet to all eligible Android users globally, expanding on our mission to make Robinhood the most trusted and easiest way to use crypto. All customers who previously joined the waitlist can download and get started today.
Engineering at Meta
MARCH 6, 2024
To comply with a new EU law, the Digital Markets Act (DMA), which comes into force on March 7th, we’ve made major changes to WhatsApp and Messenger to enable interoperability with third-party messaging services. We’re sharing how we enabled third-party interoperability (interop) while maintaining end-to-end encryption (E2EE) and other privacy guarantees in our services as far as possible.
Data Engineering Weekly
MAY 3, 2024
The tweet received strong reactions on LinkedIn and Twitter. To clarify, I quoted it as a Notebook-style development, but it is not exactly a Notebook. There is a lot of context missing in that tweet, so I decided to write a blog about it. People have reservations about using tools like Jupytor Notebook for the production pipeline for a good reason.
DoorDash Engineering
FEBRUARY 27, 2024
We reviewed the architecture of our global search at DoorDash in early 2022 and concluded that our rapid growth meant within three years we wouldn’t be able to scale the system efficiently, particularly as global search shifted from store-only to a hybrid item-and-store search experience. Our analysis identified Elasticsearch as our architecture’s primary bottleneck.
Advertisement
Generative AI is upending the way product developers & end-users alike are interacting with data. Despite the potential of AI, many are left with questions about the future of product development: How will AI impact my business and contribute to its success? What can product managers and developers expect in the future with the widespread adoption of AI?
The Pragmatic Engineer
JANUARY 4, 2024
👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. In every issue, I cover topics related to Big Tech and startups through the lens of engineering managers and senior engineers. In this article, we cover one out of four topics from today’s subscriber-only The Pulse issue. To get full issues twice a week, subscribe here.
Monte Carlo
APRIL 1, 2024
Good Night Moon. Where The Wild Things Are. The Cat in the Hat. And now, from the mind of Barr Moses, comes the historic next children’s literary classic: Mastering Data Quality And Your ABCs. A follow up to 2022’s Data Quality Fundamentals: A Practical Guide to Building Reliable Data Pipelines published by O’Reilly Media , Mastering Data Quality And Your ABCs educates the next generation of data and AI engineers about the importance of highly reliable data.
KDnuggets
APRIL 4, 2024
These GitHub repositories provide valuable resources for mastering computer science, including comprehensive roadmaps, free books and courses, tutorials, and hands-on coding exercises to help you gain the skills and knowledge necessary to thrive in the ever-evolving field of technology.
Snowflake
APRIL 11, 2024
Data is the lifeblood of modern businesses, but unlocking its true insights often requires complex SQL queries. These queries can be time-consuming to write and challenging to maintain. At Snowflake, we believe in making the power of data accessible to all. That’s why we prioritize simplicity, governance and quality in everything we build – including our AI-powered tools.
Advertisement
Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.
ArcGIS
FEBRUARY 21, 2024
ArcGIS Pro 3.3 is planned to be available in May 2024. Install.NET 8 before attempting to install ArcGIS Pro 3.3 for the best user experience!
Confluent
MARCH 19, 2024
Seamlessly integrate Apache Kafka data into your lakehouse as Apache Iceberg tables, bridging the operational and analytical divide, with Tableflow. Read more in our blog post.
databricks
MARCH 27, 2024
Databricks’ mission is to deliver data intelligence to every enterprise by allowing organizations to understand and use their unique data to build their.
Robinhood
JANUARY 11, 2024
The new class of spot Bitcoin ETFs that were approved by the SEC yesterday are now available on Robinhood Earlier today, Robinhood started offering the new class of spot Bitcoin ETFs that were approved by the SEC on January 10. These 11 ETFs became tradable to all customers in the United States this morning in both retirement and brokerage accounts though Robinhood Financial.
Speaker: Timothy Chan, PhD., Head of Data Science
Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.
Engineering at Meta
MARCH 21, 2024
Threads has entered the fediverse! As part of our beta experience, now available in a few countries, Threads users aged 18+ with public profiles can now choose to share their Threads posts to other ActivityPub-compliant servers. People on those servers can now follow federated Threads profiles and see, like, reply to, and repost posts from the fediverse.
Tweag
JANUARY 17, 2024
I recently merged linear let- and where-bindings in GHC. Which means that we’ll have these in GHC 9.10, which is cause for celebration for me. Though they are much overdue, so maybe I should instead apologise to you. Anyway, I thought I’d take the opportunity to discuss some of GHC’s inner workings and how they explain some of the features of linear types in Haskell.
Yelp Engineering
MARCH 26, 2024
One of Yelp’s top priorities is the trust and safety of our users. Yelp’s platform is most well-known for its reviews, and its moderation practices have been recognised in academic research for mitigating misinformation and building consumer trust. In addition to reviews, Yelp’s Trust and Safety team takes significant measures when it comes to protecting its users from inappropriate material posted through other content types.
Knowledge Hut
MAY 10, 2024
As of the beginning of January 2022, India has recognized more than 61,000 startups, thus having the 3rd largest startup ecosystem after the US and China. The government of India has an initiative called Startup India, whose sole purpose is to bring about startup culture and build an ecosystem for entrepreneurship and innovation. As a result, the startup ecosystem in India has emerged as a major growth engine for the country in the past few years and aims to become a global tech powerhouse.
Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage
Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.
Cloudera
MARCH 22, 2024
As enterprise AI technologies rapidly reshape our digital environment, the foundation of your cloud infrastructure is more critical than ever. That’s why Cloudera and Red Hat , renowned for their open-source solutions, have teamed up to bring Red Hat Enterprise Linux ( RHEL ) to Cloudera on public cloud as the operating system for all of our public cloud platform images.
KDnuggets
APRIL 15, 2024
Want to learn math for data science? Check out these three courses to learn linear algebra, calculus, statistics, and more.
Snowflake
APRIL 8, 2024
In 2020, Snowflake announced a new global competition to recognize the work of early-stage startups building their apps — and their businesses — on Snowflake, offering up to $250,000 in investment as the top prize. Four years later, the Snowflake Startup Challenge has grown into a premiere showcase for emerging startups, garnering interest from companies in over 100 countries and offering a prize package featuring a portion of up to $1 million in potential investment opportunities and exclusive
ArcGIS
JANUARY 31, 2024
Exploring the value of critique as part of the process of creating a new map of the Total Eclipse that will cross the United States on April 8th
Advertisement
Start-ups & SMBs launching products quickly must bundle dashboards, reports, & self-service analytics into apps. Customers expect rapid value from your product (time-to-value), data security, and access to advanced capabilities. Traditional Business Intelligence (BI) tools can provide valuable data analysis capabilities, but they have a barrier to entry that can stop small and midsize businesses from capitalizing on them.
Confluent
FEBRUARY 27, 2024
Apache Kafka 3.7 introduces updates to the Consumer rebalance protocol, an official Apache Kafka Docker image, JBOD support in Kraft-based clusters, and more!
databricks
MARCH 26, 2024
By Steve Sobel - Global Industry Leader; Communications, Media & Entertainment Today Databricks and Adobe are excited to announce a strategic partnership focused.
Robinhood
MARCH 26, 2024
Robinhood set to host first-ever keynote to announce the Robinhood Gold Card, a new 1% boost on Robinhood Gold deposits, and a reimagined Robinhood app Today, we are hosting Robinhood Presents: The New Gold Standard, our first-ever keynote event where Co-Founder and CEO Vlad Tenev will unveil new product and feature updates live to Robinhood customers in New York City.
Engineering at Meta
FEBRUARY 6, 2024
We’ve open sourced DotSlash , a tool that makes large executables available in source control with a negligible impact on repository size, thus avoiding I/O-heavy clone operations. With DotSlash, a set of platform-specific executables is replaced with a single script containing descriptors for the supported platforms. DotSlash handles transparently fetching, decompressing, and verifying the appropriate remote artifact for the current operating system and CPU.
Advertisement
While data platforms, artificial intelligence (AI), machine learning (ML), and programming platforms have evolved to leverage big data and streaming data, the front-end user experience has not kept up. Holding onto old BI technology while everything else moves forward is holding back organizations. Traditional Business Intelligence (BI) aren’t built for modern data platforms and don’t work on modern architectures.
Expert insights. Personalized for you.
345 
Let's personalize your content