Engineering at Meta

JANUARY 11, 2024

What’s going on with generative AI (GenAI) at Meta? In this episode of the Meta Tech Podcast, Meta engineer Pascal Hartig ( @passy ) speaks with Devi Parikh, an AI research director at Meta. And if you’re interested in AI career opportunities at Meta visit the Meta Careers page.

Engineering 79

Engineering 79

Christophe Blefari

APRIL 12, 2024

AI News 🤖 Open-source LLMs for everyone — A great post from Siemens AI team about open LLMs initiatives that brings new usages in the dev workflow, wether it's about code completion and pull request / crash reporting summarisation, it looks neat. PS: Apache Superset is going 4.0 this week with a lot of new features.

BI 130

BI SQL Data Coding 130

The Pragmatic Engineer

JULY 6, 2023

Well, it relies on Google Cloud’s ML and AI services, as per engineers whom I talked with at Twitter. That Meta could pull off a non-throttled launch is very impressive at the scale of tens of millions of users, for two reasons: Infrastructure readiness from day one. Meta’s rapid bounce back.

Google Cloud 225

Google Cloud Media Cloud Utilities 225

The Pragmatic Engineer

DECEMBER 2, 2023

Alina Prokhoda, listed in the JDKon 2024 lineup But there is no such MVP, and I confirmed with my sources that no one by this name works at Meta. All this took about 30 minutes of research to find out, including the pinging of contacts at Coinbase and Meta. I then looked at previous DevTernity conferences.

Software Engineer 301

Software Engineer Software Engineering Insurance Coding 301

databricks

JULY 18, 2023

Today, Meta released their latest state-of-the-art large language model (LLM) Llama 2 to open source for commercial use1. This is a significant development.

Building 95

Building 95

The Pragmatic Engineer

OCTOBER 27, 2022

The observations on how Big Tech hiring will slow down have since been validated, with Meta not only laying off in November, but also rescinding offers in January 2023, and Amazon doing the same. How does this compare to the number of hires Microsoft, Google and Meta made during the past 12 months? It’s hard to tell.

IT 130

IT Software Engineer Software Engineering Recruitment 130

Engineering at Meta

NOVEMBER 15, 2023

Meta is building for the future of AI at every level – from hardware like MTIA v1 , Meta’s first-generation AI inference accelerator to publicly released models like Llama 2 , Meta’s next-generation large language model, as well as new generative AI (GenAI) tools like Code Llama.

Building 88

Building Engineering Transportation Software Engineer 88

Engineering at Meta

NOVEMBER 21, 2023

Python plays a big part at Meta. It powers Instagram’s backend and plays an important role in our configuration systems, as well as much of our AI work. Meta even made contributions to Python 3.12 , the latest version of Python. The post Writing and linting Python at scale appeared first on Engineering at Meta.

Python 95

Python Engineering Systems IT 95

Engineering at Meta

SEPTEMBER 7, 2023

Meta presents Chakra execution traces , an open graph-based representation of AI/ML workload execution, laying the foundation for benchmarking and network performance optimization. The limitations of traditional AI benchmarking methodology Traditionally, benchmarking AI systems has largely relied on running full ML workloads.

Metadata 103

Metadata Utilities Systems Designing 103

Christophe Blefari

OCTOBER 20, 2023

Gen AI 🤖 Can you run it? New Vertex AI Feature Store — GCP Vertex AI is the place to do "serverless" AI. Do we still want a future where AI decide for us? At the same time, luckily for us, Meta is creating custom silicon for AI. In public preview.

Generalist 130

Generalist Entertainment NoSQL Datasets 130

Data Engineering Weekly

MARCH 17, 2024

Stephanie Kirmer: Uncovering the EU AI Act Large language models have taken the world by storm, and every country is trying to evaluate its potential impact. India recently announced that all AI apps require government approval and dropped the plan later.

Data Engineering 70

Data Engineering Data Engineer Engineering Data Governance 70

Christophe Blefari

SEPTEMBER 1, 2023

AI fights this is the future we want. After Excel, Notebooks get a second youth — Meta explained how they schedule Jupyter Notebooks in production , Google announced the BigQuery studio with embedded Notebooks in the UI and Jupyter released Jupyter AI (you call it with %ai ) to bring Gen AI to the notebook.

Food 130

Food Data SQL Python 130

Engineering at Meta

APRIL 11, 2024

The post Building new custom silicon for Meta’s AI workloads appeared first on Engineering at Meta.

Building 62

Building Engineering 62

Christophe Blefari

APRIL 21, 2023

If this picture had been generated with AI it would have been boring ( credits ) Dear readers, I hope you're doing good. Gen AI 🤖 If you want to understand LLMs there is a note that has been written by an experts office of the French gov. fal-ai/isolate — Yet another package manager in Python. Which is crazy.

Raw Data 130

Raw Data Data Datasets SQL 130

Engineering at Meta

JANUARY 18, 2024

At Meta, the quest for faster model training has yielded an exciting milestone: the adoption of Lazy Imports and the Python Cinder runtime. At Meta, we’ve been able to significantly improve our model training times, as well as our overall developer experience (DevX) by adopting Lazy Imports and the Python Cinder runtime. The outcome?

Machine Learning 82

Machine Learning Python Coding Education 82

Engineering at Meta

JANUARY 27, 2023

At Meta, we’ve found that these challenges broadly fall into three themes: 1.) Data center networking: Over the past decade, on the physical front, we have seen a rise in vendor-specific hardware that comes with heterogeneous feature and architecture sets (e.g., non-blocking architecture).

Engineering 126

Engineering Software Engineer Software Engineering Transportation 126

Christophe Blefari

JULY 15, 2023

Gen AI 🤖 Elon Musk announced xAI , his new company, to show that he's better than the rest. He hired alumni from all the AI companies (e.g. Shopify introduce Sidekick — Once again Gen AI is a Copilot. Gen AI used as a Copilot. So it will be for later. Deep Mind, Google, OpenAI, etc.).

Datasets 130

Datasets Python Machine Learning Data 130

Data Engineering Weekly

APRIL 21, 2024

Meta: Introducing Meta Llama 3 - The most capable openly available LLM to date Meta is taking an interesting approach in the growing LLM market with the open source approach and distribution across all the leading cloud providers and data platforms. It is exciting to see Llama 3 with 70B parameters on par with GPT-3.5,

Data Engineering 52

Data Engineering Data Engineer Engineering Medical 52

Engineering at Meta

FEBRUARY 7, 2023

We’re Meta now, but our mission remains the same: Giving people the power to build community and bring the world closer together. Across Meta, our family of applications (Facebook, Instagram, WhatsApp, among others) are using our basemap to connect people through functions like status updates, location sharing, and location-based searching.

Entertainment 134

Entertainment Transportation Data Schemas AWS 134

Snowflake

MARCH 5, 2024

Because human-machine interaction using natural language is now possible with large language models (LLMs), more data teams and developers can bring AI to their daily workflows. So how does Snowflake Cortex make AI easy, whether you are doing prompt engineering or RAG? Let’s dive into the details and check out some code along the way.

Government 93

Government AWS Data Preparation Data Governance 93

Data Engineering Weekly

APRIL 14, 2024

Meta: OpenEQA - From word models to world models Will AI agents soon become a common fixture in our homes and an integral part of our daily lives? link] Aishwarya Srinivasan: How Microsoft's 1-bit LLM is going to change the LLM landscape?

Data Engineering 62

Data Engineering Data Engineer Engineering Business Intelligence 62

Christophe Blefari

JUNE 3, 2023

Gen AI 🤖 As always the pace of innovation in this field is incredibly fast so here a few news I've seen I found worth it: Japan goes all in: copyright doesn’t apply to AI training — I'm far from being a law expert but it looks like something that will create precedence. Surprising.

Data Pipeline 130

Data Pipeline Data SQL Algorithm 130

Christophe Blefari

APRIL 8, 2023

Gen AI 🤖 It seems that Samsung employees leaked data to ChatGPT — Unsurprisingly OpenAI saves all the prompts we type (🫠) and can eventually improve models incrementally. In order to run Vicuna (or other similar open-source models) you need to get the weights from the LLaMA Meta foundation 65B params model.

Pipeline-centric 130

Pipeline-centric Database-centric Algorithm Data 130

Christophe Blefari

APRIL 8, 2023

Gen AI 🤖 It seems that Samsung employees leaked data to ChatGPT — Unsurprisingly OpenAI saves all the prompts we type (🫠) and can eventually improve models incrementally. In order to run Vicuna (or other similar open-source models) you need to get the weights from the LLaMA Meta foundation 65B params model.

Pipeline-centric 130

Pipeline-centric Database-centric Algorithm Data 130

Christophe Blefari

OCTOBER 9, 2023

Gen AI 🤖 OpenAI’s plan to build the "iPhone of artificial intelligence" — Obviously this is one of the main struggle for OpenAI. ❤️ Generative AI exists because of the transformer — A scroll story by the Financial Times explaining what's Generative AI.

Python 130

Python Data Database Java 130

Christophe Blefari

FEBRUARY 16, 2024

Last few days have been heavily packed with AI News as well. Next Wednesday I will participate to a Data Night Talk a open discussion about AI & data engineering with other content creators. ✨ Second, I'm partnering with La Conférence MLOps , a half-day conference on the challenges of industrializing AI.

Food 130

Food Data SQL Government 130

Engineering at Meta

APRIL 11, 2024

An engineer shares how his team is building the foundation for AI infrastructure at Meta, from physical data centers to training AI models.

Building 49

Building Engineering Data 49

Christophe Blefari

DECEMBER 3, 2022

A bot that watched 70,000 hours of Minecraft could unlock AI’s next big thing — Yes, generative models are fun, but I've you watched imitative or reinforcement learning? Obviously Meta is Meta and they redeveloped everything from the ground up. This article by the Preset team is a good introduction.

Kafka 130

Kafka BI Finance Data 130

Christophe Blefari

SEPTEMBER 15, 2023

Gen) AI News 🤖 Reinforcement Learning: an easy introduction to value iteration — Title says easy, but the article contains maths formula. HuggingFace CEO and co-founder opening statement at AI insight forum — This week US AI giants went to a 6-hours private meeting with 60 US senators to explore AI regulation.

Data Warehouse 130

Data Warehouse Data SQL Python 130

Christophe Blefari

MAY 6, 2023

Meta ones). And more traditional AI : YOLO-NAS a new object detection model — you should have seen already this model that detects people in real-time in videos. Mistral AI , a French Gen AI company, will probably raise €100m (link in French) in the following weeks.

Programming Language 100

Programming Language Data Python Data Warehouse 100

Snowflake

NOVEMBER 15, 2023

BUILD 2023 is where AI gets real. Register now to get access to sessions on AI and ML, Snowpark, Iceberg, streaming, Snowflake Native Apps and more. And this year we’ve added a new LLM Bootcamp with all the inside info you’ll need to build and deploy an AI-enriched app.

Building 109

Building Accessible Accessibility IT 109

KDnuggets

JULY 19, 2023

This article explores the technical details and implications of Meta's newly released Llama 2, a large language model that promises to revolutionize the field of generative AI.

IT 83

IT 83

Christophe Blefari

MARCH 17, 2023

It also means that if you have any questions that you want me to ask you can send them to me beforehand 🫠 Gen AI 🤖 I will create a specific category for generative AI. Politicians think we should work longer when we are slowly starting to discover new AI capabilities that will for sure impact workplaces.

Data 130

Data SQL Deep Learning Kafka 130

Christophe Blefari

JUNE 16, 2023

I'm now under the Berlin rain with 20° When I write in these conditions I feel like a tortured author writing a depressing novel while actually today I'll speak about the AI Act, Python, SQL and data platforms. AI 🤖 AI Act 🇪🇺 has been voted in the European parliament. Also called GDPR 2.0

Programming Language 130

Programming Language SQL PostgreSQL Data 130

Engineering at Meta

APRIL 11, 2024

An engineer shares how his team is building the foundation for AI infrastructure at Meta, from physical data centers to training AI models.

Building 40

Building Engineering Data 40

Knowledge Hut

NOVEMBER 17, 2023

In this article, we're embarking on a salary tour for AI Scientists, delving into country-specific average salaries in the US, the UK, Germany, China, India, and even the global average. The last decade has seen tremendous progress in improving artificial intelligence (AI) and its real-world applications.

Banking 52

Banking Deep Learning Amazon Web Services Computer Science 52

Engineering at Meta

APRIL 11, 2024

A Meta systems engineer shares how building and scaling our next generation MTIA chip will enable the future of AI.

Building 42

Building Engineering Systems 42