Data Engineering Weekly

NOVEMBER 27, 2022

I have a long list of thoughts on this conversation, which might need a blog post on its own. link] Airbnb: Building Airbnb Categories with ML and Human-in-the-Loop Data & Machine Learning are increasingly powering the applications and driving user experience. I want to address one comment in the conversation.

Data Engineering 52

Data Engineering Data Engineer Engineering SQL 52

Knowledge Hut

MARCH 20, 2024

While some tasks naturally follow others due to constraints or logical necessity, there exists a category of dependencies known as discretionary dependency. In this blog, I will explain the intricacies of discretionary dependency and its implications for effective project management, with examples and tips on how to use it effectively.

Project 52

Project Management Pharmaceutical Manufacturing 52

Data Engineering Weekly

FEBRUARY 26, 2023

the addition of the “Fully Managed” category is an exciting space to watch out for. link] Funding Circle: Data Engineering Culture @ FC Many companies show their technical excellence in their blogs. All views expressed in this newsletter are my own and do not represent current, former, or future employers’ opinions.

Data Engineering 57

Data Engineering Data Engineer Engineering Raw Data 57

Palantir

APRIL 9, 2021

This is the third in a series of blog posts on scaling git’s merge and rename detection machinery. You might note that the previous blog post in this series essentially fell into the approximate solution category. In my opinion, this is the best of all the optimizations I did. Click to read the first and second posts.

Computer Science 52

Computer Science Algorithm Software Engineer Software Engineering 52

ProjectPro

SEPTEMBER 6, 2021

The projects have been divided into categories so that you can quickly pick one as per your requirements. Project Idea: Casual opinion of a business often unexpectedly affects the businesses’ stock prices. In this article, you will find a list of interesting web scraping projects that are fun and easy to implement.

Project 52

Project Programming Language Entertainment Python 52

Monte Carlo

JULY 7, 2022

You can read more about Convoy’s approach from our blog with their Head of Product, Data Platform, Chad Sanderson, “ The modern data warehouse is broken.” Once the contract was developed they could select from a range of tooling, not have to conform to our opinions about how the data was structured, and really control their own destiny.

Data Warehouse 52

Data Warehouse Software Engineer Software Engineering Data 52

Data Engineering Podcast

MAY 7, 2023

What are some of the categories of attributes that need to be managed in a prototypical customer profile? Let us know if you have opinions there! Contact Info Kevin LinkedIn Blog Hanhan LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Pipeline-centric 130

Pipeline-centric Data Lake Machine Learning Data Warehouse 130

ProjectPro

OCTOBER 18, 2021

They have a well-researched collection of data such as ratings, reviews, timestamps, price, category information, customer likes, and dislikes. Most users go to social media to convey their personal views, opinions and share feelings through images and words. Use libraries like NumPy, Pandas, Matplotlib, Theano, etc.,

Machine Learning 52

Machine Learning Project Datasets Algorithm 52

ProjectPro

FEBRUARY 19, 2021

Considering you are no Lord of Thunder and you have no control over the weather, how will you decide whose opinion to take more seriously, keeping in mind the fact that you are impartial towards both? Ordinal variables are categorical variables, but the categories are ordered/ranked like Low, Moderate, High.

Machine Learning 40

Machine Learning Datasets Algorithm Data Science 40

Christophe Blefari

AUGUST 4, 2023

As a disclaimer, this may not quite make sense in a corporate context, but since this is my blog, I'll do what I want. My opinion on the matter is this: all clouds are born equal, you just have to find the one you're most comfortable with, or suffer your company's choices. What will you do in LLM category?

Google Cloud 225

Google Cloud MongoDB NoSQL Data 225

LinkedIn Engineering

JULY 19, 2023

In this blog post, we will discuss the guiding principles outlined for OpenHouse and the northstar UX when interfacing with OpenHouse tables. Having full control allows the control plane to be opinionated about management aspects such as data organization, transactional semantics, security, high availability, disaster recovery, and quotas.

Big Data 78

Big Data Data Management Management Metadata 78

Data Engineering Weekly

MAY 28, 2023

Cowboy ventures unbundle the various categories of Generative AI infra stack here. The blog narrates the working on the event collector, writing to Kafka, and the S3 storage with Lambda triggers. They are not a separate category. In Q1 2023, a whopping $1.7B was invested into gen AI startups.

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52

Knowledge Hut

NOVEMBER 28, 2023

FiveThirtyEight American website FiveThirtyEight specializes in opinion poll analysis, politics, economics, and sports blogging in the country. It also encourages users to add a dataset or example of how to use a dataset in the registry. Link to Dataset 2. Statistician Nate Silver founded FiveThirtyEight.

Datasets 96

Datasets Data Science Project Banking 96

dbt Developer Hub

OCTOBER 11, 2022

This blog contains our early best practice recommendations for metrics in two key areas: Design : What logic goes into metrics and how to use calculations, filters, dimensions, etc. However, this is still a relatively new part of the dbt toolbox and you probably have a lot of questions on how exactly you can do that.

Designing 52

Designing Finance Datasets Coding 52

ProjectPro

JANUARY 31, 2023

Read this blog to learn more about how the insurance industry benefits from implementing AI and ML solutions, which highlights the most practical applications and real-world use cases of machine learning in insurance and how it brings a new level of precision and effciency to the industry.

Insurance 75

Insurance Machine Learning Project Algorithm 75

Rockset

DECEMBER 19, 2023

This blog post distills his decade of experience into a comprehensive read, offering a detailed overview of the complexities and innovations at every stage of building a real-world recommender system.

Systems 52

Systems Machine Learning Deep Learning Media 52

ProjectPro

JULY 27, 2021

This blog is your one-stop solution for the top 100+ Data Engineer Interview Questions and Answers. In this blog, we have collated the frequently asked data engineer interview questions based on tools and technologies that are highly useful for a data engineer in the Big Data industry. that leverage big data analytics and tools.

Data Engineering 40

Data Engineering Data Engineer Engineering Hadoop 40

Data Engineering Weekly

APRIL 9, 2023

The blog also discusses two burning questions everyone is debating. This isn't a shift from the cloud; it is a platform shift within a different category, but it has the same potential to change how we build and deliver software fundamentally. [link] Download the full report: [link] Confused bit: Simply explained: how does GPT work?

Data Engineering 52

Data Engineering Data Engineer Engineering AWS 52

Netflix Tech

JANUARY 25, 2022

In fact, most of the material from this blog series has been adapted from our internal Experimentation 101 and 201 classes, which are open to anyone at Netflix. We’ve also invested in education programs to up-level company-wide understanding of how we use A/B tests as a framework for product development.

Education 95

Education Entertainment Programming Designing 95