Snowflake

MARCH 15, 2023

If you’re already an avid docs user, don’t worry—your bookmarks will continue to work. Snowflake Documentation is now a comprehensive resource for developers building and developing on top of Snowflake. The docs site helps curate the latest features with homepage highlights and easy access to the Releases section.

Accessible 52

Accessible Accessibility Project Building 52

ThoughtSpot

AUGUST 22, 2023

That said, we understand how frustrating it is to get stuck in the middle of finding an answer, solving a problem, or building an important report. However, we do make self-service resources available through our thorough Docs , Community , and eLearning resources for those who prefer to work solo.

Data 80

Data Designing Accessible Accessibility 80

Knowledge Hut

SEPTEMBER 21, 2023

When building and growing new apps or using them to run existing apps on the public cloud, users have a choice between these services. Participated in a tech community volunteer project to help build up Azure resources for a charity event's website. Windows Azure, is Microsoft's public cloud computing platform.

Cloud 52

Cloud Amazon Web Services Cloud Computing AWS 52

Data Engineering Weekly

MARCH 19, 2023

Try it free Netflix: Building a Media Understanding Platform for ML Innovations Netflix recently wrote a series of blogs about its media ML platform. The blog narrates how Expedia with nine ML systems with no unified way to build and deploy to standardize the infrastructure by adopting build → optimize → enhance methodologies.

Data Engineering 57

Data Engineering Data Engineer Engineering Media 57

Towards Data Science

JULY 10, 2023

A simple framework for building dbt models that actually get used. When I was researching the Ultimate Guide to dbt , I was shocked by the lack of material around actually building models from scratch. Step 1 of which is to go learn as much about the business process as you can before you even think about building a model.

Designing 98

Designing Electronics Engineering Coding 98

dbt Developer Hub

MAY 9, 2022

The main goal of this article is to spread awareness of these endpoints as the docs are being built & show you how to use them. Please keep in mind that the collection is not an evergreen doc. Please keep in mind that the collection is not an evergreen doc. Note that this assumes you already have both projects set up.

Cloud 52

Cloud Management Government Data Warehouse 52

Knowledge Hut

MARCH 27, 2024

In the modern business world, which is characterized by constant change and a high level of competition, project management constitutes a central part of the process that permits companies to fulfill their targets and accomplish their goals. What is Google Project Management Certification? What is PMP?

Project 52

Project Management Certification Education 52

dbt Developer Hub

MAY 16, 2022

Analytics engineers (AEs) are constantly navigating through the names of the models in their project, so naming is important for maintainability in your project in the way you access it and work within it. In the Project view, they will see the data models in the folder hierarchy present in your project’s repository.

BI 52

BI Data Warehouse Database SQL 52

dbt Developer Hub

FEBRUARY 7, 2022

You can follow along with Donny's data modeling technique for identity resolution in this dbt project repo. It includes a set of demo CSV files, which you can use as dbt seeds to test Donny's project for yourself. To do so, they want to build out their sales motion to target companies with active gaggles. Builder Beware!

Data Warehouse 52

Data Warehouse Datasets Data SQL 52

Data Engineering Podcast

JANUARY 26, 2020

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. __init__ 2 years ago?

Data Pipeline 100

Data Pipeline PostgreSQL Media Data Validation 100

Data Engineering Weekly

OCTOBER 1, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. See how it works today. Dropbox: Is this a date? The Activation API sits on top of that Redis instance."

Data Engineering 52

Data Engineering Data Engineer Engineering Data Pipeline 52

Data Engineering Podcast

JANUARY 14, 2017

Pachyderm is a platform for building a data lake with a versioned file system. This week Daniel Whitenack shares the story of how the project got started, how it works under the covers, and how you can get started using it today! What is pachyderm and what problem were you trying to solve when the project was started?

Data Lake 100

Data Lake Raw Data Kafka Data Pipeline 100

Data Engineering Podcast

MAY 19, 2019

Summary In recent years the traditional approach to building data warehouses has shifted from transforming records before loading, to transforming them afterwards. The data build tool (dbt) is designed to bring battle tested engineering practices to your analytics pipelines. When is it the wrong choice?

Data Analytics 100

Data Analytics Building Engineering Data Warehouse 100

Picnic Engineering

FEBRUARY 1, 2023

Without a smooth build and test setup teams lose productivity and everything grinds to a halt. While doing that we standardized our pipelines, reduced the build/queue time, and took control of our build agent hardware and environment. to build our largest repo. Turns out, that was not the case. Quite impressive right?

AWS 64

AWS Cloud Project Building 64

Cloudera

JANUARY 31, 2024

It forms a foundational element for building robust and reliable distributed architectures. While aggregation is the main use case for prefixless replication, it can also be used to build traditional replication pipelines that provide a safety net for your Kafka data if things go amiss. This is the first part of a two-blog series.

Management 69

Management Kafka Big Data Cloud 69

dbt Developer Hub

APRIL 30, 2023

I kept looking for goldilocks projects to save/make money for companies. I wanted to build prestige in my career. dbt brought code-based tests, integrated CI, efficient development with packages, and global docs. Tristan has written extensively about this , but a few years ago, a big dbt project was ~500 models.

Data Engineering 64

Data Engineering Data Engineer Engineering Finance 64

Knowledge Hut

MAY 3, 2023

Project Managers are usually trained and advised to think of the possible scenarios or situations that could cause obstructions and constrictions, which could hinder a successful project execution. Collectively, Resource Management Plan deals with identifying and planning the effective use of resources required by the project.

Management 52

Management IT Certification Project 52

Monte Carlo

MAY 18, 2023

We’ve written extensively on how to analyze the build vs buy decision across the modern data stack, but it’s important to speak specifically about open source data lineage options. Our team attempted to leverage Spline (one of the open source data lineage tools listed here) as a building block. Ok, that is enough caveat emptor.

Metadata 64

Metadata Data Lake Government Data Governance 64

DataKitchen

JANUARY 18, 2023

Green fields smell sweet, and a nice long design phase can give you a rosy view of your project. By automating your tests, then running them with each refresh, you build in safety valves for your data pipeline. . The alternative is to acknowledge that the primary source of your docs will always be your data structures and code.

Data Pipeline 52

Data Pipeline Data AWS Data Engineering 52

Knowledge Hut

SEPTEMBER 28, 2023

This is where IT project managers come in – a role that's in high demand. In India, IT project managers usually earn an average annual salary ranging from ₹10 lakh to ₹23 lakh, making it an attractive career choice. Who is an IT Project Manager and What Do They Do? How to Become an IT Project Manager in Simple Steps?

Project 52

Project IT Management Computer Science 52

dbt Developer Hub

MARCH 9, 2022

Special Thanks: Emilie Schario, Matt Winkler dbt has done a great job of building an elegant, common interface between data engineers, analytics engineers, and any data-y role, by uniting our work on SQL. This eventually leads to projects becoming unusable and forgotten. Should we increase the SQL surface area to build ML models?

Machine Learning 52

Machine Learning Raw Data SQL Python 52

dbt Developer Hub

JULY 2, 2023

is a data modeling technique designed to help scale large data warehousing projects. Have you experienced a data warehousing project with 50+ data sources, with 25+ data developers working on the same data platform, or data spanning 5+ years with two or more generations of source systems? Data Vault 2.0 So why Data Vault?

Cloud 52

Cloud Data Warehouse Data BI 52

dbt Developer Hub

JANUARY 23, 2023

Building views on top of the base table to split tests by owner or severity, and creating visualizations using our tool of choice. All of our tests are aliased according to a specific naming convention so that we know the table names they will put data into, and we have modified our dbt project config to set store_failures true for all tests.

Metadata 52

Metadata High Quality Data SQL Data Integration 52

Grouparoo

DECEMBER 13, 2021

Giving a Grouparoo App the power to check the data warehouse for a specific query and trigger its Schedules whenever new data is found opens up new opportunities for integrating with projects that are already performing robust ELT processes. Browse or fork our dbt example project here This example project uses a Postgres database.

Metadata 52

Metadata Data Warehouse SQL Utilities 52

Knowledge Hut

NOVEMBER 22, 2023

Creative projects play a significant role in shaping an organization’s brand and visibility. In this post, we will discuss in detail how to become a creative project manager, Project Management prerequisites , roles and responsibilities, skills, creative project manager jobs and much more.

Project 52

Project Management Certification Portfolio 52

Rockset

NOVEMBER 4, 2021

Apache Spark is an open-source project that was started at UC Berkeley AMPLab. Here are some examples of the things you can do in your apps with Apache Spark: Build continuous ETL pipelines for stream processing SQL BI and analytics Do machine learning, and much more! How do you build a data application with Apache Spark and Rockset?

Scala 52

Scala Java AWS Hadoop 52

Grouparoo

OCTOBER 26, 2020

That isn’t to say writing docs is the best approach for all instances, but it’s a solid default stance to take. Default to open When we decided to build an open-source product, we found ourselves asking over and over again “should this feature be open-source/free or paid?” Most recently we played some Settlers of Catan!

Programming 52

Programming Project Building Process 52

Monte Carlo

SEPTEMBER 6, 2022

With these integrations, data teams can extend end-to-end data observability to their data lakehouse to ensure high-quality and trustworthy data to power data science, machine learning, and big data analytics projects and workloads. Check out the docs to learn more. Learn how in the docs. Ready to turn this on for your team?

Data Lake 52

Data Lake Machine Learning Data Science Data 52

Grouparoo

MAY 11, 2021

Let's build him a pipeline to get data from Google Sheets to flow automatically into Mailchimp. Start by installing the grouparoo package from NPM globally, moving to whatever folder you want the project to live in, and initiating a new project. the-folder-that-my-grouparoo-project-will-live-in grouparoo init.

Data Pipeline 52

Data Pipeline Data Project Utilities 52

Ripple Engineering

FEBRUARY 2, 2021

This means we need to build better, more configurable and more collaborative tooling that prevents code collisions and enforces software engineering best practices. But, at the time of writing, GCP Build does not support GitLab or generic git repositories and solely integrates with Cloud Service Repositories and GitHub. py}" -.gitlab-ci.yml

Building 52

Building Python Google Cloud Coding 52

dbt Developer Hub

JANUARY 14, 2023

The tools: I want to be able to run my project on Google Cloud Functions due to the generous free tier. dlt integrates well with dbt and enables fast and simple data ingestion, making this project simpler than I thought it would be. dlt is a new Python library for declarative data ingestion which I have wanted to test for some time.

Data Ingestion 52

Data Ingestion Google Cloud Python Cloud 52

Rockset

SEPTEMBER 8, 2021

At Rockset, we work hard to build developer tools (as well as APIs and SDKs) that allow you to easily consume semi-structured data using SQL and run sub-second queries on real-time data. We believe this will help build a more supportive Rockset community. Rockset’s community is just getting started ?.

SQL 52

SQL Data Ingestion Consulting Data Pipeline 52

Knowledge Hut

APRIL 12, 2023

For example, you want to build a Customer Relationship Management (CRM) application with advanced automated lead management capabilities. Understanding the meaning of MVP will help you build a valuable yet minimal version of your product. MVP is a valuable technique to ensure you get clear ideas about how best to build the product.

Certification 52

Certification Utilities Building Project 52

dbt Developer Hub

AUGUST 2, 2023

Materialized views are now an out of the box materialization in your dbt project once you upgrade to the latest version of dbt v1.6 Materialized views, just like any other materialization, fit a need and you should utilize them while taking into consideration the additional complexity they will add to your project.

Datasets 52

Datasets Kafka SQL Cloud 52

Edureka

FEBRUARY 17, 2023

From recognising accomplishments to encouraging collaboration, these tactics will help you build stronger relationships with your team and boost company morale. No one wants to feel like they’re just doing busy work, so make sure their projects are challenging yet achievable.

Media 52

Media Programming Education Management 52

Zalando Engineering

NOVEMBER 19, 2023

And even if you were to gather all the information from the docs, it's still not enough. Origami builds on top of Elasticsearch and our internal/Zalando-specific suite of APIs. As always after a big project, we had a retrospective, and the team was pretty happy with the results. In Zalando, the size of data is pretty massive.

Scala 86

Scala Java Coding IT 86

dbt Developer Hub

NOVEMBER 28, 2021

So I challenge you after reading this article to test out your skillsets, think about the code that you find yourself reusing again and again, and build a package. A dbt package is basically a mini-dbt project. The only mandatory file that it requires is a dbt_project.yml to validate that it’s a dbt package (same as any dbt project).

Building 52

Building SQL Coding Datasets 52