article thumbnail

dbt multi-project collaboration

Christophe Blefari

cross-project dependencies ( credits ) Over the last few years, dbt has become a de facto standard enabling companies to collaborate easily on data transformations. Whatever the number, there will be a critical point at which a single project no longer scale. Cross-project references is a key enabler to data team decentralisation.

Project 264
article thumbnail

An educational side project

The Pragmatic Engineer

I’d like to share a story about an educational side project which could prove fruitful for a software engineer who’s seeking a new job. Juraj created a systems design explainer on how he built this project, and the technologies used: The systems design diagram for the Rides application The app uses: Node.js

Education 363
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Kafka to MongoDB: Building a Streamlined Data Pipeline

Analytics Vidhya

Introduction Data is fuel for the IT industry and the Data Science Project in today’s online world. We know that streaming data is data that is emitted at high volume […] The post Kafka to MongoDB: Building a Streamlined Data Pipeline appeared first on Analytics Vidhya.

MongoDB 217
article thumbnail

Build Better Tests For Your dbt Projects With Datafold And data-diff

Data Engineering Podcast

Summary Data engineering is all about building workflows, pipelines, systems, and interfaces to provide stable and reliable data. Datafold has invested a lot of time into integrating with the workflow of dbt projects to add early verification that the changes you are making are correct. What are the parallels to that in data projects?

Project 130
article thumbnail

The Essential Guide to Building Analytic Applications

What should product managers keep in mind when adding an analytics project to their roadmap? Download this eBook to discover insights from 16 top product experts, and learn what it takes to build a successful application with analytics at its core.

article thumbnail

Build Data Engineering Projects, with Free Template

Start Data Engineering

Data project template 2.1. Introduction 2. Prerequisites 2.2. Setup infra 2.3. Tear down infra 3. Set up data infrastructure 3.1. Run data infra on your laptop with containers 3.2. Manage cloud infrastructure with code 4. Set up development workflow 4.1. CI: Automated tests & checks before the merge with GitHub Actions 4.2.

Project 147
article thumbnail

How To Build and Open Source PYPI Python Package

Confessions of a Data Guy

Ever wondered how to build and end-to-end project for an Open Source Python Package that gets published to PYPI? link] The post How To Build and Open Source PYPI Python Package appeared first on Confessions of a Data Guy.

Python 100
article thumbnail

3 Challenges of Building Complex Dashboards with Open Source Components

Speaker: Ryan MacCarrigan, Founding Principal, LeanStudio

Watch this webinar with Ryan MacCarrigan, Founding Principal of LeanStudio, to learn about key considerations for launching your next analytics project. But what happens when you have a growing user base and additional feature requests?

article thumbnail

How to Find and Test Assumptions in Product Development

Watch this webinar with Laura Klein, product manager and author of Build Better Products, to learn how to spot the unconscious assumptions which you’re basing decisions on and guidelines for validating (or invalidating) your ideas. You'll learn: Why every product leader goes into a new project with untested, hidden assumptions.

article thumbnail

The Definitive Guide to Embedded Analytics

We hope this guide will transform how you build value for your products with embedded analytics.

article thumbnail

New Study: 2018 State of Embedded Analytics Report

Why do some embedded analytics projects succeed while others fail? We surveyed 500+ application teams embedding analytics to find out which analytics features actually move the needle. Read the 6th annual State of Embedded Analytics Report to discover new best practices. Brought to you by Logi Analytics.

article thumbnail

Modern Data Architecture for Embedded Analytics

Every data-driven project calls for a review of your data architecture—and that includes embedded analytics. Download the whitepaper to see the 7 most common approaches to building a high-performance data architecture for embedded analytics.

article thumbnail

Why “Build or Buy?” Is the Wrong Question for Analytics

Every time an application team gets caught up in the “build vs buy” debate, it stalls projects and delays time to revenue. Partnering with an analytics development platform gives you the freedom to customize a solution without the risks and long-term costs of building your own. There is a third option.