Remove docs support config-files
article thumbnail

The Docker Compose of ETL: Meerschaum Compose

Towards Data Science

How Compose Tames the Engine With great power comes great responsibility, and in Docker’s case, this responsibility is handled by a manifest file called docker-compose.yml which describes how services within an application should run. mrsm compose explain Parses the Compose file and prints the current environment and status of defined pipes.

article thumbnail

CLI User Experience Case Study: Topiary

Tweag

Usage: topiary [OPTIONS] <--language <LANGUAGE>|--input-files [<INPUT_FILES>.]> Options: -l, --language <LANGUAGE> Which language to parse and format [possible values: json, nickel, ocaml, ocaml-interface, ocamllex, toml] -f, --input-files [<INPUT_FILES>.] Path to an input file or multiple input files.

Coding 64
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Optimizing Materialized Views with dbt

dbt Developer Hub

Jetblue has outgrown lambda views due to performance constraints (a view can only be so performant) and we are at another milestone in dbt’s journey to support streaming. Today we are announcing that we now support Materialized Views in dbt. dbt-bigquery support will be coming in 1.7. So, what does that mean? In production? (If

article thumbnail

ConsoleMe: A Central Control Plane for AWS Permissions and Access

Netflix Tech

This is an amazing movement providing numerous opportunities for product innovation, but managing this growth has introduced a support burden of ensuring proper security authentication & authorization, cloud hygiene, and scalable processes. Weep supports the following methods of serving credentials: Write credentials to a user’s ~/.aws/credentials

AWS 100
article thumbnail

Migrate Hive data from CDH to CDP public cloud

Cloudera

Using easy-to-define policies, Replication Manager solves one of the biggest barriers for the customers in their cloud adoption journey by allowing them to move both tables/structured data and files/unstructured data to the CDP cloud of their choice easily. The Replication Manager support matrix is documented in our public docs.

Cloud 71
article thumbnail

Data engineers + dbt v1.5: Evolving the craft for scale

dbt Developer Hub

dbt brought code-based tests, integrated CI, efficient development with packages, and global docs. features aim to support the growth of those type of dbt projects by going back to the roots of software engineering best practices—dbt v1.5 is bringing service oriented architectures to a dbt project near you.

article thumbnail

Building CI/CD with Airflow, GitLab and Terraform in GCP

Ripple Engineering

You use a.gitlab-ci.yml file in a repo to define the CI/CD settings to invoke based on the triggers you define. But, at the time of writing, GCP Build does not support GitLab or generic git repositories and solely integrates with Cloud Service Repositories and GitHub. hooks: - id: seed-isort-config - repo: [link] rev: v4.3.21