Zalando Engineering

JULY 27, 2016

It happens mainly because the libraries you are including in your project may contain extra elements in their manifests, which will be blended with permissions requested in your manifest file (see The Commons Blog for more details). To check your manifest before the APK build, we can use a new feature presented in Android Studio 2.2:

Metadata 40

Metadata Coding Java Project 40

Confluent

SEPTEMBER 26, 2019

Rockset supports JDBC and integrates with other SQL dashboards like Tableau, Grafana, and Apache Superset. ® , Go, and Python SDKs where an application can use SQL to query raw data coming from Kafka through an API (but that is a topic for another blog). Apache Kafka as an event streaming platform for real-time analytics.

Kafka 20

Kafka BI SQL Datasets 20

Pinterest Engineering

JULY 25, 2023

Each dataset needs to be securely stored with minimal access granted to ensure they are used appropriately and can easily be located and disposed of when necessary. Consequently, access control mechanisms also need to scale constantly to handle the ever-increasing diversification.

Accessible 95

Accessible Accessibility Big Data Hadoop 95

Knowledge Hut

DECEMBER 28, 2023

Web development language is the backbone of the internet, powering everything from simple blogs to complex online applications. It is a superset of JavaScript and gives the language optional static typing. With so many programming languages available, it can be daunting to choose the right one for your project.

Programming Language 52

Programming Language Java Python SQL 52

Maxime Beauchemin

FEBRUARY 28, 2017

In The Rise of the Data Engineer , Maxime defined data engineering as: The data engineering field could be thought of as a superset of business intelligence and data warehousing that brings more elements from software engineering. With a brief Introduction and Takeaway added by Taylor D.

Data Engineering 130

Data Engineering Data Engineer Engineering Data Pipeline 130

Rockset

JUNE 8, 2023

The cost of provisioned write capacity grows linearly with the number of GSIs configured, making it cost prohibitive to use many GSIs to support many access patterns. For a more detailed examination of using DynamoDB secondary indexes for analytics, see our blog Secondary Indexes For Analytics On DynamoDB.

NoSQL 52

NoSQL AWS SQL Database 52

Rockset

FEBRUARY 25, 2021

Rockset, on the other hand, provides full-featured SQL and an API endpoint interface that allows developers to quickly join across data sources like DynamoDB and Kafka. Often this lack of structure forces developers to spend a lot of their time engineering ETL and data pipelines so that analysts can access the complex datasets.

SQL 40

SQL Data Pipeline Kafka Database 40

Rockset

NOVEMBER 6, 2019

In this blog, we will examine the use of three different data backends for event data - Apache Druid , Elasticsearch and Rockset. Supporting separation of data access (read/write) mechanisms like CQRS. Events are messages that are sent by a system to notify operators or other systems about a change in its domain.

Kafka 40

Kafka Data Lake SQL Hadoop 40

Rockset

DECEMBER 20, 2018

In this blog, I will show how Rockset can serve a live dashboard, which surfaces analytics on real-time Twitter data ingested into Rockset from a Kinesis stream. This API allows me to specify a list of terms that I want to include in my search (e.g. twitter api credentials access_token=. import boto3 kinesis = boto3.client('kinesis')

AWS 52

AWS Kafka Data Ingestion Data 52

ProjectPro

NOVEMBER 15, 2021

When any particular project is open-sourced, it makes the source code accessible to anyone. This blog will walk through the most popular and fascinating open source big data projects. The only pitfalls are lesser transparency and control, the limited scope of performance improvement tricks compared to other Apache APIs, and open bugs.

Big Data 52

Big Data Project Metadata Programming Language 52

Monte Carlo

JANUARY 23, 2024

One of the first data engineers at Facebook and Airbnb, he wrote and open sourced the wildly popular orchestrator, Apache Airflow , followed shortly thereafter by Apache Superset , a data exploration tool that’s taking the data viz landscape by storm. In the world of data engineering, Maxime Beauchemin is someone who needs no introduction.

Data Engineering 98

Data Engineering Data Engineer Engineering Data 98

Maxime Beauchemin

MARCH 8, 2021

Secondarily, we had a limited number of licenses for Tableau, and generally had an order of magnitude more employees that wanted/needed access to our internal than our contract allowed. In this blog post, I will explain why the future of business intelligence is open source. we were stirred towards using Tableau Extracts.

Business Intelligence 130

Business Intelligence BI Database-centric Google Cloud 130

Airbnb Tech

APRIL 30, 2021

We built an in-house data catalog, Dataportal , to organize and document our data and created, now open sourced, Apache Superset so more users could analyze data independently and interactively. This API serves a vital role in Airbnb’s next-generation data warehouse architecture. Core Product, Trust, Payments).

Data Warehouse 52

Data Warehouse Finance Metadata Aggregated Data 52