DoorDash Engineering

MARCH 7, 2023

As backend developers, we needed to stay unblocked while the infrastructure — in this case AWS resources — was being created. It was fair to assume that we would use other AWS services, particularly SQS and AWS Secrets Manager. Often we’re going from zero to one.

AWS 119

AWS PostgreSQL Database SQL 119

Knowledge Hut

NOVEMBER 17, 2023

Running your application in the AWS cloud can help you move faster and operate securely. AWS is vast and it's easy to get lost in the ocean of services and features it offers. This blog post will define AWS and provide you with tips to help you navigate some of its important services and discuss its advantages.

AWS 52

AWS Amazon Web Services Cloud Computing Consulting 52

Data Science Blog: Data Engineering

SEPTEMBER 19, 2023

In the contemporary age of Big Data, Data Warehouse Systems and Data Science Analytics Infrastructures have become an essential component for organizations to store, analyze, and make data-driven decisions. Infrastructure as Code (IaC) can be a game-changer in this scenario. Infrastructure as Code (IaC) can be a game-changer in this scenario.

Data Warehouse 52

Data Warehouse Coding Systems Cloud 52

ProjectPro

JUNE 16, 2022

An AWS data pipeline helps businesses move and unify their data to support several data-driven initiatives. Amazon Web Services (AWS) offers an AWS Data Pipeline solution that helps businesses automate the transformation and movement of data. AWS CLI is an excellent tool for managing Amazon Web Services.

Data Pipeline 59

Data Pipeline AWS Amazon Web Services Data Consolidation 59

Workfall

MARCH 21, 2023

Their ultimate goal is for the stored data to be easily retrievable, updated, queried, and generally administered via a graphical user interface (GUI), dashboard, or even command line interface (CLI). In this blog, we’ll explore: What is SurrealDB? This allows you to quickly and cheaply build secure and performant apps.

PostgreSQL 68

PostgreSQL NoSQL Database Unstructured Data 68

Towards Data Science

SEPTEMBER 5, 2023

The algorithm was designed to solve a complex optimisation problem that required some specific libraries installed in a Linux environment. This article describes how we approached this problem and what solution we came up with. The result is written to a storage location once completed. — Image

Algorithm 63

Algorithm Architecture Python Designing 63

Towards Data Science

SEPTEMBER 8, 2023

The algorithm was designed to solve a complex optimisation problem that required some specific libraries installed in a Linux environment. This article describes how we approached this problem and what solution we came up with. The result is written to a storage location once completed. — Image

Algorithm 52

Algorithm Architecture Python Designing 52

Rockset

JANUARY 17, 2020

In this blog we will set up a real-time SQL API on Kafka using AWS Lambda and Rockset. We will also show how to make the same API and query work for any of the teams in the NFL. Follow the directions below to set it up if you don’t have a Kafka installation to experiment with. There are 3 steps to get started.

Kafka 40

Kafka SQL AWS Accessible 40

Tweag

APRIL 19, 2023

As scary or awe-inspiring as it is, one can’t deny the great impact AI can have when applied to fields with positive social value, such as healthcare. Large Language Models (LLMs)… The list of hyped buzzwords goes on and on, even more so since ChatGPT made a wider audience realize what is now achievable.

Medical 60

Medical Process Cloud Bytes 60

Confluent

MAY 29, 2019

Now in part 2, we’ll discuss the challenges we faced developing, building, and deploying the KSQL portion of our application and how we used Gradle to address them. In part 3, we’ll explore using Gradle to build and deploy KSQL user-defined functions (UDFs) and Kafka Streams microservices. Introduction. Sample repository. gradlew composeUp.

Kafka 95

Kafka Management Bytes SQL 95

ProjectPro

JANUARY 24, 2023

This blog is your comprehensive guide to Google BigQuery, its architecture, and a beginner-friendly tutorial on how to use Google BigQuery for your data warehousing activities. Some excellent cloud data warehousing platforms are available in the market- AWS Redshift, Google BigQuery , Microsoft Azure , Snowflake , etc.

Bytes 52

Bytes Google Cloud Data Warehouse Datasets 52

phData: Data Engineering

JANUARY 3, 2022

DataOps: What Is It, Core Principles, and Tools For Implementation Nick Goble January 3, 2022 When building a successful company, it’s critical to have a strategy around how you build and scale your business from a technology and data perspective. Table of Contents How Impactful is Your Data? How do we minimize costs?

IT 52

IT AWS Software Engineer Software Engineering 52

ProjectPro

DECEMBER 10, 2021

This blog covers the top 50 most frequently asked Azure interview questions and answers. What makes Azure better than AWS? How many cloud service roles are provided by Azure? With AWS being the first, Microsoft Azure, Microsoft's cloud computing service, ranks as the second-largest market share in the United States.

BI 52

BI Cloud Computing SQL Database 52

ProjectPro

JUNE 29, 2021

This blog brings you the most popular Kafka interview questions and answers divided into various categories such as Apache Kafka interview questions for beginners, Advanced Kafka interview questions/Apache Kafka interview questions for experienced, Apache Kafka Zookeeper interview questions, etc. How to study for Kafka interview?

Kafka 40

Kafka Bytes Big Data Java 40

Cloudera

FEBRUARY 14, 2022

We not only enabled Spark-on-Kubernetes but we built an ecosystem of tooling dedicated to the data engineers and practitioners from first-class job management API & CLI for dev-ops automation to next generation orchestration service with Apache Airflow. . Auto scaling workloads on the fly leading to better hardware utilization.

Data Engineering 113

Data Engineering Data Engineer Engineering Data Pipeline 113