March, 2018

article thumbnail

MarketStore: Managing Timeseries Financial Data with Hitoshi Harada and Christopher Ryan - Episode 24

Data Engineering Podcast

Summary The data that is used in financial markets is time oriented and multidimensional, which makes it difficult to manage in either relational or timeseries databases. To make this information more manageable the team at Alapaca built a new data store specifically for retrieving and analyzing data generated by trading markets. In this episode Hitoshi Harada, the CTO of Alapaca, and Christopher Ryan, their lead software engineer, explain their motivation for building MarketStore, how it operat

article thumbnail

Introducing QALM, Uber’s QoS Load Management Framework

Uber Engineering

Much of Uber’s business involves connecting people with people, making the reliability of our customer platform crucial to our success. The customer platform supports everything from ridesharing and Uber Eats , to Uber Freight and Uber for Business. Our … The post Introducing QALM, Uber’s QoS Load Management Framework appeared first on Uber Engineering Blog.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

The Art of Ontology

Zalando Engineering

Introducing Semantic Web Technologies at Zalando Two years ago, in March 2016, the newly-opened Helsinki office wondered about the expressivity of our current product data. What do attributes like material construction or sport quality really mean, and how can we use them to create meaningful fashion experiences online for our customers? It was around that time that, after working for five years solely in the art sector and building digital strategies for various classical music organisations, I

Scala 52
article thumbnail

Disrupt and Innovate in a Data-Driven World

Cloudera

If you do an internet search for ‘data-driven disruption’ you can find articles about almost every industry being disrupted by digitalisation and new applications of data. Banking, transportation, healthcare, retail, and real estate, all have seen the emergence of new business models fundamentally changing how customers use their services. While there are instances of data-driven efforts in the nonprofit sector, they are not as widespread as they can be.

article thumbnail

Get Better Network Graphs & Save Analysts Time

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

article thumbnail

Recap of Hadoop News for February 2018

ProjectPro

News on Hadoop - February 2018 Kyvos Insights to Host Webinar on Accelerating Business Intelligence with Native Hadoop BI Platforms. PRNewswire.com, February 1, 2018. The leading big data analytics company Kyvo Insights is hosting a webinar titled “Accelerate Business Intelligence with Native Hadoop BI platforms.” on February 7, 2018 at 10 AM PST.

Hadoop 52
article thumbnail

Automagic reload for clients after deploy with Angular 4 (updated to work with Angular 7)

nodeSWAT

Most of the webpages I’ve built run around the idea that people come, do their things and then go away. This process is repeated for every time they need the functionalities provided by the site, be it an investment platform, e-shop or some sort of an administration tool. But what if the users don’t leave, ever? What if they keep the page open 24/7, without refreshing, re-logging or re-entering the site.

More Trending

article thumbnail

Scaling Infrastructure Management with Grail

Uber Engineering

To build and maintain infrastructure at scale, easy access to the current state of the system is paramount. As Uber’s business continues to expand, our infrastructure has grown in size and complexity, making it more difficult to get all the … The post Scaling Infrastructure Management with Grail appeared first on Uber Engineering Blog.

article thumbnail

Cross-Department Hackathons at Zalando

Zalando Engineering

Last week, at our new-format Zalando Hack Week , two important departments dropped their day-to-day tasks and embarked on what, for many of them, was their first ever hackathon. How did this come about? Zalando’s new Hack Week is a departure from the hackathons we have organised in the past, which typically only involved the tech department and happened once a year.

article thumbnail

Altus SDX: Shared services for cloud-based analytics

Cloudera

The real power in machine learning and analytics is when multiple analytics disciplines are able to work together in concert, sharing data in service of solving more complex and more valuable questions. That’s what Cloudera SDX (Shared Data Experience) enables for our customers and why we’re so excited to introduce it today for Cloudera Altus.

Cloud 40
article thumbnail

Database Refactoring Patterns with Pramod Sadalage - Episode 22

Data Engineering Podcast

Summary As software lifecycles move faster, the database needs to be able to keep up. Practices such as version controlled migration scripts and iterative schema evolution provide the necessary mechanisms to ensure that your data layer is as agile as your application. Pramod Sadalage saw the need for these capabilities during the early days of the introduction of modern development practices and co-authored a book to codify a large number of patterns to aid practitioners, and in this episode he

Database 100
article thumbnail

Understanding User Needs and Satisfying Them

Speaker: Scott Sehlhorst

We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.

article thumbnail

The Future Data Economy with Roger Chen - Episode 21

Data Engineering Podcast

Summary Data is an increasingly sought after raw material for business in the modern economy. One of the factors driving this trend is the increase in applications for machine learning and AI which require large quantities of information to work from. As the demand for data becomes more widespread the market for providing it will begin transform the ways that information is collected and shared among and between organizations.

Raw Data 100
article thumbnail

Discovering a Future in Tech

Zalando Engineering

How former Zalando trainee, Anriika Kauppi, found her calling Fresh out of high school, Anriika Kauppi, 19, was interested in becoming a teacher, but instead of taking the scholastic route, she did a summer traineeship at Zalando’s Helsinki Tech Hub. With a family background in tech, Anriika wanted to see what the field had to offer as a career. A year and a half later, she has lived abroad for three months, completed another internship in the tech field, and applied to study engineering.

Banking 40
article thumbnail

Introducing QALM, Uber’s QoS Load Management Framework

Uber Engineering

Much of Uber’s business involves connecting people with people, making the reliability of our customer platform crucial to our success. The customer platform supports everything from ridesharing and Uber Eats , to Uber Freight and Uber for Business. Our … The post Introducing QALM, Uber’s QoS Load Management Framework appeared first on Uber Engineering Blog.

article thumbnail

In Praise of TypeScript

Zalando Engineering

Insights on making NodeJS APIs great NodeJS is getting more and more popular these days. It’s gone through a long and painful history of mistakes and learning. By being a “window” for front-end developers to the “world of back-end,” it has improved the overall tech knowledge of each group of engineers by giving them the opportunity to write actual end-to-end solutions themselves using familiar approaches.

MongoDB 40
article thumbnail

Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You Need to Know

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

article thumbnail

Why MobX?

Zalando Engineering

Removing the burden of state management State management and change propagation are arguably some of the hardest challenges in GUI programming. Many tools promised to save us from their burden. Only a few remained. Among them is MobX and its flavor of Transparent Reactive Programming. To understand the appeal of MobX, it is helpful to first understand how React revolutionized GUI programming.

article thumbnail

Zalando Tech: Lisbon

Zalando Engineering

Engineering Lead, Michael Duergner on the company’s newest tech hub Now in its 10th year of operation, Zalando continues to focus on a smooth and inspiring digital experience for its customers with the opening of its latest tech hub in Lisbon , among other initiatives. We talk to engineering lead, Michael Duergner, who tells us more about the newest Zalando location and the company’s personalization plans.

article thumbnail

How to Spot a Bad Product

Zalando Engineering

Red flags to look out for in badly written projects. Let’s talk about common red flags or alternatively, how to define badly-written project. Many of us have experienced a project which is crying and begging for something drastic to change, or even for it to be put out of its misery altogether, but alas; we don’t have the heart or the resources to “pull the plug” as it were.

Project 40
article thumbnail

Just Run a Game Day

Zalando Engineering

Scaling operational excellence Zalando is iterating our production incident handling process. The previous process had a dedicated Tier One 24/7 team who coordinated the incident response communication while escalating to the service-owning Tier Two team(s) for a resolution. That has been rationalized to those service-owning teams handling their incident flow, from alert to post-mortem to reduce time to resolution.

AWS 40
article thumbnail

Peak Performance: Continuous Testing & Evaluation of LLM-Based Applications

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.