May, 2018

article thumbnail

The Alooma Data Pipeline With CTO Yair Weinberger - Episode 33

Data Engineering Podcast

Summary Building an ETL pipeline is a common need across businesses and industries. It’s easy to get one started but difficult to manage as new requirements are added and greater scalability becomes necessary. Rather than duplicating the efforts of other engineers it might be best to use a hosted service to handle the plumbing so that you can focus on the parts that actually matter for your business.

article thumbnail

Engineering a Job-based Forecasting Workflow for Observability Anomaly Detection

Uber Engineering

At Uber, we combine real-time systems monitoring with intelligent alerting mechanisms to ensure the availability and reliability of our apps. In our push to empower our engineers to author more accurate alerts, Uber’s Observability Applications team sought to introduce alert … The post Engineering a Job-based Forecasting Workflow for Observability Anomaly Detection appeared first on Uber Engineering Blog.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

AI at the Forefront of Digital Transformation Process in 2018

InData Labs

Digital Transformation Definition Digital transformation has been a big topic for a few years now, and it has many definitions. From a business perspective, digital transformation is about leveraging digital technologies to improve processes, competencies, and business models. It is also about changing the culture of the company because it requires letting go of old.

Process 52
article thumbnail

New on Cloud Academy: Machine Learning on Google Cloud and AWS, Big Data Analytics, Terraform, and more

Cloud Academy

A 2017 IDC White Paper “recommend[s] that organizations that want to get the most out of cloud should train a wide range of stakeholders on cloud fundamentals and provide deep training to key technical teams ” (emphasis ours). Regular readers of the Cloud Academy blog know we’ve been talking about this for a long time. Future-proofing your organization requires technical excellence, collective experience, business context, and shared understanding.

article thumbnail

From Developer Experience to Product Experience: How a Shared Focus Fuels Product Success

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

article thumbnail

Investing in the Future of Engineering and Design

Zalando Engineering

Our cooperation with CODE University At Zalando, we strive to create an environment in which all our engineers, product, and design specialists feel they can inspire each other, make their ideas a reality, and contribute to providing the best possible platform for Zalando’s customers to have the ultimate customer experience. Part of this is making sure we understand what the future generation of product managers, interaction designers, and software engineers are thinking and what ideas and innov

article thumbnail

Disrupting Everything in BI Analytics

Cloudera

Global Technology Partner of the Year. A Cloudera contingent, including Business Development, Marketing, Sales, and Software Engineering just got back from Qlik Qonnections in Orlando, Florida where the vibe to #DisruptEverything was strong! Qonnections is the premier Business Intelligence (BI) conference that brings data lovers together to share insights and discover data in new ways.

BI 45

More Trending

article thumbnail

Recap of Hadoop News for April 2018

ProjectPro

News on Hadoop - April 2018 Big Data and Cambridge Analytica: 5 Big Picture Truths.Datamation.com, April 2, 2018. Cambridge Analytica is in the news headlines as people realize the fact that how Trump campaign and its donors used FB ads and created a sociopolitical shakeup.Let’s understand what big truths does the #deletefacebook movement reveal and what implications it has - i) This data leak is not due to any breach but is a quite common and nothing unusual.

Hadoop 40
article thumbnail

Brief Conversations From The Open Data Science Conference: Part 2 - Episode 31

Data Engineering Podcast

Summary The Open Data Science Conference brings together a variety of data professionals each year in Boston. This week’s episode consists of a pair of brief interviews conducted on-site at the conference. First up you’ll hear from Andy Eschbacher of Carto. He dscribes some of the complexities inherent to working with geospatial data, how they are handling it, and some of the interesting use cases that they enable for their customers.

article thumbnail

Simulation for better decision making

Cloudera

Over the past decade, we have observed open source powered big data and analytics platforms evolve from large data storage containers to massively scalable advanced modeling platforms that seamlessly operate on-premises and in a multi-cloud environment. Cloudera Enterprise is the market leader in this space and working closely with the wider open source community to integrate the latest innovations in machine learning and artificial intelligence (AI).

Finance 43
article thumbnail

Now Available: Cloudera Data Science Workbench Release 1.4

Cloudera

Cloudera Data Science Workbench (CDSW) makes secure, collaborative data science at scale a reality for the enterprise and accelerates the delivery of new data products. With CDSW, organizations can research and experiment faster, deploy models easily and with confidence, as well as rely on the wider Cloudera platform to reduce the risks and costs of data science projects.

article thumbnail

Peak Performance: Continuous Testing & Evaluation of LLM-Based Applications

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

article thumbnail

Nominations Now Open for the Sixth Annual Cloudera Data Impact Awards

Cloudera

Cloudera 2017 Data Impact Award Winners. We are excited to kick off the 2018 Data Impact Awards ! Nominations are now open and will remain open until July 20th. Since 2012, the Data Impact Awards have showcased how organizations are using Cloudera and the power of data to transform themselves and achieve dramatic results. Click to tweet : Nominations are now open for the sixth annual Cloudera Data Impact Awards!

article thumbnail

Scaling Agile at Zalando

Zalando Engineering

Sharing successful large scale agile experiences Zalando has been known for radical approaches to agility since 2015. In order to keep growing and staying successful we took the next step in 2017 forming around 30 business units. Each business unit is formed around one particular business problem, topic or product with end2end responsibility. All disciplines needed are inside this business unit from commercial roles to tech teams.

article thumbnail

Dublin’s Data Science Guild

Zalando Engineering

How to establish and evolve your data science community In Zalando, we have many guilds: self-organized groups of people who share interests. The topics, scope, size, and ways to organize the guilds varies. We have technical guilds like the web or API guilds , local and artistic guilds like the knitting guild in Helsinki, and some guilds that support the growth of people in certain job families, like the Data Science Guild.

article thumbnail

How to Make Product Management for Enterprise Systems Work

Zalando Engineering

Moving from a more traditional internal IT setup to a product-driven culture I love building enterprise systems, because you get to work with your customers/users every day and literally see their lives change as you release new features. In my case, at Zalando, these are systems for fashion buying, supply chain management, inventory management and procure-to-pay processes (e.g. paying our suppliers for merchandise we bought from them).

Systems 40
article thumbnail

How to Build an Experimentation Culture for Data-Driven Product Development

Speaker: Margaret-Ann Seger, Head of Product, Statsig

Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating

article thumbnail

Our Dublin Tech Hub Turns Three

Zalando Engineering

Celebrating Zalando’s first international tech hub Three years ago, Zalando decided to start looking beyond Germany’s borders to tap into Europe’s pool of tech talent. Diverse and brilliant minds from other European cities and beyond contributed to cementing Zalando’s place as Europe’s most fashionable tech company. So, back in 2015, Zalando’s first move was across the Irish Sea, and now the team is very excited to celebrate its third anniversary!

article thumbnail

Brief Conversations From The Open Data Science Conference: Part 1 - Episode 30

Data Engineering Podcast

Summary The Open Data Science Conference brings together a variety of data professionals each year in Boston. This week’s episode consists of a pair of brief interviews conducted on-site at the conference. First up you’ll hear from Alan Anders, the CTO of Applecart about their challenges with getting Spark to scale for constructing an entity graph from multiple data sources.

article thumbnail

Cross-Functional Trade Surveillance

Cloudera

The Keystone to a Holistic Trade Surveillance Strategy. Criminals don’t refer to a playbook of best practices to execute a crime. They are creative in their thinking and collaborative in their efforts (including with parties who may not know they are complicit) to obtain their objectives and avoid getting caught. Trade surveillance in the financial services industry must respond to their creativity and the complexities of a global trading network, the myriad of digital and physical communication

article thumbnail

Building the Modern Platform with Cloudera Enterprise 6.x

Cloudera

Why Enterprises Need to Unify ML, Analytics, and Cloud. Times are changing, and the traditional models of analytics and data management don’t serve the needs of the modern enterprise, so the way to address these topics is changing too. While organizations are moving more workloads to the cloud, many mission-critical workloads remain on-prem. End users, data stewards, governance groups, and security groups alike can easily get overwhelmed with multiple access points, inconsistent user interfaces,

article thumbnail

Entity Resolution Checklist: What to Consider When Evaluating Options

Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.

article thumbnail

State Management in React

Zalando Engineering

Comparing Redux, MobX & setState in React by Kaiser Anwar Shad and revised by Eugen Kiss Introduction React is a declarative, efficient, and flexible JavaScript library for building user interfaces. Compared to other frontend libraries and frameworks, React’s core concept is simple but powerful: ‘React makes it painless to design simple views and renders by using virtual DOM’.

article thumbnail

Cloudera Altus is Now Available on Azure

Cloudera

It was exactly one year ago at Strata London that we introduced the world to Cloudera Altus Data Engineering. The premise was simple: make it quicker and easier for customers to drive data to their machine learning and analytics services by leveraging cloud resources, while at the same time, eliminating the pain associated with managing datacenter or cloud infrastructure.

AWS 40
article thumbnail

Many-to-Many Relationships Using Kafka

Zalando Engineering

Real-time joins in event-driven microservices As discussed in my previous blog post , Kafka is one of the key components of our event-driven microservice architecture in Zalando’s Smart Product Platform. We use it for sequencing events and building an aggregated view of data hierarchies. This post expands on what I previously wrote about the one-to-many data model and introduces more complex many-to-many relationships.

Kafka 40