November, 2019

article thumbnail

Open Source Projects by Google, Uber and Facebook for Data Science and AI

KDnuggets

Open source is becoming the standard for sharing and improving technology. Some of the largest organizations in the world namely: Google, Facebook and Uber are open sourcing their own technologies that they use in their workflow to the public.

article thumbnail

Building A Real Time Event Data Warehouse For Sentry

Data Engineering Podcast

Summary The team at Sentry has built a platform for anyone in the world to send software errors and events. As they scaled the volume of customers and data they began running into the limitations of their initial architecture. To address the needs of their business and continue to improve their capabilities they settled on Clickhouse as the new storage and query layer to power their business.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Optimizing Observability with Jaeger, M3, and XYS at Uber

Uber Engineering

When something goes wrong with a piece of code, engineers want to know all the relevant details of the error immediately so they can get right to work remedying the malfunction. . However, as technology has advanced, measuring system metrics and … The post Optimizing Observability with Jaeger, M3, and XYS at Uber appeared first on Uber Engineering Blog.

article thumbnail

Introducing ksqlDB

Confluent

Today marks a new release of KSQL, one so significant that we’re giving it a new name: ksqlDB. Like KSQL, ksqlDB remains freely available and community licensed, and you can […].

IT 111
article thumbnail

Generative AI Deep Dive: Advancing from Proof of Concept to Production

Speaker: Maher Hanafi, VP of Engineering at Betterworks & Tony Karrer, CTO at Aggregage

Executive leaders and board members are pushing their teams to adopt Generative AI to gain a competitive edge, save money, and otherwise take advantage of the promise of this new era of artificial intelligence. There's no question that it is challenging to figure out where to focus and how to advance when it’s a new field that is evolving everyday. 💡 This new webinar featuring Maher Hanafi, CTO of Betterworks, will explore a practical framework to transform Generative AI prototypes into

article thumbnail

Customer Data Platforms: Silo Killer or Yet Another Silo?

Teradata

How do you ensure your Customer Data Platform is enabling breakthrough customer experience business outcomes, rather than hindering them? Find out more!

Data 84
article thumbnail

TDA Announces InData Labs as the Winners in Global Agency Awards

InData Labs

Today we witness new technologies arising and new tendencies influencing the way we work and live. In order to stay competitive, it’s important to be aware of the latest trends, maintain a level of strong expertise, and offer best-in-class services. Our team is always striving to move with the times and keep all modern requirements. Запись TDA Announces InData Labs as the Winners in Global Agency Awards впервые появилась InData Labs.

More Trending

article thumbnail

Escaping Analysis Paralysis For Your Data Platform With Data Virtualization

Data Engineering Podcast

Summary With the constant evolution of technology for data management it can seem impossible to make an informed decision about whether to build a data warehouse, or a data lake, or just leave your data wherever it currently rests. What’s worse is that any time you have to migrate to a new architecture, all of your analytical code has to change too.

Data Lake 100
article thumbnail

Introducing Menu Maker: Uber Eats’ New Menu Management Tool

Uber Engineering

A restaurant’s menu is arguably its most important feature. When ordering online or via the app with Uber Eats, potential customers can’t peer in through a restaurant’s windows or smell the scents wafting from their kitchens, so digital menus become … The post Introducing Menu Maker: Uber Eats’ New Menu Management Tool appeared first on Uber Engineering Blog.

article thumbnail

Kafka Streams and ksqlDB Compared – How to Choose

Confluent

ksqlDB is a new kind of database purpose-built for stream processing apps, allowing users to build stream processing applications against data in Apache Kafka® and enhancing developer productivity. ksqlDB simplifies […].

Kafka 108
article thumbnail

Rich Model, Poor Model

Teradata

An integrated data foundation allows data science models to be more accurate, actionable and engage more customers. Find out how your model can positively impact your bottom line.

article thumbnail

Leading the Development of Profitable and Sustainable Products

Speaker: Jason Tanner

While growth of software-enabled solutions generates momentum, growth alone is not enough to ensure sustainability. The probability of success dramatically improves with early planning for profitability. A sustainable business model contains a system of interrelated choices made not once but over time. Join this webinar for an iterative approach to ensuring solution, economic and relationship sustainability.

article thumbnail

Workforce Analytics is Reinventing HR

U-Next

Introduction to Workforce Analytics Today, the need to understand what attracts skillful individuals to join an organization, stay motivated, and deliver outstanding results has become more important than ever. However, this is not a task which can be shouldered by the HR team alone; they need the right tools to deliver optimal results. Over the years, organizations around the globe have spent billions of dollars on employee performance analysis, talent recruitment, leadership training, and deve

article thumbnail

Top KDnuggets tweets, Nov 20-26: How to Speed up Pandas by 4x with one line of code

KDnuggets

Also: Deep Learning for Image Classification with Less Data; How to Speed up Pandas by 4x with one line of code; 25 Useful #Python Snippets to Help in Your Day-to-Day Work; Automated Machine Learning Project Implementation Complexities.

Coding 124
article thumbnail

Designing For Data Protection

Data Engineering Podcast

Summary The practice of data management is one that requires technical acumen, but there are also many policy and regulatory issues that inform and influence the design of our systems. With the introduction of legal frameworks such as the EU GDPR and California’s CCPA it is necessary to consider how to implement data protectino and data privacy principles in the technical and policy controls that govern our data platforms.

Designing 100
article thumbnail

Netflix at AWS re:Invent 2019

Netflix Tech

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Please stop by our “Living Room” for an opportunity to connect or reconnect with Netflixers. We’ve compiled our speaking events below so you know what we’ve been working on. We look forward to seeing you there!

AWS 40
article thumbnail

Navigating the Future: Generative AI, Application Analytics, and Data

Generative AI is upending the way product developers & end-users alike are interacting with data. Despite the potential of AI, many are left with questions about the future of product development: How will AI impact my business and contribute to its success? What can product managers and developers expect in the future with the widespread adoption of AI?

article thumbnail

Conquering Hybrid Cloud with Replicated Event-Driven Architectures

Confluent

Potential advantages of hybrid cloud architectures include avoiding vendor lock-in, increasing system resilience, optimizing costs, and inducing price competition among cloud providers. Hybrid cloud architectures require the ability to securely […].

article thumbnail

The Four Types of Chief Data Officers

Teradata

Every organization, in every industry, needs a Chief Data Officer. Use these guidelines to choose the one with the optimal skills and background for success.

Data 59
article thumbnail

Analytics on Kafka Event Streams Using Druid, Elasticsearch and Rockset

Rockset

Events are messages that are sent by a system to notify operators or other systems about a change in its domain. With event-driven architectures powered by systems like Apache Kafka becoming more prominent, there are now many applications in the modern software stack that make use of events and messages to operate effectively. In this blog, we will examine the use of three different data backends for event data - Apache Druid , Elasticsearch and Rockset.

Kafka 40
article thumbnail

10 Free Must-read Books on AI

KDnuggets

Artificial Intelligence continues to fill the media headlines while scientists and engineers rapidly expand its capabilities and applications. With such explosive growth in the field, there is a great deal to learn. Dive into these 10 free books that are must-reads to support your AI study and work.

Media 123
article thumbnail

Get Better Network Graphs & Save Analysts Time

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

article thumbnail

Automating Your Production Dataflows On Spark

Data Engineering Podcast

Summary As data engineers the health of our pipelines is our highest priority. Unfortunately, there are countless ways that our dataflows can break or degrade that have nothing to do with the business logic or data transformations that we write and maintain. Sean Knapp founded Ascend to address the operational challenges of running a production grade and scalable Spark infrastructure, allowing data engineers to focus on the problems that power their business.

article thumbnail

Netflix at AWS re:Invent 2019

Netflix Tech

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Please stop by our “Living Room” for an opportunity to connect or reconnect with Netflixers. We’ve compiled our speaking events below so you know what we’ve been working on. We look forward to seeing you there!

AWS 40
article thumbnail

Using Confluent Platform to Complete a Massive Cloud Provider Migration and Handle Half a Million Events Per Second

Confluent

In the past 12 months, games and other forms of content made with the Unity platform were installed 33 billion times reaching 3 billion devices worldwide. Apart from our real-time […].

Cloud 85
article thumbnail

Is There a Geographic Component in Your Analytic Cloud Architecture?

Teradata

Moving part of your analytic ecosystem to the cloud requires the inspection of all the ecosystem elements to make sure they perform well over a WAN. Read more.

Cloud 58
article thumbnail

Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You Need to Know

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

article thumbnail

Tutorial: Building An Analytics Data Pipeline In Python

Dataquest

If you’ve ever wanted to learn Python online with streaming data, or data that changes quickly, you may be familiar with the concept of a data pipeline. Data pipelines allow you transform data from one representation to another through a series of steps. Data pipelines are a key part of data engineering, which we teach in our new Data Engineer Path.

article thumbnail

How to Speed up Pandas by 4x with one line of code

KDnuggets

While Pandas is the library for data processing in Python, it isn't really built for speed. Learn more about the new library, Modin, developed to distribute Pandas' computation to speedup your data prep.

Coding 121
article thumbnail

Two Years In The Life of AI, Machine Learning, Deep Learning and Java

KDnuggets

Where does Java stand in the world of artificial intelligence, machine learning, and deep learning? Learn more about how to do these things in Java, and the libraries and frameworks to use.

article thumbnail

Advice for New and Junior Data Scientists

KDnuggets

If you are a new Data Scientists early in your professional journey, and you’re a bit confused and lost, then follow this advice to figure out how to best contribute to your company.

Data 109
article thumbnail

How To Get Promoted In Product Management

Speaker: John Mansour

If you're looking to advance your career in product management, there are more options than just climbing the management ladder. Join our upcoming webinar to learn about highly rewarding career paths that don't involve management responsibilities. We'll cover both career tracks and provide tips on how to position yourself for success in the one that's right for you.

article thumbnail

How to Create a Vocabulary for NLP Tasks in Python

KDnuggets

This post will walkthrough a Python implementation of a vocabulary class for storing processed text data and related metadata in a manner useful for subsequently performing NLP tasks.

Python 115
article thumbnail

Automated Machine Learning Project Implementation Complexities

KDnuggets

To demonstrate the implementation complexity differences along the AutoML highway, let's have a look at how 3 specific software projects approach the implementation of just such an AutoML "solution," namely Keras Tuner, AutoKeras, and automl-gs.

article thumbnail

A Doomed Marriage of Machine Learning and Agile

KDnuggets

Sebastian Thrun, the founder of Udacity, ruined my machine learning project and wedding.

article thumbnail

Lit BERT: NLP Transfer Learning In 3 Steps

KDnuggets

PyTorch Lightning is a lightweight framework which allows anyone using PyTorch to scale deep learning code easily while making it reproducible. In this tutorial we’ll use Huggingface's implementation of BERT to do a finetuning task in Lightning.

article thumbnail

How Embedded Analytics Gets You to Market Faster with a SAAS Offering

Start-ups & SMBs launching products quickly must bundle dashboards, reports, & self-service analytics into apps. Customers expect rapid value from your product (time-to-value), data security, and access to advanced capabilities. Traditional Business Intelligence (BI) tools can provide valuable data analysis capabilities, but they have a barrier to entry that can stop small and midsize businesses from capitalizing on them.