Fri.Apr 21, 2023

article thumbnail

Data News — Week 23.16

Christophe Blefari

If this picture had been generated with AI it would have been boring ( credits ) Dear readers, I hope you're doing good. We are close to the second anniversary of the newsletter. Which is crazy. Retrospectively it means that I've written 900 words on average every week for the last 102 weeks. When you look at the first edition we came a long way—lmao.

Data 130
article thumbnail

Dolly 2.0: ChatGPT Open Source Alternative for Commercial Use

KDnuggets

Dolly 2.0 was trained on a human-generated dataset of prompts and responses. The training methodology is similar to InstructGPT but with a claimed higher accuracy and lower training costs of less than $30.

Datasets 135
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

DataOS and Snowflake – Better Together

The Modern Data Company

Not Getting Value from Your Data Transformation? Fix it Download (PDF) The post DataOS and Snowflake – Better Together appeared first on TheModernDataCompany.

IT 98
article thumbnail

Data Scientist Job Salaries Analysis

KDnuggets

Data scientists are in high demand in many industries and sectors. But how much do they earn and where do they work?

Data 105
article thumbnail

Beyond the Basics of A/B Tests: Innovative Experimentation Tactics You Need to Know as a Data or Product Professional

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

article thumbnail

Three simple lessons that will catapult financial services into its golden age

databricks

Register now for the virtual replay Imagine a retail bank funding home loans in minutes. Or an insurer underwriting with 200 billion parameters.

article thumbnail

DEW 123: Generative AI at BuzzFeed, Building OnCall Culture & Dimensional Modeling at WhatNot

Data Engineering Weekly

Welcome to another episode of Data Engineering Weekly Radio. Ananth and Aswin discussed a blog from BuzzFeed that shares lessons learned from building products powered by generative AI. The blog highlights how generative AI can be integrated into a company's work culture and workflow to enhance creativity rather than replace jobs. BuzzFeed provided their employees with intuitive access to APIs and integrated the technology into Slack for better collaboration.

More Trending

article thumbnail

How to Translate SQL Scripts Into Matillion Jobs

phData: Data Engineering

Unlike traditional methods that rely on complex SQL queries for orchestration, Matillion Jobs provide a more streamlined approach. By converting SQL scripts into Matillion Jobs , users can take advantage of the platform’s advanced features for job orchestration, scheduling, and sharing. Additionally, the directed acyclic graph (DAG) feature enables users to easily visualize the relationships between different tasks within a transformation job or different transformation tasks in an orches

SQL 52
article thumbnail

What is Project Termination? Types, Importance, Process

Knowledge Hut

Managing a project is never smooth. Challenges are a part of project management, but what happens when despite careful planning and execution, things don’t look promising? Or when the team is re-shuffled for a critical project and your own project is put on the back burner? Not just this, but what if the client decides to end the contract in the middle of a project execution?

Project 52
article thumbnail

How to find (and style!) detailed water polygons for your map

ArcGIS

Finding high res, recent, water polygons can be a challenge. Here's how you can use Sentinel-2 Land Cover imagery for your vector maps.

61
article thumbnail

What is Project Status? Report Examples, Terms, Best Practices

Knowledge Hut

Project management is a complicated process with many phases, tasks, and stakeholders. Project status reporting is a vital part of project management because it lets people know how a project is going and points out any problems or risks that could hurt its success. This article will discuss status reporting in project management, including what it is, why it is crucial, and how to create an effective report.

Project 52
article thumbnail

From Developer Experience to Product Experience: How a Shared Focus Fuels Product Success

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

article thumbnail

DataOS and Snowflake – Better Together

The Modern Data Company

Not Getting Value from Your Data Transformation? Fix it Download (PDF) The post DataOS and Snowflake – Better Together appeared first on TheModernDataCompany.

IT 52
article thumbnail

Failures in Agile Transformation

Knowledge Hut

With the increase in Agile adoption across the organization, the stories are piling up too. Now the question is, are these success stories or the failure stances. Usually, in the conferences or meetups, you get to meet people from various establishments, this is just another way of getting to hear what worked or what not. Even in your own organization, you can feel the pulse of the transformation.

article thumbnail

YipitData leverages Databricks Unity Catalog to Scale Data Services

databricks

This blog is authored by Anup Segu, Co-Head of Data Engineering at YipitData YipitData provides daily market insights to its clients by analyzing.

article thumbnail

How to Become a Chief Technology Officer (CTO) in 2023

Knowledge Hut

The technology landscape has been disrupted in the last few decades. While the earliest human innovations took thousands of years to develop, advancements in computer technology occurred in shorter spans in the twenty-first century. A chief technology officer (CTO) is responsible for keeping up with technological changes and overseeing technology projects in an organization.

article thumbnail

Peak Performance: Continuous Testing & Evaluation of LLM-Based Applications

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

article thumbnail

Building a large scale unsupervised model anomaly detection system?—?Part 1

Lyft Engineering

Building a large scale unsupervised model anomaly detection system — Part 1 Distributed Profiling of Model Inference Logs By Anindya Saha , Han Wang , Rajeev Prabhakar Introduction LyftLearn is Lyft’s ML Platform. It is a machine learning infrastructure built on top of Kubernetes that powers diverse applications such as dispatch, pricing, ETAs, fraud detection, and support.

Systems 104
article thumbnail

Software Development Planning: Process, Importance, Tools

Knowledge Hut

A perfect software doesn’t come to life overnight - there are a lot of pieces behind the scenes that come together to bring about a solution. The software development process undergoes several intricate stages before the actual work begins. It includes defining goals, estimating costs and resources, distributing work, and not to mention, tracking everything.

Process 52
article thumbnail

Product Backlog vs Sprint Backlog: Differences & Similarities

Knowledge Hut

While a product starts with one idea and vision, it must soon grow with multiple ideas and features. However, there will be numerous ideas and tasks, and product teams need a better way to manage all possible work that can go into product development. They need guidance and direction to understand what work they should do and when to provide optimal value to customers and businesses.