KDnuggets

OCTOBER 10, 2023

Looking to understand the semantic layer and how it can improve your data stack? This GigaOm Sonor report on Semantic Layers can help you delve deeper.

Data 83

Data IT 83

The Pragmatic Engineer

OCTOBER 10, 2023

👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. In every issue, I cover topics related to Big Tech and startups through the lens of engineering managers and senior engineers. In this article, we cover three out of eight topics from today’s deepdive into tech scaleup Chronosphere. To get full issues twice a week, subscribe here.

Software Engineer 251

Software Engineer Software Engineering Architecture Media 251

Data Engineering Podcast

OCTOBER 8, 2023

Summary The insurance industry is notoriously opaque and hard to navigate. Max Cho found that fact frustrating enough that he decided to build a business of making policy selection more navigable. In this episode he shares his journey of data collection and analysis and the challenges of automating an intentionally manual industry. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.

Insurance 162

Insurance BI SQL Machine Learning 162

Marc Lamberti

OCTOBER 11, 2023

Do you wonder how to use the DockerOperator in Airflow to kick off a docker image? Or how to run a task without creating dependency conflicts? In this tutorial, you will discover everything you need about the DockerOperator with practical examples. If you’re new to Airflow, I’ve created a course you can check out here. Ready? Let’s go!

AWS 130

AWS Python Hadoop SQL 130

Advertisement

Generative AI is upending the way product developers & end-users alike are interacting with data. Despite the potential of AI, many are left with questions about the future of product development: How will AI impact my business and contribute to its success? What can product managers and developers expect in the future with the widespread adoption of AI?

Data

Waitingforcode

OCTOBER 10, 2023

If you have some experience with RDBMS, who doesn't btw, you have probably run a VACUUM command to reclaim the storage space occupied by deleted or obsolete rows. If you're now working with Delta Lake, you can do the same!

130

130

Christophe Blefari

OCTOBER 9, 2023

( credits ) Hey, I'm a bit late once again. I hope this newsletter edition finds you well. This is almost a raw edition, I had quite a big amount of links, I hope you will like this selection. Gen AI 🤖 OpenAI’s plan to build the "iPhone of artificial intelligence" — Obviously this is one of the main struggle for OpenAI.

Python 130

Python Data Database Java 130

KDnuggets

OCTOBER 12, 2023

SQL is the essential data science language due to its universal database accessibility, efficient data cleaning capabilities, seamless integration with other languages, and requirement for most data science jobs.

Data Science 139

Data Science SQL Database Data 139

Jesse Anderson

OCTOBER 12, 2023

Unapologetically Technical is finally back with a new episode! In this episode of Unapologetically Technical, I had the pleasure of interviewing Neil Avery from Liquidlabs. We discussed his experiences creating grid computing systems at major banks like Royal Bank of Scotland and Deutchebank, as well as his journey to founding a startup called Logscape and working as a consultant at Excellian.

Banking 100

Banking Consulting Kafka Systems 100

Knowledge Hut

OCTOBER 13, 2023

Project management involves muti faceted skills and competencies. There are various skilled people involved in project management, from project coordinators to project consultants, the list is endless. One key role in project management is the project director. These individuals are in the top line of project management, they are responsible for making crucial decisions involved in the projects.

Project 96

Project Certification Education Media 96

databricks

OCTOBER 10, 2023

We’re excited to announce that Meta AI’s Llama 2 foundation chat models are available in the Databricks Marketplace for you to fine-tune and dep.

Machine Learning 125

Machine Learning Data Science Data 125

Advertisement

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

Database

KDnuggets

OCTOBER 12, 2023

Ready to take your machine learning skills to new heights? Dive into the world of Metaflow with us and elevate your expertise with Uplimit's Full-Stack Machine Learning with Metaflow course!

Machine Learning 126

Machine Learning 126

Confluent

OCTOBER 12, 2023

With Confluent Cloud, Loggi migrated to an event-driven architecture, powering real-time analytics, boosting productivity, and cutting costs.

Architecture 98

Architecture Cloud 98

Snowflake

OCTOBER 9, 2023

Easily collect and store digital events directly to create a complete composable customer data platform (CDP) Marketers are increasingly leveraging the Snowflake Data Cloud as the foundation for all of their customer data analytics and activation. Marketing teams are creating composable customer data platforms (CDPs) on the Data Cloud to build a 360-degree view of each customer.

Cloud 98

Cloud Building SQL Data 98

databricks

OCTOBER 9, 2023

We’re excited to announce that Databricks has obtained the International Standards Organization (ISO) 27701 certification as a data processor. This certification reflects our c.

Certification 89

Certification Data 89

Speaker: Scott Sehlhorst

We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.

Certification

KDnuggets

OCTOBER 13, 2023

A new deep learning framework built entirely in Rust that aims to balance flexibility, performance, and ease of use for researchers, ML engineers, and developers.

Deep Learning 130

Deep Learning Engineering Machine Learning 130

Confluent

OCTOBER 11, 2023

Apache Kafka 3.6 brings Tiered Storage Early Access, migrating clusters from ZooKeeper to KRaft with no downtime, a grace period for stream-table joins, and more!

Kafka 89

Kafka Accessible Accessibility 89

Towards Data Science

OCTOBER 12, 2023

Construction engineer investigating his work — Stable diffusion Introduction In our previous publication, From Data Engineering to Prompt Engineering , we demonstrated how to utilize ChatGPT to solve data preparation tasks. Apart from the good feedback we have received, one critical point has been raised: Prompt engineering may help with simple tasks, but is it really useful in a more challenging environment?

Data Integration 73

Data Integration Systems Engineering Datasets 73

databricks

OCTOBER 13, 2023

This blog was written in collaboration with David Roberts (Analytics Engineering Manager), Kevin P. Buchan Jr (Assistant Vice President, Analytics), and Yubin Park.

Engineering 92

Engineering Management 92

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

Data Science

KDnuggets

OCTOBER 12, 2023

This article talks about several best practices for writing ETLs for building training datasets. It delves into several software engineering techniques and patterns applied to ML.

Building 118

Building Software Engineer Software Engineering Datasets 118

Confluent

OCTOBER 10, 2023

Learn how data streaming enables you to accurately predict future customer demands while delivering the right products in the right quantities to satisfy customer demand without creating a surplus.

Data 70

Data 70

Snowflake

OCTOBER 12, 2023

In the age of climate consciousness, industries worldwide are grappling with the urgent need to reduce their carbon footprints. One industry that has come under increased scrutiny is telecommunications, where Scope 3 emissions , or the indirect emissions that occur in a company’s value chain that the company has no direct control over, alone account for a staggering 85% of a typical telecom company’s carbon footprint.

Telecommunication 80

Telecommunication Utilities Consulting Cloud 80

databricks

OCTOBER 11, 2023

We are delighted to announce that Databricks Asset Bundles are now in public preview. Bundles, for short, facilitate the adoption of software engineering.

Software Engineer 96

Software Engineer Software Engineering Engineering 96

Advertisement

Start-ups & SMBs launching products quickly must bundle dashboards, reports, & self-service analytics into apps. Customers expect rapid value from your product (time-to-value), data security, and access to advanced capabilities. Traditional Business Intelligence (BI) tools can provide valuable data analysis capabilities, but they have a barrier to entry that can stop small and midsize businesses from capitalizing on them.

Data Analysis

KDnuggets

OCTOBER 11, 2023

This week: What three data science projects should you choose to guarantee you get the job? • A 7 step guide to help you go from the fundamentals of machine learning and Python to Transformers, recent advances in NLP, and beyond.

Data Science 120

Data Science Project Machine Learning Python 120

Precisely

OCTOBER 9, 2023

Telecom providers invest heavily in infrastructure, so it’s vital that they optimize those investments by using an intelligent planning process. That means making data-driven decisions based on rich, contextual, location-based data. Is your company making the right investments in infrastructure? That depends on the answers to three questions: Are you building in the right place?

Telecommunication 69

Telecommunication Raw Data Portfolio Data Validation 69

Confluent

OCTOBER 9, 2023

Learn how data streaming and artificial intelligence enables you to project your brand’s reputation with real-time social media monitoring.

Media 78

Media Data Project 78

databricks

OCTOBER 9, 2023

Written in partnership with Shell. The energy industry is all about physical assets – from terminals, ships and pipelines to refineries and wind f.

Data Analytics 86

Data Analytics Data Manufacturing 86

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

Building

KDnuggets

OCTOBER 11, 2023

RNN, Transformers, and BERT are popular NLP techniques with tradeoffs in sequence modeling, parallelization, and pre-training for downstream tasks.

Process 131

Process 131

Monte Carlo

OCTOBER 11, 2023

Today, I’m thrilled to announce that Eli Collins, VP of Product at Google DeepMind, will join us on stage as our surprise keynote speaker at IMPACT: The Data Observability Summit ! Alongside Billy Beane ( yes, that Billy Beane ), Annie Duke, author of one of my favorite books, Thinking in Bets , and Nga Phan, SVP of Product at Salesforce AI, Eli will round out our slate of data and AI keynotes for the conference.

Google Cloud 64

Google Cloud Portfolio Deep Learning Data 64

Confluent

OCTOBER 12, 2023

Learn about the key capabilities of a data streaming platform and what factors to consider when choosing a stream processing engine like Apache Flink® to fuel use cases with real-time data.

Process 62

Process Engineering Data 62

databricks

OCTOBER 13, 2023

Today, we are excited to announce the general availability of the Databricks SQL Statement Execution API on AWS and Azure, with support for.

SQL 82

SQL AWS 82

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

Engineering