Monte Carlo

JANUARY 18, 2024

5 factors that lead to alert fatigue and how to prevent them with incident management best practices Last Friday afternoon, Pedram Navid, head of data at Dagster and overall data influencer , went to X to ask an important question. He asked: Ok — is anomaly detection in data actually that useful or is just a bunch of alerts you end up muting and not doing anything with?

Data Engineering 69

Data Engineering Data Engineer Engineering Machine Learning 69

Waitingforcode

JANUARY 17, 2024

Even though I'm into streaming these days, I haven't really covered streaming in Delta Lake yet. I only slightly blogged about Change Data Feed but completely missed the fundamentals. Hopefully, this and next blog posts will change this!

Data 130

Data 130

Christophe Blefari

JANUARY 14, 2024

Back to school ( credits ) Hello you. Back to the usual Data News—with a little delay, I'm sorry. First of all, I'd like to thank you for your positive comments on last week 's article. It's a subject close to my heart and I was very happy to share it with you, because I never thought that Data News would become such a big part of my life.

Google Cloud 130

Google Cloud Data SQL Python 130

Confessions of a Data Guy

JANUARY 16, 2024

Well, I finally got around to it. What you say? Fine-tuning an LLM, that’s what. I mean all the cool kids are talking about and caring on like it’s the next thing. What can I say … I’m jaded. I’ve been working on ML systems for a good few years now, and I’ve seen the […] The post Engineering Lessons Learned from LLM Fine Tuning appeared first on Confessions of a Data Guy.

Engineering 100

Engineering Systems IT Data 100

Advertisement

Generative AI is upending the way product developers & end-users alike are interacting with data. Despite the potential of AI, many are left with questions about the future of product development: How will AI impact my business and contribute to its success? What can product managers and developers expect in the future with the widespread adoption of AI?

Data

KDnuggets

JANUARY 15, 2024

This article has explored the impact of quantum computing on data science and AI. We will look at the fundamental concepts of quantum computing and the key terms that are used in the field. We will also cover the challenges that lie ahead for quantum computing and how they can be overcome.

Data Science 121

Data Science Data 121

Cloudera

JANUARY 17, 2024

Cloudera DataFlow for the Public Cloud (CDF-PC) is a complete self-service streaming data capture and movement platform based on Apache NiFi. It allows developers to interactively design data flows in a drag and drop designer, which can be deployed as continuously running, auto-scaling flow deployments or event-driven serverless functions. CDF-PC comes with a monitoring dashboard out of the box for data flow health and performance monitoring.

Bytes 101

Bytes Architecture Designing Building 101

databricks

JANUARY 18, 2024

This is part 1 of a blog series where we look back at the major areas of progress for Databricks SQL in 2023.

SQL 116

SQL 116

KDnuggets

JANUARY 15, 2024

Learn the generic scenarios and techniques of grouping and aggregating data, partitioning and ranking data in SQL, which will be very helpful in reporting requirements.

SQL 113

SQL Aggregated Data Data Science Data 113

ThoughtSpot

JANUARY 16, 2024

This is part of our ongoing spotlight series which highlights ThougthSpot’s quarterly Selfless Excellence champion. At ThoughtSpot, Selfless Excellence is the heart of who we are as a company. It creates room for personal success – but never at the cost of others on the team. Simply put, this means we consider our teammates, customers, and society at large ahead of our own personal wins, and without the distraction of office politics.

Data Analytics 83

Data Analytics Project Engineering IT 83

Knowledge Hut

JANUARY 18, 2024

Data Science is an amalgamation of several disciplines, including computer science, statistics, and machine learning. As the world on the internet is becoming our second home, Big Data has exploded. Data Science is the study of this big data to derive a meaningful pattern. All the businesses are now looking to explore this gold mine of information to solve already existing problems.

Data Science 98

Data Science Amazon Web Services Finance Big Data 98

Advertisement

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

Database

Engineering at Meta

JANUARY 18, 2024

At Meta, the quest for faster model training has yielded an exciting milestone: the adoption of Lazy Imports and the Python Cinder runtime. The outcome? Up to 40 percent time to first batch (TTFB) improvements, along with a 20 percent reduction in Jupyter kernel startup times. This advancement facilitates swifter experimentation capabilities and elevates the ML developer experience (DevX).

Machine Learning 80

Machine Learning Python Education Coding 80

KDnuggets

JANUARY 18, 2024

Looking to make a career in data science? Here are five free university courses to help you get started.

Data Science 142

Data Science Data 142

ThoughtSpot

JANUARY 16, 2024

Are you a ThoughtSpot enthusiast? Maybe you built a liveboard that saved your department hours each work week, or perhaps you figured out a unique way to gamify adoption across your team. You put in the hard work, now it’s time to show it off. ThoughtSpot User Groups were designed to help users connect—a place where you can share stories and get new ideas to empower your organization with data.

Business Intelligence 76

Business Intelligence Consulting Certification Utilities 76

Knowledge Hut

JANUARY 18, 2024

In my journey as a Scrum Master, I've experienced the profound impact of Backlog Refinement on the success of Agile projects. This process goes beyond mere task management; it embodies a strategic approach aimed at enhancing the efficiency and manageability of Agile initiatives. Through this meticulous process of continuously grooming and prioritizing backlog items, I have seen teams transform their workflow, achieving higher productivity and better alignment with project goals.

Project 98

Project Certification Management Process 98

Speaker: Scott Sehlhorst

We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.

Certification

Towards Data Science

JANUARY 17, 2024

Parquet vs ORC vs Avro vs Delta Lake Photo by Viktor Talashuk on Unsplash The big data world is full of various storage systems, heavily influenced by different file formats. These are key in nearly all data pipelines, allowing for efficient data storage and easier querying and information extraction. They are designed to handle the challenges of big data like size, speed, and structure.

Big Data 75

Big Data Data Data Storage SQL 75

KDnuggets

JANUARY 17, 2024

Looking to understand the universal semantic layer and how it can improve your data stack? This GigaOm Sonor report on Semantic Layers can help you delve deeper.

Data 105

Data IT 105

ArcGIS

JANUARY 17, 2024

What are cartographic conventions and do you need to follow them?

Designing 117

Designing Education 117

Knowledge Hut

JANUARY 18, 2024

Data Science has risen to become one of the world's topmost emerging multidisciplinary approaches in technology. Recruiters are hunting for people with data science knowledge and skills these days. Entering the field of data science can be extremely rewarding and beneficial to your career due to its tremendous future advancement opportunities. Data Scientists collect, analyze, and interpret large amounts of data.

Data Science 98

Data Science Business Analyst ETL Method Data Architect 98

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

Data Science

Confluent

JANUARY 18, 2024

The Confluent CLI now supports custom plugins to simplify CLI commands, execute dynamic workflows, and boost efficiency. Read a step-by-step guide on how to get started.

73

73

KDnuggets

JANUARY 16, 2024

Today, we're proud to announce a significant addition to our catalog at Machine Learning Mastery. Known for our detailed, code-centric guides, we're taking a leap further into the realms of Computer Vision with our latest offering.

Machine Learning 100

Machine Learning Coding 100

Cloudera

JANUARY 19, 2024

As described in our recent blog post , an SQL AI Assistant has been integrated into Hue with the capability to leverage the power of large language models (LLMs) for a number of SQL tasks. It can help you to create, edit, optimize, fix, and succinctly summarize queries using natural language. This is a real game-changer for data analysts on all levels and will make SQL development faster, easier, and less error-prone.

SQL 71

SQL Data Warehouse AWS Architecture 71

Knowledge Hut

JANUARY 18, 2024

Data science is a multidisciplinary field that requires a broad set of skills from mathematics and statistics to programming, machine learning, and data visualization. The world has been swept by the rise of data science and machine learning. Data scientists are in high demand, and the demand will only continue to rise. However, data scientists need to know certain programming languages and must have a specific set of skills.

Programming Language 98

Programming Language Data Science Programming Scala 98

Advertisement

Start-ups & SMBs launching products quickly must bundle dashboards, reports, & self-service analytics into apps. Customers expect rapid value from your product (time-to-value), data security, and access to advanced capabilities. Traditional Business Intelligence (BI) tools can provide valuable data analysis capabilities, but they have a barrier to entry that can stop small and midsize businesses from capitalizing on them.

Data Analysis

Confluent

JANUARY 16, 2024

Confluent integrates with Pinecone Serverless to enable cost-effective development of highly performant GenAI applications fueled by fully managed data streams.

Management 73

Management Data 73

KDnuggets

JANUARY 16, 2024

As enterprises rapidly adopt cloud-native technologies, managing containerized applications has become crucial, so this article provides practical insights on the leading container management solutions to help organizations choose the right one for their needs.

Cloud 96

Cloud Management Technology 96

Hepta Analytics

JANUARY 14, 2024

Today we’re excited to launch the HeptaPay WooCommerce Plugin for WordPress. With this plugin, online businesses across East Africa can now receive instant international payments to their mobile wallets in Rwanda, Kenya and Uganda. Businesses can choose to be settled to their MTN MoMo Pay, M-PESA Till Number, MTN MoMo, M-PESA, or Airtel Money mobile wallets.

69

69

Knowledge Hut

JANUARY 18, 2024

When people decide to start their journey in the cloud industry, their first confusion is which certification course they should take. The two primary certifications in this field are CISA (Certified Information Systems Auditor) and CISSP (Certified Information Systems Security Professional). Though both offer a great start to the cloud professional's journey, they belong to different spectrums.

Certification 98

Certification Consulting Cloud Systems 98

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

Building

Towards Data Science

JANUARY 16, 2024

My personal take on justifying the existence of Data Mesh A senior stakeholder at one my projects mentioned that they wanted to decentralise their data platform architecture and democratise data across the organisation. When I heard the words ‘decentralised data architecture’, I was left utterly confused at first! In my then limited experience as a Data Engineer, I had only come across centralised data architectures and they seemed to be working very well.

Data Warehouse 68

Data Warehouse Data Architecture Relational Database NoSQL 68

KDnuggets

JANUARY 16, 2024

From Skill Assessment to Networking: Your Roadmap to Thriving in the World of Data Science.

Data Science 129

Data Science Data 129

Confluent

JANUARY 17, 2024

Curious how to start building real-time streaming apps with programming languages for Apache Kafka? Explore the latest tutorials, courses, and articles on Kafka languages to jumpstart your journey.

Programming Language 62

Programming Language Kafka Programming Building 62

Knowledge Hut

JANUARY 17, 2024

While hacking is illegal, ethical hacking is a legal method of breaching a security system to detect potential security threats. Ethical hackers look at strategies to see if there are any flaws that cybercriminals could take advantage of. Ethical hackers are incredibly valuable nowadays, as businesses face extraordinary levels of risk and dangerous cyber threats.

Consulting 98

Consulting Media Government Certification 98

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

Engineering