Sat.Dec 31, 2022 - Fri.Jan 06, 2023

article thumbnail

Why I'm using (Neo)vim as a Data Engineer and Writer in 2023

Simon Späti

I used VS Code, Sublime, Notepad++, TextMate, and others, but the shortcut with cmd(+shift)+end, jumping with option+arrow-keys from word to word, needed to be faster at some point. I was hitting my limits. Everything I was doing I did decently fast, but I didn’t get any faster. Vim is the only editor you get faster with time. Vim is based solely on shortcuts.

article thumbnail

CircleCI’s unnoticed holiday security breach

The Pragmatic Engineer

Originally published on 5 January 2023. 👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. We cover one out of seven topics in today’s subscriber-only The Scoop issue. To get this newsletter every week, subscribe here. For most engineering teams, returning from the winter holiday usually involves gradually getting back into the swing of things.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Python Matplotlib Cheat Sheets

KDnuggets

Matplotlib is the most famous and commonly used plotting library in Python. It allows you to create clear and interactive visualizations that make your data easier to understand and your results more concrete.

Python 159
article thumbnail

Confluent + Immerok: Cloud Native Kafka Meets Cloud Native Flink

Confluent

Introducing fully managed Apache Kafka® + Flink for the most robust, cloud-native data streaming platform with stream processing, integration, and streaming analytics in one.

Kafka 145
article thumbnail

From Developer Experience to Product Experience: How a Shared Focus Fuels Product Success

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

article thumbnail

Why Vim Is More than Just an Editor – Vim Language, Motions, and Modes Explained

Simon Späti

Throughout my time as a developer, I’ve used VS Code, Sublime, Notepad++, TextMate, and others. But shortcuts like cmd(+shift)+end and jumping with option+arrow-keys from word to word needed to be faster at some point. I was hitting my limits. Everything I was doing I did decently fast, but I didn’t get any faster. I’ve since learned that Vim is the only editor that you get faster using with time.

Coding 130
article thumbnail

I talked to DataGen podcast

Christophe Blefari

🎙 A few week ago I did my first podcast with Robin. We talked about data engineering and everything around doing a weekly curation. This is the first episode of Robin's podcast in English and you should follow him because more are coming! In the podcast we talked about 🔥 My journey before launching the newsletter 🔥 Why and how I write 🔥 My main challenges as a Data Engineer 🔥 My favorite contents 🔥 What I like about data 🔥 A few tips f

More Trending

article thumbnail

4 Tips for Agility and Resiliency Through Supply Chain Process Automation

Precisely

Times are changing, and at a near-constant pace. With shifting customer preferences and disruptive world events shaking up the global supply chain market, many business leaders are left wondering whether they’ll be able to stay competitive. Supply chain automation technologies can have a big role to play when it comes to providing end-to-end visibility and risk mitigation for complex, data-intensive SAP processes in supply chain.

Process 58
article thumbnail

The Open Data Stack Distilled into Four Core Tools

Simon Späti

In this article, we are going to explore core open-source tools that are needed for any company to become data-driven. We’ll cover integration, transformation, orchestration, analytics, and ML tools as a starter guide to the latest open data stack. Let’s start with the Modern Data Stack. Have you heard of it or where the term came from?

Data 130
article thumbnail

Clustering on Normal, CLONE, COPY tables

Cloudyard

Read Time: 2 Minute, 32 Second During this post we will discuss multiple scenario on Clustering Tables. We will be analyzing and implementing the following scenarios in this post. Non Cluster to Cluster table : Create Clustering on Normal table and see the partitions pruning. CLONE Cluster table: CLONE the above Clustered table and analyze the Clustering.

IT 52
article thumbnail

CCC Webinar: Best Practices When Using XML Articles in AI, Machine Learning and Text Mining Projects

KDnuggets

Register now for this webinar on Jan. 12 to learn how to simplify the process of using scientific literature within your AI, machine learning, and text mining projects.

article thumbnail

Peak Performance: Continuous Testing & Evaluation of LLM-Based Applications

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

article thumbnail

What is ESG?

Precisely

Environmental, social, and governance (ESG) initiatives are topics of discussion everywhere – in the workplace, social media, news outlets, and beyond. And for good reason. Recent public advocacy efforts around climate issues, diversity and inclusion, data privacy, and more have been driving forces in pushing ESG to the forefront. While stellar products and services used to be enough for businesses to attract new customers, investors, and employees – and win their loyalty over time – that’s not

article thumbnail

Teradata’s Top 10 Innovations in 2022

Teradata

As we start 2023, our product marketing team has compiled a list of the top 10 features in Teradata Vantage which have immensely helped our customers and are technological breakthroughs.

article thumbnail

Recycling Kubernetes Nodes

Yelp Engineering

Manually managing the lifecycle of Kubernetes nodes can become difficult as the cluster scales. Especially if your clusters are multi-tenant and self-managed. You may need to replace nodes for various reasons, such as OS upgrades and security patches. One of the biggest challenges is how to terminate nodes without disturbing tenants. In this post, I’ll describe the problems we encountered administering Yelp’s clusters and the solutions we implemented.

article thumbnail

Micro, Macro & Weighted Averages of F1 Score, Clearly Explained

KDnuggets

Understanding the concepts behind the micro average, macro average, and weighted average of F1 score in multi-class classification with simple illustrations.

article thumbnail

How to Build an Experimentation Culture for Data-Driven Product Development

Speaker: Margaret-Ann Seger, Head of Product, Statsig

Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating

article thumbnail

Real-World Data Governance: The Role of Data Governance in a Data Strategy

Precisely

Does your company have a formal data strategy? If so, does that strategy effectively lay out a path toward better business outcomes by helping you optimize your use of data? Although it is a given that data can be one of a company’s real differentiators if used properly, many organizations still do not have a comprehensive data strategy in place.

article thumbnail

2023 Predictions: Data Trends That Will Dominate Business Agenda in APAC

Cloudera

In the past year, businesses who doubled down on digital transformation during the pandemic saw their efforts coming to fruition in the form of cost savings and more streamlined data management. Faced with even more pressure to remain resilient and agile amid looming global economic threats, Asia-Pacific (APAC) region businesses are looking to further mobilize emerging technologies such as artificial intelligence (AI) and machine learning that will optimize operational efficiencies and cost savi

Banking 52
article thumbnail

A Guide to Data Contracts

Striim

Companies need to analyze large volumes of datasets, leading to an increase in data producers and consumers within their IT infrastructures. These companies collect data from production applications and B2B SaaS tools (e.g., Mailchimp). This data makes its way into a data repository, like a data warehouse (e.g., Redshift), and is shown to users via a dashboard for decision-making.

article thumbnail

Unsupervised Disentangled Representation Learning in Class Imbalanced Dataset Using Elastic Info-GAN

KDnuggets

This рареr attempts to exploit primarily twо flaws in the Infо-GАN рареr while retаining the оther good qualities improvements.

Datasets 108
article thumbnail

Entity Resolution Checklist: What to Consider When Evaluating Options

Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.

article thumbnail

Precisely Women in Techology: Meet Samantha Kastin

Precisely

At Precisely, diversity is an inherent aspect of the company culture. Celebrating each other’s differences makes the team stronger as a whole. The Precisely Women in Technology (PWIT) program is a designated space for women in the company to learn from one another, support each other, provide career-growth advice, and share opportunities. Each month, a member of the PWIT group is featured to learn more about their experience as a woman in technology at Precisely.

article thumbnail

ON-DEMAND WEBINAR: Managing Stress in Data Engineering: Data Quality and Testing Techniques for Data Observability

DataKitchen

Why do 78% of data engineers wish their job came with a therapist to help manage work-related stress? THEY DO NOT TEST. The post ON-DEMAND WEBINAR: Managing Stress in Data Engineering: Data Quality and Testing Techniques for Data Observability first appeared on DataKitchen.

article thumbnail

More 2023 Tech and Industry Predictions from Teradata Experts

Teradata

From advances in AI/ML to the expansion of satellite/cellular services to expand coverage to remote areas, our tech & industry experts weigh in on game-changing predictions for 2023.

52
article thumbnail

How to Merge Pandas DataFrames

KDnuggets

Data merge is a common data processing activity. Learn how Pandas provide various ways to merge our data.

article thumbnail

The Path to Product Excellence: Avoiding Common Pitfalls and Enhancing Communication

Speaker: David Bard, Principal at VP Product Coaching

In the fast-paced world of digital innovation, success is often accompanied by a multitude of challenges - like the pitfalls lurking at every turn, threatening to derail the most promising projects. But fret not, this webinar is your key to effective product development! Join us for an enlightening session to empower you to lead your team to greater heights.

article thumbnail

How to Write Unit Tests for Forms in an Angular 15 Application Using Jasmine?

Workfall

Reading Time: 6 minutes In our previous blog, we demonstrated How to Write Unit Tests for Angular 15 Application Using Jasmine and Enforce Code Quality in a CI Workflow With Github Actions. We looked at general unit tests involving components that receive data from services. It is important to always ensure that Unit Tests are written in order to ensure that the quality of code being shipped to production is guaranteed to be free of any errors or bugs that can be avoided.

Coding 52
article thumbnail

Five books every developer should read by Peter Holman

Scott Logic

Here are five books that influenced my coding style and working practices early in my career. A top list of anything is deeply personal, so I’ve tried to select books I found both inspirational and informative, with an equal focus on technical and non-technical skills. Personally, I feel the content of these books will most benefit those at the start of their careers.

article thumbnail

Acceldata Data Observability Cloud v2.4.1 Introduces New Data Reliability and Compute Capabilities

Acceldata

We released the latest version of Acceldata Data Observability Cloud (ADOC). Version 2.4.1 is now generally available, and it provides enhancements to compute, data reliability, data pipeline management and orchestration, and introduces new monitoring and alerting capabilities.

Cloud 52
article thumbnail

Python Lambda Functions, Explained

KDnuggets

Learn the syntax and uses of the lambda function, which is an alternative to the regular Python function.

Python 115
article thumbnail

Reimagined: Building Products with Generative AI

“Reimagined: Building Products with Generative AI” is an extensive guide for integrating generative AI into product strategy and careers featuring over 150 real-world examples, 30 case studies, and 20+ frameworks, and endorsed by over 20 leading AI and product executives, inventors, entrepreneurs, and researchers.

article thumbnail

Introducing Data Products to Deliver Better Value from Data

Ascend.io

Businesses are increasingly reliant on new technologies to enable the use of data in new and innovative ways. However, most data leaders are finding that technology alone does not cause the organization to deliver new and valuable insights fast enough. Fundamentally, we need an approach that holistically supports the infrastructure, technology, and processes to convert raw data into something valuable and accessible.

Data 52
article thumbnail

Real-Time Data Predictions for 2023

Rockset

This blog compiles real-time data predictions from industry leaders so you know what’s coming in 2023. Here’s what made it into the short list: Streaming data will continue to see widespread adoption with cloud becoming the great enabler Real-time streaming data stacks will start to replace batch-oriented stacks Real-time streaming data stacks must impact the bottom line of the business New applications for streaming real-time data emerge: data applications + real-time ML Growth in the adoption

article thumbnail

Snowflake: Database Role

Cloudyard

Read Time: 4 Minute, 18 Second During this post we will discuss the significance of Database role in snowflake. Scenario 1: Consider a scenario there is SALES_ANALYST Account role exists in our Snowflake Account. This Role is authorized to have access on Database SALES_DB, Schema inside the DB, and all respective tables. To allow access on SALES_DB, will run the below GRANT commands accordingly.

article thumbnail

12 Essential Commands for Streamlit

KDnuggets

Learn about the most commonly used Streamlit commands and build a customized web application.

Building 114
article thumbnail

The Big Payoff of Application Analytics

Outdated or absent analytics won’t cut it in today’s data-driven applications – not for your end users, your development team, or your business. That’s what drove the five companies in this e-book to change their approach to analytics. Download this e-book to learn about the unique problems each company faced and how they achieved huge returns beyond expectation by embedding analytics into applications.