The Pragmatic Engineer
NOVEMBER 17, 2022
👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. We cover one out of five topics in today’s subscriber-only The Scoop issue. To get this newsletter every week, subscribe here. This article was updated in December 2022. In the midst of gloomy news about hiring freezes and layoffs, let's highlight companies which are growing and hiring.
Christophe Blefari
NOVEMBER 18, 2022
Scracthing the surface ( credits ) Hey you, a new Friday means data news. This week feels a bit like old data news with a variety of articles on different cool topics while I navigate through the actual data trends. Next Monday I'll present "How to build a data dream team" at Y42 meetup. I'll share in next week edition a written form of my talk.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Confessions of a Data Guy
NOVEMBER 16, 2022
Ok, so I don’t really mean all that. Or do I? I have no idea what the future holds. Sometimes it’s easy to pick out the winners, like Databricks and Snowflake, you can see, feel, and taste the results of those data products, a delicious and delectable bounty to feast upon. Other things are harder […] The post A Diatribe against Data Contracts and their Abuses. appeared first on Confessions of a Data Guy.
Jesse Anderson
NOVEMBER 15, 2022
My guest this week is Kulani Likotsi , the Head of Data Management and Data Governance at one of the four biggest banks in Africa. She’s had a rising career journey going from an analyst, to a Business Intelligence developer, to the data warehouse team, to the data governance team. I was impressed with Kulani’s volunteer spirit. Whenever there was a need, she volunteered.
Speaker: Maher Hanafi, VP of Engineering at Betterworks & Tony Karrer, CTO at Aggregage
Executive leaders and board members are pushing their teams to adopt Generative AI to gain a competitive edge, save money, and otherwise take advantage of the promise of this new era of artificial intelligence. There's no question that it is challenging to figure out where to focus and how to advance when it’s a new field that is evolving everyday. 💡 This new webinar featuring Maher Hanafi, CTO of Betterworks, will explore a practical framework to transform Generative AI prototypes into
The Pragmatic Engineer
NOVEMBER 16, 2022
I get a lot of scoop sent by readers (thank you!). Sadly, in 2022, a good part of the scoop is about companies laying off people. Some of this scoop has not been reported before. I don't want to broadcast layoffs on Twitter or LinkedIn continuously, but also don't want this information to be lost. This page collects scoops I receive, some of which might not have been reported elsewhere.
Data Engineering Podcast
NOVEMBER 13, 2022
Summary Building data products is an undertaking that has historically required substantial investments of time and talent. With the rise in cloud platforms and self-serve data technologies the barrier of entry is dropping. Shane Gibson co-founded AgileData to make analytics accessible to companies of all sizes. In this episode he explains the design of the platform and how it builds on agile development principles to help you focus on delivering value.
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
Netflix Tech
NOVEMBER 17, 2022
by Christos G. Bampis , Li-Heng Chen and Zhi Li When you are binge-watching the latest season of Stranger Things or Ozark, we strive to deliver the best possible video quality to your eyes. To do so, we continuously push the boundaries of streaming video quality and leverage the best video technologies. For example, we invest in next-generation, royalty-free codecs and sophisticated video encoding optimizations.
Teradata
NOVEMBER 17, 2022
"Doing more with less” is a familiar refrain echoing through the halls of many organizations. To answer this call, businesses are searching for efficiency gains & turning to data to unlock savings.
Data Engineering Podcast
NOVEMBER 13, 2022
Summary CreditKarma builds data products that help consumers take advantage of their credit and financial capabilities. To make that possible they need a reliable data platform that empowers all of the organization’s stakeholders. In this episode Vishnu Venkataraman shares the journey that he and his team have taken to build and evolve their systems and improve the product offerings that they are able to support.
KDnuggets
NOVEMBER 16, 2022
While different ways to learn Data Science for the first time exist, the approach that works for you should be based on how you learn best. One powerful method is to evolve your learning from simple practice into complex foundations, as outlined in this learning path recommended by a physicist who turned into a Data Scientist.
Speaker: Jason Tanner
While growth of software-enabled solutions generates momentum, growth alone is not enough to ensure sustainability. The probability of success dramatically improves with early planning for profitability. A sustainable business model contains a system of interrelated choices made not once but over time. Join this webinar for an iterative approach to ensuring solution, economic and relationship sustainability.
Confluent
NOVEMBER 17, 2022
The call for papers for Kafka Summit London 2023 has opened, and we’re looking to hear about your experiences using and working with Kafka. If you’re stuck looking for ideas on what to talk about, write what you know.
Cloudera
NOVEMBER 17, 2022
Cloudera’s November Volunteer Spotlight is Glaucia Esppenchutz , staff data engineer, based in Lisbon, Portugal. . Glaucia volunteers with Free Code Camp , an organization founded in 2014 that helps aspiring technicians learn to code for free. . Through the creation and publication of videos, articles, and interactive coding lessons — all freely available to the public — Free Code Camp is able to reach and train millions of people annually.
Lyft Engineering
NOVEMBER 17, 2022
Vulnerability Management at Lyft: Enforcing the Cascade - Part 1 Converting container scan data into tickets, linked with automated pull requests Abstract Over the past 2 years, we’ve built a comprehensive vulnerability management program at Lyft. This blog post will focus on the systems we’ve built to address OS and OS-package level vulnerabilities in a timely manner across hundreds of services run on Kubernetes.
KDnuggets
NOVEMBER 14, 2022
In this post, you will learn to clarify business problems & constraints, understand problem statements, select evaluation metrics, overcome technical challenges, and design high-level systems.
Advertisement
Generative AI is upending the way product developers & end-users alike are interacting with data. Despite the potential of AI, many are left with questions about the future of product development: How will AI impact my business and contribute to its success? What can product managers and developers expect in the future with the widespread adoption of AI?
Engineering at Meta
NOVEMBER 16, 2022
Code reviews are one of the most important parts of the software development process At Meta we’ve recognized the need to make code reviews as fast as possible without sacrificing quality We’re sharing several tools and steps we’ve taken at Meta to reduce the time waiting for code reviews When done well, code reviews can catch bugs , teach best practices , and ensure high code qualit y.
Cloudera
NOVEMBER 16, 2022
I recently had the privilege of attending the CDAO event in Boston hosted by Corinium. Tracks represented financial services, insurance, retail and consumer packaged goods, and healthcare. Overall, it struck me that while data science is not new, most firms are still defining the mission of the data office and data officer. It’s clear firms seek to leverage data and embrace its potential insights, but most are forging ahead in largely uncharted territory.
Striim
NOVEMBER 18, 2022
It’s a Tuesday night. A nurse in the emergency department (ED) receives an alert on her smartphone: the ED will be overcrowded after 1.5 hours. The alert also gives suggestions, such as the number of beds that will be filled or what type of care will be required. The nurse uses this information to communicate with transport, radiology, and lab teams to make the necessary preparations.
KDnuggets
NOVEMBER 16, 2022
Based on the recent discussions with dozens of Fortune 500 data science teams, we can expect to see a continued spotlight on AI model quality in 2023.
Advertisement
Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.
Cloudyard
NOVEMBER 17, 2022
Read Time: 3 Minute, 0 Second SSO Login with Azure Active Directory: During this post we will discuss configure SSO (single sign-on) to connect with Snowflake via Azure Active Directory. With SSO enabled, your users authenticate through an external, SAML 2.0-compliant identity provider (IdP). Once authenticated by this IdP, users can securely initiate one or more sessions in Snowflake for the duration of their IdP session without having to log into Snowflake.
Cloudera
NOVEMBER 15, 2022
CDP Operational Database (COD) is a real-time auto-scaling operational database powered by Apache HBase and Apache Phoenix. It is one of the main data services that run on Cloudera Data Platform (CDP) Public Cloud. You can access COD from your CDP console. The cost savings of cloud-based object stores are well understood in the industry. Applications whose latency and performance requirements can be met by using an object store for the persistence layer benefit significantly with lower cost of o
DataKitchen
NOVEMBER 18, 2022
Part 3: Considering the Elements of Data Journeys. This is the third post in DataKitchen’s four-part series on DataOps Observability. Observability is a methodology for providing visibility of every journey that data takes from source to customer value across every tool, environment, data store, team, and customer so that problems are detected and addressed immediately.
KDnuggets
NOVEMBER 16, 2022
Knowing git is no longer an option for data professionals. Grab this handy reference sheet now and make sure you know how to git the job done.
Speaker: Timothy Chan, PhD., Head of Data Science
Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.
U-Next
NOVEMBER 18, 2022
Introduction . Artificial Intelligence (AI) is a process of programming computers to make decisions for themselves. This technology creates intelligent applications capable of reasoning, learning, and acting independently. Among many things, AI finds innumerable applications in cloud computing. Cloud computing delivers computing services—including servers, storage, databases, networking, software, analytics, and intelligence—over the Internet (“the cloud”) to offer faster innovation
Cloudera
NOVEMBER 18, 2022
Introduction. Stream processing is about creating business value by applying logic to your data while it is in motion. Many times that involves combining data sources to enrich a data stream. Flink SQL does this and directs the results of whatever functions you apply to the data into a sink. Business use cases, such as fraud detection , advertising impression tracking, health care data enrichment, augmenting financial spend information, GPS device data enrichment, or personalized customer commun
DataKitchen
NOVEMBER 18, 2022
. Question: What is the difference between Data Quality and Observability in DataOps? Data Quality is static. It is the measure of data sets at any point in time. Data Observability is dynamic — it is the testing of data, integrated data, and tools acting upon data — as it is processed — that checks for flow rates and data errors.
KDnuggets
NOVEMBER 18, 2022
Read research papers on neural models, word embedding, language modeling, and attention & transformers.
Speaker: John Mansour
If you're looking to advance your career in product management, there are more options than just climbing the management ladder. Join our upcoming webinar to learn about highly rewarding career paths that don't involve management responsibilities. We'll cover both career tracks and provide tips on how to position yourself for success in the one that's right for you.
U-Next
NOVEMBER 18, 2022
Introduction . The usage of AI technology has been on the rise in the business world, especially when it comes to creating business strategies. . Artificial Intelligence (AI) and Machine Learning are currently used by businesses to make their operations more efficient, improve customer experience and achieve better results. As per Artificial Intelligence Statistics 2022 , AI adoption by businesses around the globe continued at a steady pace in 2022, with more than a third of companies (35%) re
Monte Carlo
NOVEMBER 16, 2022
Last month at IMPACT 2022: The Data Observability Summit, I had the distinct privilege of chatting with Daniel Kahneman, Nobel Prize-winning economist and author of one of my favorite books, Thinking, Fast and Slow. Most notably, Daniel discussed the difference between two major types of thinking: System 1, decision making that operates automatically (say, doing simple multiplication) and System 2, decision making that requires effort and attention (for instance, a complex Calculus problem).
Emeritus
NOVEMBER 15, 2022
Data has become a pivotal asset for all businesses but it can prove useless if it isn’t leveraged effectively. That’s where data engineering comes in. It lays down the foundation for data science applications by preparing raw data for collection and analysis. Specialized in a practice that mainly focuses on the end application of data… The post What is Data Engineering?
KDnuggets
NOVEMBER 18, 2022
The post explains all the key elements of SQL that you must know as a data science practitioner.
Advertisement
Start-ups & SMBs launching products quickly must bundle dashboards, reports, & self-service analytics into apps. Customers expect rapid value from your product (time-to-value), data security, and access to advanced capabilities. Traditional Business Intelligence (BI) tools can provide valuable data analysis capabilities, but they have a barrier to entry that can stop small and midsize businesses from capitalizing on them.
Expert insights. Personalized for you.
134 
Let's personalize your content