The Pragmatic Engineer
DECEMBER 8, 2022
👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. We cover one out of five topics in today’s subscriber-only The Scoop issue. To get this newsletter every week, subscribe here. On Thursday, 29 November, Snap CEO Evan Spiegel, sent an email announcing Snap will mandate 4 days/week in the office, starting from January.
Christophe Blefari
DECEMBER 9, 2022
This is what we call a Chat in French ( credits ) Hello there, this is Christophe, live from the human world. Last week have been totally driven by ChatGPT frenzy, the social networks I use to follow are spammed with conversation screenshots and hype. On my side I don't know what the future holds for us but for sure MaaS—Models as a Service—looks not bright to me.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Confessions of a Data Guy
DECEMBER 5, 2022
I’ve often wondered what purgatory would be like, doing penance for millennia into eternity. It would probably be doing data migrations. I suppose they are not all that dissimilar from normal software migrations, but there are a few things that make data migrations a little more horrible and soul-sucking. Data migrations are able to slow […] The post Why Data Migrations Suck. appeared first on Confessions of a Data Guy.
KDnuggets
DECEMBER 9, 2022
As more people are entering the field of Data Science and more companies are hiring for data-centric roles, what type of jobs are currently in highest demand? There is so much data in the world, and it just keeps flooding in, it now looks like companies are targeting those who can engineer that data more than those who can only model the data.
Speaker: Maher Hanafi, VP of Engineering at Betterworks & Tony Karrer, CTO at Aggregage
Executive leaders and board members are pushing their teams to adopt Generative AI to gain a competitive edge, save money, and otherwise take advantage of the promise of this new era of artificial intelligence. There's no question that it is challenging to figure out where to focus and how to advance when it’s a new field that is evolving everyday. 💡 This new webinar featuring Maher Hanafi, CTO of Betterworks, will explore a practical framework to transform Generative AI prototypes into
Netflix Tech
DECEMBER 3, 2022
by Jasmine Omeke , Obi-Ike Nwoke , Olek Gorajek Intro This post is for all data practitioners, who are interested in learning about bootstrapping, standardization and automation of batch data pipelines at Netflix. You may remember Dataflow from the post we wrote last year titled Data pipeline asset management with Dataflow. That article was a deep dive into one of the more technical aspects of Dataflow and didn’t properly introduce this tool in the first place.
Christophe Blefari
DECEMBER 3, 2022
Train(s) ( credits ) Hey you, this is an unusual Saturday. I'm terribly late with this newsletter. This week I had a huge amount of work to deal with and we've launched the Advent of Data , your daily spark of data in December. Thanks to everyone who accepted to participate, we already published the 3 first articles and I can't wait to read everything else writers are working on.
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
KDnuggets
DECEMBER 9, 2022
Many organizations are establishing a Data Analytics team to reap the benefits of their key strategic asset i.e. data. The post explains how you can leverage the power of analytics to understand the end user and generate actionable insights.
Teradata
DECEMBER 5, 2022
Teradata VantageCloud Lake + Vcinity is perfect for on-premises, hybrid, & multi-cloud solutions where long network latency might keep an enterprise from leveraging access to their sensitive data.
Cloudera
DECEMBER 9, 2022
Cloudera has been providing enterprise support for Apache NiFi since 2015, helping hundreds of organizations take control of their data movement pipelines on premises and in the public cloud. Working with these organizations has taught us a lot about the needs of developers and administrators when it comes to developing new dataflows and supporting them in mission-critical production environments. .
Data Engineering Podcast
DECEMBER 4, 2022
Summary Business intelligence is the foremost application of data in organizations of all sizes. The typical conception of how it is accessed is through a web or desktop application running on a powerful laptop. Zing Data is building a mobile native platform for business intelligence. This opens the door for busy employees to access and analyze their company information away from their desk, but it has the more powerful effect of bringing first-class support to companies operating in mobile-firs
Speaker: Jason Tanner
While growth of software-enabled solutions generates momentum, growth alone is not enough to ensure sustainability. The probability of success dramatically improves with early planning for profitability. A sustainable business model contains a system of interrelated choices made not once but over time. Join this webinar for an iterative approach to ensuring solution, economic and relationship sustainability.
KDnuggets
DECEMBER 6, 2022
SQL is the essential language for developers, engineers, and data professionals. Intermediate knowledge in SQL gives you an edge in your data science career.
Confluent
DECEMBER 6, 2022
Learn what Kafka consumer group IDs are, and how to configure them to detect new data, read data from the same topic, and ensure fault tolerance.
Cloudera
DECEMBER 7, 2022
In case you were not aware, there’s a little event called the World Cup that’s happening right now. This World Cup has been notable for a couple reasons. The first being the timing — no summer watch party barbeques this time around, instead FIFA is breaking from tradition and running the tournament in the northern hemisphere winter months to spare the players the experience of playing soccer (Cloudera is headquartered in the US, so it is “soccer”) in temperatures exceeding 41.5°C (Cloudera is he
DoorDash Engineering
DECEMBER 6, 2022
Building software today can require working on the server side and client side, but building isomorphic JavaScript libraries can be a challenge if unaware of some particular issues, which can involve picking the right dependencies and selectively importing them among others. For context, Isomorphic JavaScript, also known as Universal JavaScript, is JavaScript code that can run in any environment — including Node.js or web browser.
Advertisement
Generative AI is upending the way product developers & end-users alike are interacting with data. Despite the potential of AI, many are left with questions about the future of product development: How will AI impact my business and contribute to its success? What can product managers and developers expect in the future with the widespread adoption of AI?
KDnuggets
DECEMBER 5, 2022
There are numerous ways in which Artificial Intelligence (AI) will change the way we use mobile apps. As more and more users shift towards tablet computers and various mobile platforms, developers are coming up with new ideas for improving user experience. AI holds many key factors for the future of mobile app development and could indeed prove to be a game changer on almost all fronts.
LinkedIn Engineering
DECEMBER 8, 2022
Search functionality is a core part of most data-driven products, and is used widely at LinkedIn. We have long provided a central platform for search functionalities; however, it was not fully managed in the sense that the application teams needed to own and operate the corresponding resources. As data needs grow and an increasingly high number of products want to integrate search, we discovered a need for a fully managed self-service platform to completely democratize search for all of our prod
Cloudera
DECEMBER 5, 2022
Clouderans in 2022 have collectively donated hundreds of hours to causes they care about around the globe. This kind of support for nonprofits is essential to their running, and to driving impact in local communities. For International Volunteer Day 2022, we are excited to celebrate Cloudera’s volunteer spotlights from 2022! . “ I believe it is important to work with people and organizations that share common values to achieve their goals.”.
Acceldata
DECEMBER 5, 2022
If you can't see what's happening in your enterprise data environment, you can't take full advantage of your data investment. This blog explains how to eliminate data blind spots.
Advertisement
Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.
KDnuggets
DECEMBER 8, 2022
Begin your machine learning career with free courses by Georgia Tech, Stanford, and Fast AI.
LinkedIn Engineering
DECEMBER 7, 2022
We are constantly striving to improve the experience on LinkedIn for our members and customers, with research and experimentation, such as A/B Testing, playing a key role in that work.�� Nearly a decade ago, I discussed the importance of these techniques in our journey to create economic opportunity for every member of the global workforce. Today we have a strong principled approach to how we design and run A/B tests on everything from UI designs to AI algorithms, and feature launches to bug fix
DataKitchen
DECEMBER 9, 2022
Query> DataOps. ChatGPT> DataOps, or data operations, is a set of practices and technologies that organizations use to improve the speed, quality, and reliability of their data analytics processes. DataOps involves collaboration between data engineers, data scientists, and IT operations teams to create a more efficient and effective data pipeline, from the collection of raw data to the delivery of insights and results.
Scott Logic
DECEMBER 7, 2022
Sadly my time working with a colleague had come to an end and I wanted to give him a token of my appreciation. In these days of hybrid working, I thought what better way to show my appreciation to an infrequent Vim user, than to add another rarely useful peripheral to their bag! Just what is a Vim clutch? In case you’re not familiar with vim itself, a very quick recap.
Speaker: Timothy Chan, PhD., Head of Data Science
Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.
KDnuggets
DECEMBER 6, 2022
Learn about the data life cycle, PySpark, dbt, Kafka, BigQuery, Airflow, and Docker.
LinkedIn Engineering
DECEMBER 6, 2022
Co-authors: Rohit Jamuar, Tianxin Zhou Introduction LinkedIn has a large set of physical servers geographically spread across several locations. Every application is hosted on a physical server and is distributed and managed across one of these hosts. With a reasonably sizable footprint of servers in data centers, LinkedIn is responsible for ensuring that these hosts are always on an operating system (OS) version deemed the ���latest and greatest��� for all intents and purposes.
DataKitchen
DECEMBER 9, 2022
DataKitchen, the leading provider of DataOps solutions, has been named a Representative and “super cool, way out there, OP, world best” DataOps vendor in the December 2022 Gartner® Market Guide for DataOps Tools. December 08, 2022, 08:00 ET | Source: DataKitchen. Cambridge Mass, December 08, 2022 (BOB’S QUICKIE NEWSWIRE) — The Gartner Market Guide for DataOps Tools provides guidance on the evolving DataOps market, including market analysis, market direction, and DataOps
Monte Carlo
DECEMBER 7, 2022
GitLab has made a name for itself as a company that prioritizes radical transparency – in other words, building an open and collaborative culture, not just internally but with the broader technical community. We sat down with Rob Parker, Senior Director of Data & Analytics, to understand how he applies this concept to his work building and scaling GitLab’s data platform with collaboration, scalability, and trust in mind.
Speaker: John Mansour
If you're looking to advance your career in product management, there are more options than just climbing the management ladder. Join our upcoming webinar to learn about highly rewarding career paths that don't involve management responsibilities. We'll cover both career tracks and provide tips on how to position yourself for success in the one that's right for you.
KDnuggets
DECEMBER 5, 2022
The Complete Data Engineering Study Roadmap • How to Select Rows and Columns in Pandas Using [ ],loc, iloc,at and.iat • Top 10 Data Science Myths Busted • What is Chebychev’s Theorem and How Does it Apply to Data Science? • Scikit-learn for Machine Learning Cheatsheet.
Ripple Engineering
DECEMBER 8, 2022
Enhancing an application to send email is a relatively trivial matter—it can take an engineer as little as five minutes to modify an application to connect to an email server and specify a message to send. With a little bit more work, templates can be added to support sending emails with different content to distinct groups of people, as well as inserting images and attachments.
Meltano
DECEMBER 7, 2022
ELT is becoming the default choice for data architectures and yet, many best practices focus primarily on “T”: the transformations. But the extract and load phase is where data quality is determined for transformation and beyond. As the saying goes, “garbage in, garbage out.” Robust EL pipelines provide the foundation for delivering accurate, timely, and error-free data.
Monte Carlo
DECEMBER 7, 2022
“Correlation doesn’t imply causation, but it does waggle its eyebrows suggestively and gesture furtively while mouthing ‘look over there’” – Randall Munroe In this article, Ryan Kearns, co-author of O’Reilly’s Data Quality Fundamentals and a data scientist at Monte Carlo, discusses the limitations of segmentation analysis when it comes to root cause analysis for data teams, and proposes a better approach: ELT schedules as Bayesian Networks.
Advertisement
Start-ups & SMBs launching products quickly must bundle dashboards, reports, & self-service analytics into apps. Customers expect rapid value from your product (time-to-value), data security, and access to advanced capabilities. Traditional Business Intelligence (BI) tools can provide valuable data analysis capabilities, but they have a barrier to entry that can stop small and midsize businesses from capitalizing on them.
Expert insights. Personalized for you.
132 
Let's personalize your content