AltexSoft
JULY 10, 2023
Imagine walking through an art exhibition at the renowned Gagosian Gallery , where paintings seem to be a blend of surrealism and lifelike accuracy. One particular piece catches your eye: it depicts a child staring at the viewer with wind-tossed hair, evoking the feel of the Victorian era through its coloring and what appears to be a simple linen dress.
Analytics Vidhya
JULY 25, 2023
In the world of data, two crucial roles play a significant part in unlocking the power of information: Data Scientists and Data Engineers. But what sets these wizards of data apart? Welcome to the ultimate showdown of Data Scientist vs Data Engineer! In this captivating journey, we’ll explore the distinctive paths these tech titans take […] The post Data Engineer vs Data Scientist: Which Career to Choose?
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Confessions of a Data Guy
JULY 22, 2023
Nothing gives me greater joy than rocking the boat. I take pleasure in finding what people love most in tech and trying to poke holes in it. Everything is sacred. Nothing is sacred. I also enjoy doing simple things, things that have a “real-life” feel to them. I suppose I could be like the others […] The post Polars vs Pandas. Inside an AWS Lambda. appeared first on Confessions of a Data Guy.
The Pragmatic Engineer
JULY 6, 2023
Originally published 6 July 2023 👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. We cover one out of six topics in today’s subscriber-only The Scoop issue. If you’re not yet a full subscriber, you missed this week’s deep-dive on What a senior engineer is at Big Tech. To get the full issues twice a week, subscribe here.
Speaker: Dr. Greg Loughnane and Chris Alexiuk
Technology professionals developing generative AI applications are finding that there are big leaps from POCs and MVPs to production-ready applications. They're often developing using prompting, Retrieval Augmented Generation (RAG), and fine-tuning (up to and including Reinforcement Learning with Human Feedback (RLHF)), typically in that order. However, during development – and even more so once deployed to production – best practices for operating and improving generative AI applications are le
Data Engineering Podcast
JULY 30, 2023
Summary All software systems are in a constant state of evolution. This makes it impossible to select a truly future-proof technology stack for your data platform, making an eventual migration inevitable. In this episode Gleb Mezhanskiy and Rob Goretsky share their experiences leading various data platform migrations, and the hard-won lessons that they learned so that you don't have to.
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
Knowledge Hut
JULY 28, 2023
Machine learning for anomaly detection is crucial in identifying unusual patterns or outliers within data. It plays a vital role in cybersecurity, finance, healthcare, and industrial monitoring. By learning from historical data, machine learning algorithms autonomously detect deviations, enabling timely risk mitigation. They excel at identifying subtle anomalies and adapt to changing patterns.
Analytics Vidhya
JULY 6, 2023
Introduction In this era of Generative Al, data generation is at its peak. Building an accurate machine learning and AI model requires a high-quality dataset. The quality assurance of the dataset is the most critical task, as poor data causes inaccurate analytics and unidentified predictions that can affect the entire repo of any business and […] The post Getting Started with Amazon SageMaker Ground Truth appeared first on Analytics Vidhya.
Medium Data Engineering
JULY 23, 2023
Прочитал на выходных простую книгу про построение конвейеров данных для дата инже
The Pragmatic Engineer
JULY 20, 2023
👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. In every issue, I cover topics related to Big Tech and startups through the lens of engineering managers and senior engineers. In this article, we cover one out of five topics from today’s subscriber-only deepdive on Advice on how to sell a startup. To get full issues twice a week, subscribe here.
Advertisement
Are you thinking of adding enhanced data matching and relationship detection to your product or service? Do you need to know more about what to look for when assessing your options? The Senzing Entity Resolution Buyer’s Guide gives you step-by-step details about everything you should consider when evaluating entity resolution technologies. You’ll learn about use cases, technology and deployment options, top ten evaluation criteria and more.
Towards Data Science
JULY 24, 2023
While there is no right answer, there is likely a sweet spot for most organizations’ data platforms. Read on to see where that might be. Photo by Kelly Sikkema on Unsplash Data engineers discovered the benefits of conscious uncoupling around the same time as Gwyneth Paltrow and Chris Martin in 2014. Of course, instead of life partners, engineers were starting to gleefully decouple storage and compute with emerging technologies like Snowflake (2012), Databricks (2013), and BigQuery (2010).
The Modern Data Company
JULY 31, 2023
Modern Announces Partnership with Data Mesh Pioneers, ThoughtWorks In July, we collaborated with ThoughtWorks at the annual CDOIQ Conference in Cambridge, MA to discuss real-world Data Products implementation and best practices for Data Mesh. The data community, especially CDOs, emphasized the importance of raising awareness and gaining clarity about data products.
Knowledge Hut
JULY 26, 2023
Hybrid project management refers to combining two or more methodologies, thereby allowing a project manager to enjoy the benefits of multiple methodologies. This project management methodology allows you the flexibility to use elements from different methodologies. Organizations that harness hybrid project management methods are more likely to reap the benefits like speed, adaptability, flexibility, etc.
KDnuggets
JULY 31, 2023
Google's BQML can be used to make time series models, and recently it was updated to create multivariate time series models. With the simple code, this article shows how to use it to predict multivariate time series and it can be more powerful than a univariate time series model in this article.
Medium Data Engineering
JULY 24, 2023
Remote REST API + S3 + Remote Postgres Database — This data pipeline covers an advanced use case comparison between Airflow, Prefect, and… Continue reading on Geek Culture »
The Pragmatic Engineer
JULY 13, 2023
👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. We cover one out of six topics in today’s subscriber-only The Pulse issue. If you’re not yet a full subscriber, you missed this week’s deep-dive on Software architect archetypes. To get the full issues, twice a week, subscribe here. Before we start, a small change.
Towards Data Science
JULY 10, 2023
A simple framework for building dbt models that actually get used. When I was researching the Ultimate Guide to dbt , I was shocked by the lack of material around actually building models from scratch. Not the exact steps to take in the tool — that is all covered in innumerable blogs and tutorials. I mean how do you know the right design? How do you make sure your stakeholders will use that model?
Monte Carlo
JULY 19, 2023
Building a data stack doesn’t have to be complicated. Here’s what data leaders say are the 5 must-have layers of your data platform to drive data adoption – and ROI – across your business. Like bean dip and ogres , layers are the building blocks of the modern data stack. Its powerful selection of tooling components combine to create a single synchronized and extensible data platform with each layer serving a unique function of the data pipeline.
Knowledge Hut
JULY 14, 2023
Onion Routing is a method of communicating anonymously across a computer network. The layers of encryption that protect messages in an onion network are comparable to the layers of an onion. The encrypted data is sent through a network of "onion routers," or network nodes, each of which "peels" away a single layer to disclose the encrypted data's destination.
Snowflake
JULY 13, 2023
ESO is the largest software and data solutions provider to emergency medical services (EMS) agencies and fire departments in the U.S. With a mission to improve community health and public safety through the power of data, ESO makes software that helps save lives. If you call 911 and a fire or medical team responds, it’s likely they’re using ESO software to make sure you get the right help fast.
Medium Data Engineering
JULY 22, 2023
บทความนี้เขียนเพื่อแชร์ความรู้ในการใช้งาน DBT ของผมเอง ซึ่งอาจจะมีประโยชน์สำ
Confluent
JULY 18, 2023
Gain the easiest solution for data streaming and increase data flow to your platform through native integrations with Confluent Cloud and 120+ Kafka connectors.
Pinterest Engineering
JULY 25, 2023
Soam Acharya | Data Engineering Oversight; Keith Regier | Data Privacy Engineering Manager Background Businesses collect many different types of data. Each dataset needs to be securely stored with minimal access granted to ensure they are used appropriately and can easily be located and disposed of when necessary. As businesses grow, so does the variety of these datasets and the complexity of their handling requirements.
Rock the JVM
JULY 26, 2023
by Herbert Kateu Hey, it’s Daniel here. You’re reading a giant article about a real-life use of the Http4s library. If you want to master the Typelevel Scala libraries (including Http4s) with real-life practice, check out the Typelevel Rite of Passage course, a full-stack project-based course. It’s my biggest and most jam-packed course yet. 1. Introduction This article is a continuation of the authentication methods that were covered in part1.
Knowledge Hut
JULY 4, 2023
Pattern recognition is a field of computer science that deals with the automatic identification of patterns in data. This can be done by finding regularities in the data, such as correlations or trends, or by identifying specific features in the data. Pattern recognition is used in a wide variety of applications, including Image processing, Speech recognition, Biometrics, Medical diagnosis, and Fraud detection.
Towards Data Science
JULY 5, 2023
And how to ingest valuable data for free Photo by Tobias Fischer on Unsplash Data modeling can be a challenging task for analytics teams. With unique business entities in every organization, finding the right structure and granularity for each table becomes open-ended. But fear not! Some of the data you need is simplistic, free, and occupies minimal storage.
Medium Data Engineering
JULY 19, 2023
The sudo command is a super user command that grants users of a provisioned instance in the cloud permission to perform a whole lot of various actions in the cloud instance.
databricks
JULY 31, 2023
Today, we are excited to announce the public preview of Databricks Assistant, a context-aware AI assistant, available natively in Databricks Notebooks, SQL editor.
KDnuggets
JULY 28, 2023
The highly anticipated Python edition of Introduction to Statistical Learning is here. And you can read it for free! Here’s everything you need to know about the book.
The Modern Data Company
JULY 24, 2023
In the modern data-driven landscape, organizations are constantly seeking ways to extract valuable insights from their data assets. While individual data products provide significant value, the true potential lies in harnessing the power of interconnected data products. By chaining data products together, organizations can unlock new levels of data-driven decision-making and drive impactful use cases.
Knowledge Hut
JULY 6, 2023
Lean in project management, where the word ‘lean’ is associated with less wastage and more value addition. Lean is an Agile methodology that helps industries to improve productivity, increase customer value, eliminate problems, enhance the organization’s processes, reduce waste, and encourage continuous improvement. Historically, it was first introduced in the manufacturing industry, but today it is prevalent in almost every industry, including healthcare, education, software d
Towards Data Science
JULY 21, 2023
Spinning up a data platform doesn’t have to be complicated. Here are the 5 must-have layers to drive data product adoption at scale. Image courtesy of author. We hope it doesn’t make your eyes water. Like bean dip and ogres , layers are the building blocks of the modern data stack. Its powerful selection of tooling components combine to create a single synchronized and extensible data platform with each layer serving a unique function of the data pipeline.
Medium Data Engineering
JULY 23, 2023
Following a sequence of articles on APACHE BEAM, here we will describe how to deploy a streaming pipeline, created locally, to Google… Continue reading on Medium »
Expert insights. Personalized for you.
64 
Let's personalize your content