Data Engineering Weekly

APRIL 23, 2023

The highlight of the blog for me is LLMs require an immense amount of data to train. Varshita Sher: A Gentle Intro to Chaining LLMs, Agents, and Utils via LangChain As I continued my quest to learn more about LLM and its infrastructure, the author explained LLM, Agents, and Utils via LangChain pretty well.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Pipeline 52

Data Engineering Weekly

APRIL 16, 2023

The blog narrates the difference between deterministic and non-deterministic system design and the challenges of building LLM applications in production. The author explains the difference between prompting and fine-tuning and when to choose what. I print this out and read it a couple of times. Airflow is obsolete.

Data Engineering 52

Data Engineering Data Engineer Engineering Pipeline-centric 52

Data Engineering Weekly

APRIL 9, 2023

The Google research paper "Because AI is 100% right and safe": User Attitudes and Sources of AI Authority in India describes the challenges in AI & trustability. The blog also discusses two burning questions everyone is debating. The author broadly split the MLOps into four categories and explains the relevance of data engineering.

Data Engineering 52

Data Engineering Data Engineer Engineering AWS 52