DATA Pill #093 - Looker, Streaming Analytics with Flink and RAGOps

Hi,

2 massive case studies,

nice video around RAGOps,

recommended in today's Pill.?

ARTICLES

Level up your dbt tests to catch loud and silent data issues at scale | 4 min | Data Engineering | Emil Bring | Validio.io Blog

Integrating Validio with dbt offers advanced data testing capabilities beyond traditional methods, addressing scalability issues and uncovering silent anomalies. By combining dbt tests with Validio's ML-powered detection, teams ensure high-quality data, enabling engineers and consumers to maintain reliability throughout the pipeline.?

What’s new with Looker 2024? | 7 min | AI | Hanna Le | Personal Blog

The article serves as a summary of the significant changes, highlighting important information for Looker users. In addition to introducing the integrated Looker experience and Google GenAI, performance enhancements are also planned.

Streaming Analytics for the Digital Asset Risk Management System - Cloudwall Success Story | 9 min | Streaming Analytics | Maciej Maciejko, Klaudia Wachnio | GetInData | Part of Xebia Blog

How can you reduce data processing time to milliseconds for 100 million messages per hour? Ensure data quality and optimize infrastructure costs. The GetInData team chose Apache Flink for streaming analytics architecture. Explore their real-time market data platform for fast issue resolution.

In MORE LINKS you will read about: How Uber Serves Over 40 Million Reads Per Second from Online Storage Using an Integrated Cache

{ MORE LINKS }

TUTORIALS

How to Adopt Your LLM for Question Answering with Prompt-Tuning using NVIDIA Nemo Weights & Biases | Anish Shah | 12 min | LLM | MLOps Community

A tutorial on prompt-tuning and p-tuning using NeMo alongside W&B, complete with an experiment and executable code.

In MORE LINKS you will read about: Data Quality Management With Databricks

{ MORE LINKS }

TOOL

How Dataherald Makes Natural Language to SQL Easy | 4 min | LLM | Ming | Langchain Blog

Text-to-SQL technology, providing developers strong NL-to-SQL translation through LangChain, addressing challenges of semantic accuracy and dataset-specific fine-tuning. Its two agents enable diverse applications, from conversational interfaces to self-serve data access, with ongoing developments ensuring continued innovation in the field.

NEWS

Gemma: Introducing new state-of-the-art open models | 9 min | LLM | Jeanine Banks, Tris Warkentin | Google Blog

Gemma is developed by Google DeepMind and other Google teams, drawing inspiration from the Gemini models. Gemma has accompanying tools to promote developer innovation, encourage collaboration, and ensure responsible usage.?

DATA TUBE

RAGOps: Advanced Retrieval Strategies with LangChain, Langsmith and Supabase | 49 min | RAG | Prince Canuma | Personal Channel

This video will guide you through setting up each pipeline step, along with monitoring, evaluation, and enhancing your prompts and document processing. Also, get an inside look at how Kulissiwa team optimize their RAG pipelines using LangChain, Langsmith, and Supabas

CONFS EVENTS AND MEETUPS

Apache Airflow Meetup | Warsaw | 21st March

We'll talk about the newest trends and developments in Airflow, the contribution and development process itself, in particular testing provider packages. The agenda is still open - don't hesitate to contact us if you'd like to present!

________________________

Have any interesting content to share in the DATA Pill newsletter?

? Join us on GitHub

? Dig previous editions of DataPill?

Adam from the GetInData | Part of Xebia