Democratizing data with Graph RAG: What it is, What it can do, How to evaluate it
Democratizing access to data and insights is probably the biggest reason behind the meteoric rise of Generative AI and Large Language Models (LLMs).
LLMs come with both promise and limitations. The most severe and well-known limitation is the fact that they're not trustworthy.
Retrieval-augmented generation (RAG) is an attempt to fix that, and Graph RAG is a variation which has emerged to prominence in the last few months.
So much so, in fact, that Graph RAG is already bigger than Knowledge Graphs in terms of mindshare.
What this means is that there are now many people who are drawn to Graph RAG without knowing much about Knowledge Graphs.
This, and the fact that i have a practical Graph RAG use case, motivated me to document my experience so far.
I go over the background, different Graph RAG architectures, how it works in practice, how to evaluate it, and what's next.
I hope you will find it useful, and i'm looking forward to your feedback.
Shout-out to those whose work inspired and supported this: Amy Hodler Katariina Kari Paco Nathan Panos Alexopoulos Andreas Blumauer Giuseppe Futia, PhD Heather Hedden Juan Sequeda Ivo Velitchkov Andrea Volpini Jay (JieBing) Yu, PhD Atanas Kiryakov Tomaz Bratanic Ben Lorica 罗瑞卡 Prashanth Rao Morgan Senechal James Phare Mike Dillinger, PhD
To continue the conversation, you can join myself, Jorge Arango , Matteo Casu and Prasad Yalamanchi this Friday in the "Designing Graph RAG Architecture" panel hosted by the SWARM Community
And you can also follow The Year of the Graph and Connected Data
Nuclia | The RAG-as-a-Service company
6 个月Hi George Anadiotis, in case you'd be interested, Nuclia ? AI Search & RAG as a Service just released the first open-source RAG evaluation model. - Article: https://nuclia.com/developers/remi-open-source-rag-evaluation-model/ - Hugging Face: https://huggingface.co/nuclia/REMi-v0 REMi?is an adapter on top of Mistral AI’s?Mistral 7B v0.3 Instruct. It has been fine-tuned on our proprietary dataset. It takes advantage of function-calling/tool-use capabilities to generate a structured output that is consistent and easily parsable to the schema of the desired metrics.
?? Building bridges @naas.ai Universal Data & AI Platform | Research Associate in Applied Ontology | Senior Advisor Data & AI Services
7 个月Well done George Anadiotis
George Anadiotis, Thank you so much for writing this article and opening up your use case for open evaluation and learning on graphrag and other rag technologies. I shared my excitement and appreciation via my repost here: https://www.dhirubhai.net/posts/jay-jiebing-yu-phd-7b97a8_knowledgegraph-ai-genai-activity-7220782701190995968-vYvg?utm_source=share&utm_medium=member_desktop .
Associate Professor of Geographical Analysis at University of the Aegean, Department of Geography
7 个月Very nice George! Thanks
Emerging Science & Technology Professional ? Healthcare AI Expert ? Experienced Consultant ? Startup Founder
7 个月Raju Rayavarapu