How RAG Turns AI Chatbots Into Something Practical

Check out ThinkBuddy using the code "BYCLOUD" in the link: https://thinkbuddy.ai/ltd to get your discount!

my newsletter: https://mail.bycloud.ai/

Retrieval augmented generation, a current popular method to utilize LLMs to retrieve from a database instead of putting everything in a context window. But how does it work? Today I will walk through the most basic idea of RAG and the current meta of how RAG is used, and what it is composed of.


My own RAG experiment on 1TB of PDFs:
https://youtu.be/KL5Au8pKJ38

some papers
[Web + RAG] https://arxiv.org/abs/2408.07611
[Vector + KG RAG] https://arxiv.org/abs/2408.04948
[RAG Survey] https://arxiv.org/abs/2404.10981

[Knowledge Graph for RAG] https://docs.llamaindex.ai/en/stable/examples/query_engine/knowledge_graph_rag_query_engine/
[LlamaIndex] https://www.llamaindex.ai/
[LlamaParse] https://docs.llamaindex.ai/en/stable/llama_cloud/llama_parse/
[HuggingFace] https://huggingface.co/models
[Cohere Command R+] https://docs.cohere.com/docs/command-r-plus
[Cohere Rerank] https://docs.cohere.com/docs/overview
[Cohere Embedding Models] https://cohere.com/blog/introducing-embed-v3
[GraphRAG] https://github.com/microsoft/graphrag
[RAGAS] https://github.com/explodinggradients/ragas


This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Owen Ingraham, Tanaro, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Penumbraa, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth, Thipok Tham, Clayton Ford

[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud

[Music] massobeats - glisten
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] @Askejm