RAG app stack

RAG app stack

Every company will benefit on a large scale if any employee can leverage the vast amount of company documents quickly and easily. This is a dream that a couple of years back was impossible but today is at your fingers's tip. I have built a lot of these tools so I will give my recommended tech stack:

  • App orchestration: LangChain, LLamaIndex
  • LLM providers: OpenAI, Anthropic, Amazon Bedrock, Ollama for local open-source model inference.
  • Embedding providers: Nomic, Cohere, Ollama for local open-source model inference.
  • Vector databases: Milvus, PostgreSQL with pgvector extension, Amazon OpenSearch
  • Graph databases: Neo4J, Amazon Neptune.
  • Easy UI: Gradio, Streamlit.
  • AI Agents: LanGraph, CrewAI

If you want some more insights on this type of application or a detailed tutorial let me know.

José Melo

Engineer & Business Developer | Founder

8 个月

Nice!

要查看或添加评论,请登录

Reynold Oramas的更多文章

  • My AI newsletter 1st report October 2024

    My AI newsletter 1st report October 2024

    We're your AI cache, delivering the hottest bytes of AI intel faster than a quantum computer can say "superposition."…

    2 条评论
  • Graphs and LLMs

    Graphs and LLMs

    !!! Hello dear colleagues !!! Today I want to bring your attention to knowledge graphs, short and sweet. If you are…

社区洞察

其他会员也浏览了