❤️ Community

"Alone we can do so little; together we can do so much." - Helen Keller

Our project thrives on the vibrant energy, diverse skills, and shared passion of our community. It's not just about code; it's about people coming together to create something extraordinary. This space celebrates every contribution, big or small, and features the amazing people who make it all happen.

💬 Discord community

Join our Discord community here to connect with other developers, share your ideas, and get support.

🌟  Contributors

Meet some of our outstanding contributors!

See the full list here.

📚 Blog & Insights

Explore insightful articles, tutorials, and stories written by and for our community members.

• Luka Panić shares his work on
  • Ragas Evaluation: In-Depth Insights | PIXION Blog: A detailed explanation of the metrics and how they are calculated.
  • RAG in practice - Test Set Generation | PIXION Blog: A tutorial on how to generate a test set using Ragas.
• Shanthi Vardhan shares how his team at Atomicwork uses ragas to improve their AI system's ability to accurately identify and retrieve more precise information for enhanced service management.
• Pinecone's study on how RAGs can enhance capabilities of LLMs in "RAG makes LLMs better and equal" uses ragas to proves context retrieval makes LLMs provide significantly better results, even when increasing the data size to 1 billion.
• Aishwarya Prabhat shares her expertise on advanced RAG techniques in her comprehensive guide, "Performing, Evaluating & Tracking Advanced RAG (ft. AzureML, LlamaIndex & Ragas)".
• Leonie (aka @helloiamleonie) offers her perspective in the detailed article, "Evaluating RAG Applications with RAGAs".
• The joint efforts of Erika Cardenas and Connor Shorten are showcased in their collaborative piece, "An Overview on RAG Evaluation | Weaviate", and their podcast with the Ragas team.
• Erika Cardenas further explores the "RAG performance of hybrid search weightings (alpha)" in her recent experiment to tune weaviate alpha score using Ragas.
• LangChain’s work about RAG Evaluating RAG pipelines with RAGAs and LangSmith provides a complete tutorial on how to leverage both tools to evaluate RAG pipelines.
• Plaban Nayak shares his work Evaluate RAG Pipeline using RAGAS on building and evaluating a simple RAG using LangChain and RAGAS
• Stephen Kurniawan compares different RAG elements such as Chunk Size, Vector Stores: FAISS vs ChromaDB, Vector Stores 2: Multiple Documents, and Similarity Searches / Distance Metrics / Index Strategies.
• Discover Devanshu Brahmbhatt's insights on optimizing RAG systems in his article, Enhancing LLM's Accuracy with RAGAS. Learn about RAG architecture, key evaluation metrics, and how to use RAGAS scores to improve performance.
• Suzuki and Hwang conducted an experiment to investigate if Ragas' performance is language-dependent by comparing the performance (correlation coefficient between human labels and scores from Ragas) using datasets of the same content in Japanese and English. They wrote blog about the result of the experiment and basic algorithm of Ragas.
  • RAG Evaluation: Necessity and Challenge
  • RAG Evaluation : Computational Metrics in RAG and Calculation Methods in Ragas
  • RAG Evaluation: Assessing the Usefulness of Ragas
• Atita Arora writes about Evaluating Retrieval Augmented Generation using RAGAS, an end-to-end tutorial on building RAG using Qdrant and LangChain and evaluating it with RAGAS.
  • Bonus content : Learn how to create an evaluation dataset that serves as a reference point for evaluating our RAG pipeline, Understand the RAGAS evaluation metrics and how to make sense of them and putting them in action to test a Naive RAG pipeline and measure its performance using RAGAS metrics.
  • Code walkthrough : https://github.com/qdrant/qdrant-rag-eval/tree/master/workshop-rag-eval-qdrant-ragas
  • Code walkthrough using Deepset Haystack and Mixedbread.ai : https://github.com/qdrant/qdrant-rag-eval/tree/master/workshop-rag-eval-qdrant-ragas-haystack
• Minoru Onda writes for beginners about how to start Ragas v0.2 evaluation with Amazon Bedrock, and integrate with Langfuse.
  • RAG精度評価の定番ツール「Ragas」にAWSのBedrockで入門しよう！（v0.2対応） - Qiita
  • 生成AIアプリの出力をRagasで評価して、LangfuseでGUI監視しよう！ - Qiita
• Yunnglin has penned a guide on integrating Ragas v0.2 into EvalScope (an evaluation framework for large models), thereby utilizing the ModelScope ecosystem.
  • Tutorial: Using Ragas with EvalScope
  • 教程: 在EvalScope中使用Ragas一键发起RAG评估
  • 最佳实践: 打破文本边界：如何进行多模态RAG评估

📅 Events

Stay updated with our latest gatherings, meetups, and online webinars.

• OpenAI Engineers shares their RAG tricks and features Ragas on DevDay.
• LangChain’s a LangChain "RAG Evaluation” Webinar with the Ragas team