Search results

dataset_schema: add EvaluationResult.summary() returning per-metric mean/count/missing

Status: Open.

#2893 In vibrantlabsai/ragas;

· Harsh23Kashyap opened on Jul 26, 2026

BleuScore evaluates only the first sentence (corpus_bleu reference structure bug)

Status: Open.

#2888 In vibrantlabsai/ragas;

· feiiiiii5 opened on Jul 25, 2026

optimizers/dspy_llm_wrapper.py: inspect_history(n=0) returns full history (Python [-0:] bug)

Status: Open.

#2885 In vibrantlabsai/ragas;

· Harsh23Kashyap opened on Jul 25, 2026

Neighboring offline eval idea: scientific critique calibration (REFUTE)

Status: Open.

#2884 In vibrantlabsai/ragas;

· connerlambden opened on Jul 24, 2026

integrations/langchain.py: EvaluatorChain._acall discards run_manager, breaks async callback propagation

Status: Open.

#2883 In vibrantlabsai/ragas;

· Harsh23Kashyap opened on Jul 24, 2026

[Community Benchmark / Case Study] High-Precision Vietnamese Multi-Domain RAG Evaluation (SCP V3) - 99.66% Faithfulness

Status: Open.

#2882 In vibrantlabsai/ragas;

· checken1994 opened on Jul 24, 2026

tracing/langfuse.py: sync_trace() returns mock data; LangfuseTrace.filter() is a no-op

Status: Open.

#2880 In vibrantlabsai/ragas;

· Harsh23Kashyap opened on Jul 23, 2026

InMemoryExampleStore.get_nearest_examples returns all examples when top_k=0

Status: Open.

#2877 In vibrantlabsai/ragas;

· bharadwaj-pendyala opened on Jul 23, 2026

fix(prompt): generate_multiple skips on_chain_error for ValidationError and OutputParserException

Status: Open.

#2875 In vibrantlabsai/ragas;

· Harsh23Kashyap opened on Jul 22, 2026

DynamicFewShotPrompt: max_similar_examples=0 (top_k=0) returns all examples instead of none

Status: Open.

#2872 In vibrantlabsai/ragas;

· mittalpk opened on Jul 21, 2026

default_transforms() raises unhandled ZeroDivisionError on an empty documents list

Status: Open.

#2871 In vibrantlabsai/ragas;

· mittalpk opened on Jul 21, 2026

fix(cost): anthropic and bedrock parsers silently under-count token usage on multi-prompt LLMResult

Status: Open.

#2869 In vibrantlabsai/ragas;

· Harsh23Kashyap opened on Jul 21, 2026