Monitoring & Evaluation

6 tools

Ragas

Why I use it: The standard framework for evaluating RAG pipelines. Measures what matters for retrieval-augmented generation.

4.5
Evidently AI

Why I use it: Open-source ML monitoring for data drift and model performance. Beautiful reports.

4.4
TensorFlow

Why I use it: The standard ML visualization tool. Track metrics, visualize models, and inspect embeddings.

4.4
Arize AI

Why I use it: Comprehensive ML observability — monitoring, drift detection, and LLM evaluation in one platform.

4.4
LangSmith

Why I use it: LLM observability and evaluation. Trace every step of your LLM chains and agents.

4.3
Prometheus

Why I use it: Standard infrastructure monitoring. Essential for monitoring GPU utilization and serving latency.

4.5