Skip to content

Vertical

Benchmarking

Benchmarking within Safety & Evaluation.

6 listings

Arize AX

MLOps & model tooling

Arize AX evaluates, traces, monitors, and improves production AI agents and language-model applications.

MLOps & model tooling
Benchmarking
Observability
Model evaluation
Model monitoring
Enterprise / custom quoteGlobalSaaS (vendor-hosted) · Private cloud / VPC

Giskard Hub

MLOps & model tooling

Giskard Hub continuously evaluates and red-teams AI agents for quality, hallucination, and security vulnerabilities.

MLOps & model tooling
Benchmarking
Red Teaming
Model evaluation
AI & agent security
Enterprise / custom quoteGlobalSaaS (vendor-hosted) · Private cloud / VPC

Giskard OSS

MLOps & model tooling

Giskard OSS is an open-source Python library for testing model quality, bias, robustness, and LLM vulnerabilities.

MLOps & model tooling
Benchmarking
Red Teaming
Model evaluation
AI & agent security
FreeGlobalSelf-hosted / on-premises · Private cloud / VPC · On-device / edge

Humanloop

MLOps & model tooling

Humanloop evaluates and manages prompts, datasets, experiments, and model behavior for production AI systems.

MLOps & model tooling
Benchmarking
Observability
Model evaluation
Model monitoring
Enterprise / custom quoteGlobalSaaS (vendor-hosted) · Private cloud / VPC

LangSmith

MLOps & model tooling

LangSmith tests, traces, evaluates, and monitors language-model and agent applications throughout development.

MLOps & model tooling
Benchmarking
Observability
Model evaluation
Model monitoring
FreemiumGlobalSaaS (vendor-hosted) · Private cloud / VPC

Scale Nucleus

MLOps & model tooling

Scale Nucleus organizes AI data, evaluations, and quality workflows for enterprise model development.

MLOps & model tooling
Benchmarking
Data Labelling
Model evaluation
Data labeling
Enterprise / custom quoteGlobalSaaS (vendor-hosted) · Private cloud / VPC · API / SDK