Directory
256 companies sell AI evaluation, and most of them sell security
Every company and product line we found that builds, runs or sells AI evaluation, with funding, owners and status as of 5 November 2026.
- companies and product lines
- 256
- segments
- 11
- headquartered in the US
- 67%
- bought or in a pending deal
- 23
- still independent
- 193
This directory lists 256 companies and products in the AI evals market. It covers builder evals, agent simulation, leaderboards, expert data, safety evaluators, AI security, runtime control, governance, cloud platforms, insurance and institutions.
It starts from a third-party market map, then checked. We added the companies the map lacked. On 5 November 2026 we fetched every company site with a script. We also checked funding or deal status for more than 100 rows against a dated source. Where we found no dated source for funding, the table says "Not verified".
We place each company by its main buyer and product, not by every feature. Segment calls are ours. Some cases are borderline, such as Promptfoo, QuantPi, Advai, Irregular and Epoch AI.
Key findings
- Security and runtime control hold 113 of the 256 rows. AI security and red-teaming is the largest segment, with 74 rows. Builder evals and observability follow with 46.
- The market is mostly American. US firms hold 171 rows, or 67%. Israel holds 24 rows, and 16 of them sell AI security. The EU holds only 26.
- Consolidation hit builder evals and security hardest. Ten of 46 builder-eval rows and 10 of 74 security rows were bought or face a pending deal. None of the 34 governance rows and none of the 7 insurance rows did.
- Security vendors are the main buyers. Security and network vendors account for 12 of the 23 deals. Data and observability platforms account for 6. Check Point, CrowdStrike and Palo Alto Networks each bought two.
- Most of these firms are very young. Of the 247 rows with a known founding year, 130 (53%) were founded in 2023 or later. Insurers and certifiers are the youngest segment, with a median year of 2025.
- Compliance is mostly a side feature. Only 60 rows check compliance as a core function, and 137 more check it in part. Security is a core check for 144 rows.
- Vendor-paid third-party evaluators are rare. Only 8 of 256 rows have the evaluated vendor pay an outside party. Six are insurers or certifiers; the other two are Vals AI and Arena.
256 companies sell AI evaluation, and most of them sell security
Each dot is one company or product line. Scroll to sort them by segment, region and status.
Step 1 of 8: 256 dots in one field.
We found 256 companies and product lines that build, run or sell AI evaluation, as of 5 November 2026.
AI security is the largest segment, with 74 rows. Add runtime control and guardrails, and security-led products hold 113 of the 256.
Governance and compliance tools form the fourth group, with 34 rows. All of them are still independent or long-standing product lines. None was bought.
US firms hold 171 rows, or 67%. The US also hosts all 17 cloud-platform rows and all 14 expert-data rows.
Israel punches above its size, with 24 rows. Sixteen of them sell AI security.
The EU holds only 26 rows. They sell runtime control (8), builder evals (7) or governance (7), among others.
Twenty-three rows were bought or face a pending deal. Ten are builder-eval tools and ten are security firms. Security and network vendors made 12 of the deals.
Another 29 rows are product lines of larger firms. Fifteen are cloud and data platforms that bundle evals into a bigger bill. Datadog charges no separate fee for them.
The market at a glance
Half of all eval companies were founded in 2023 or later
One dot per company, by segment and year founded. Orange: bought or in a pending deal. Tick: median year.
- Acquired or pending deal (23)
- Other companies (224)
Median of the row; number at right = items in the row
Data table
| Item | Row | Year founded | Category |
|---|---|---|---|
| Cisco AI Defense | AI security & red-teaming | 1984 | Other companies |
| Check Point (AI security) | AI security & red-teaming | 1993 | Other companies |
| Fortinet FortiAIGate | AI security & red-teaming | 2000 | Other companies |
| Palo Alto Networks Prisma AIRS | AI security & red-teaming | 2005 | Other companies |
| Zscaler AI Guard | AI security & red-teaming | 2007 | Other companies |
| CrowdStrike Falcon AIDR (AI Detection & Response) | AI security & red-teaming | 2011 | Other companies |
| SentinelOne Singularity AI security | AI security & red-teaming | 2013 | Other companies |
| Cequence Security | AI security & red-teaming | 2014 | Other companies |
| CyCraft | AI security & red-teaming | 2017 | Other companies |
| Alice | AI security & red-teaming | 2018 | Other companies |
| TrojAI | AI security & red-teaming | 2019 | Acquired or pending deal |
| Origin | AI security & red-teaming | 2020 | Other companies |
| DeepKeep | AI security & red-teaming | 2021 | Other companies |
| Endor Labs agent governance | AI security & red-teaming | 2021 | Other companies |
| Giskard | AI security & red-teaming | 2021 | Other companies |
| Levo | AI security & red-teaming | 2021 | Other companies |
| Operant AI | AI security & red-teaming | 2021 | Other companies |
| Zenity | AI security & red-teaming | 2021 | Other companies |
| Akto | AI security & red-teaming | 2022 | Other companies |
| Aurva | AI security & red-teaming | 2022 | Other companies |
| Backslash Security | AI security & red-teaming | 2022 | Other companies |
| Bosch AIShield | AI security & red-teaming | 2022 | Acquired or pending deal |
| Cranium | AI security & red-teaming | 2022 | Other companies |
| Daxa.ai | AI security & red-teaming | 2022 | Other companies |
| Enkrypt AI (Anaconda) | AI security & red-teaming | 2022 | Acquired or pending deal |
| FireTail | AI security & red-teaming | 2022 | Other companies |
| HiddenLayer | AI security & red-teaming | 2022 | Other companies |
| Mindgard | AI security & red-teaming | 2022 | Other companies |
| PointGuard AI | AI security & red-teaming | 2022 | Other companies |
| Protect AI | AI security & red-teaming | 2022 | Acquired or pending deal |
| Sweet Security | AI security & red-teaming | 2022 | Other companies |
| Vorlon | AI security & red-teaming | 2022 | Other companies |
| Aurascape | AI security & red-teaming | 2023 | Other companies |
| Dreadnode | AI security & red-teaming | 2023 | Acquired or pending deal |
| Gray Swan AI | AI security & red-teaming | 2023 | Other companies |
| Haize Labs | AI security & red-teaming | 2023 | Acquired or pending deal |
| HydroX AI | AI security & red-teaming | 2023 | Other companies |
| Kanopy Security | AI security & red-teaming | 2023 | Other companies |
| Knostic | AI security & red-teaming | 2023 | Other companies |
| Lasso Security | AI security & red-teaming | 2023 | Other companies |
| Matvis | AI security & red-teaming | 2023 | Other companies |
| Noma Security | AI security & red-teaming | 2023 | Other companies |
| Ovalix | AI security & red-teaming | 2023 | Other companies |
| Pillar Security | AI security & red-teaming | 2023 | Other companies |
| Singulr AI | AI security & red-teaming | 2023 | Other companies |
| SPLX | AI security & red-teaming | 2023 | Acquired or pending deal |
| Token Security | AI security & red-teaming | 2023 | Other companies |
| Unbound | AI security & red-teaming | 2023 | Other companies |
| Vijil | AI security & red-teaming | 2023 | Other companies |
| AIM Intelligence | AI security & red-teaming | 2024 | Other companies |
| CodeIntegrity | AI security & red-teaming | 2024 | Other companies |
| Hush Security | AI security & red-teaming | 2024 | Other companies |
| Invariant Labs | AI security & red-teaming | 2024 | Acquired or pending deal |
| Lumia Security | AI security & red-teaming | 2024 | Other companies |
| Onyx Security | AI security & red-teaming | 2024 | Other companies |
| Opsin Security | AI security & red-teaming | 2024 | Other companies |
| Promptfoo (OpenAI) | AI security & red-teaming | 2024 | Acquired or pending deal |
| Quilr AI | AI security & red-teaming | 2024 | Other companies |
| Rein Security | AI security & red-teaming | 2024 | Other companies |
| Straiker | AI security & red-teaming | 2024 | Other companies |
| Virtue AI | AI security & red-teaming | 2024 | Acquired or pending deal |
| aizome | AI security & red-teaming | 2025 | Other companies |
| Arrakis Security | AI security & red-teaming | 2025 | Other companies |
| Capsule Security | AI security & red-teaming | 2025 | Other companies |
| Certiv | AI security & red-teaming | 2025 | Other companies |
| Evo by Snyk | AI security & red-teaming | 2025 | Other companies |
| General Analysis | AI security & red-teaming | 2025 | Other companies |
| Geordie AI | AI security & red-teaming | 2025 | Other companies |
| Helmet Security | AI security & red-teaming | 2025 | Other companies |
| Manifold Security | AI security & red-teaming | 2025 | Other companies |
| Neo | AI security & red-teaming | 2025 | Other companies |
| Pluto Security | AI security & red-teaming | 2025 | Other companies |
| AIR Security | AI security & red-teaming | 2026 | Other companies |
| Comet Opik | Builder evals & observability | 2017 | Other companies |
| Weights & Biases Weave (CoreWeave) | Builder evals & observability | 2017 | Acquired or pending deal |
| Arthur AI | Builder evals & observability | 2018 | Other companies |
| Datumo | Builder evals & observability | 2018 | Other companies |
| Fiddler AI | Builder evals & observability | 2018 | Acquired or pending deal |
| MLflow (Databricks; sold as Mosaic AI Agent Evaluation) | Builder evals & observability | 2018 | Other companies |
| Deepchecks (now Check Point) | Builder evals & observability | 2019 | Acquired or pending deal |
| TruEra (TruLens) | Builder evals & observability | 2019 | Acquired or pending deal |
| Arize AI | Builder evals & observability | 2020 | Acquired or pending deal |
| Citadel AI | Builder evals & observability | 2020 | Other companies |
| Evidently AI | Builder evals & observability | 2020 | Other companies |
| Humanloop | Builder evals & observability | 2020 | Other companies |
| Galileo (Cisco) | Builder evals & observability | 2021 | Acquired or pending deal |
| Openlayer | Builder evals & observability | 2021 | Other companies |
| Safe Intelligence | Builder evals & observability | 2021 | Other companies |
| Freeplay | Builder evals & observability | 2022 | Other companies |
| HoneyHive | Builder evals & observability | 2022 | Other companies |
| Langfuse (ClickHouse) | Builder evals & observability | 2022 | Acquired or pending deal |
| LangSmith (LangChain) | Builder evals & observability | 2022 | Other companies |
| Latitude | Builder evals & observability | 2022 | Other companies |
| Orq.ai | Builder evals & observability | 2022 | Other companies |
| Traceloop (OpenLLMetry) | Builder evals & observability | 2022 | Acquired or pending deal |
| AIMon Labs (now DataFramer) | Builder evals & observability | 2023 | Other companies |
| Braintrust | Builder evals & observability | 2023 | Other companies |
| Composo | Builder evals & observability | 2023 | Other companies |
| Confident AI (DeepEval) | Builder evals & observability | 2023 | Other companies |
| Helicone | Builder evals & observability | 2023 | Acquired or pending deal |
| LangWatch | Builder evals & observability | 2023 | Other companies |
| LLUMO AI | Builder evals & observability | 2023 | Other companies |
| Maxim AI | Builder evals & observability | 2023 | Other companies |
| Qualifire | Builder evals & observability | 2023 | Other companies |
| Quotient AI | Builder evals & observability | 2023 | Acquired or pending deal |
| Ragas (Vibrant Labs) | Builder evals & observability | 2023 | Other companies |
| Raindrop | Builder evals & observability | 2023 | Other companies |
| Respan (formerly Keywords AI) | Builder evals & observability | 2023 | Other companies |
| Root Signals (now Scorable) | Builder evals & observability | 2023 | Other companies |
| Future AGI | Builder evals & observability | 2024 | Other companies |
| Galtea | Builder evals & observability | 2024 | Other companies |
| Laminar | Builder evals & observability | 2024 | Other companies |
| Pay-i (Ascerta) | Builder evals & observability | 2024 | Other companies |
| Scorecard | Builder evals & observability | 2024 | Other companies |
| AvonAI | Builder evals & observability | 2025 | Other companies |
| Jetty | Builder evals & observability | 2025 | Other companies |
| Judgment Labs | Builder evals & observability | 2025 | Other companies |
| Principled Intelligence | Builder evals & observability | 2025 | Other companies |
| Gravitee (Agent Management) | Runtime control & guardrails | 2015 | Other companies |
| Tigera (Lynx) | Runtime control & guardrails | 2016 | Other companies |
| Coder (AI Gateway, Agent Firewall) | Runtime control & guardrails | 2017 | Other companies |
| Kong AI Gateway | Runtime control & guardrails | 2017 | Other companies |
| Calypso AI (F5) | Runtime control & guardrails | 2018 | Acquired or pending deal |
| Relyance AI | Runtime control & guardrails | 2020 | Other companies |
| Dynamo AI (DynamoGuard, DynamoEval, AgentWarden) | Runtime control & guardrails | 2021 | Other companies |
| Lakera (Check Point) | Runtime control & guardrails | 2021 | Acquired or pending deal |
| TrueFoundry | Runtime control & guardrails | 2021 | Other companies |
| NeuralTrust | Runtime control & guardrails | 2022 | Other companies |
| Obot AI | Runtime control & guardrails | 2022 | Other companies |
| Speakeasy MCP gateway | Runtime control & guardrails | 2022 | Other companies |
| Trustwise | Runtime control & guardrails | 2022 | Other companies |
| Alinia AI | Runtime control & guardrails | 2023 | Other companies |
| LiteLLM (BerriAI) | Runtime control & guardrails | 2023 | Other companies |
| PointFive | Runtime control & guardrails | 2023 | Other companies |
| Portkey | Runtime control & guardrails | 2023 | Acquired or pending deal |
| Realm Labs | Runtime control & guardrails | 2023 | Other companies |
| Stacklok | Runtime control & guardrails | 2023 | Other companies |
| Verax | Runtime control & guardrails | 2023 | Other companies |
| WitnessAI | Runtime control & guardrails | 2023 | Other companies |
| Airia | Runtime control & guardrails | 2024 | Other companies |
| Barndoor (Venn.ai) | Runtime control & guardrails | 2024 | Other companies |
| Rippletide | Runtime control & guardrails | 2024 | Other companies |
| Actualyze AI | Runtime control & guardrails | 2025 | Other companies |
| Archestra | Runtime control & guardrails | 2025 | Other companies |
| Kontext | Runtime control & guardrails | 2025 | Other companies |
| Kyvvu | Runtime control & guardrails | 2025 | Other companies |
| Runlayer | Runtime control & guardrails | 2025 | Other companies |
| Tenet Security | Runtime control & guardrails | 2025 | Other companies |
| Tynapse | Runtime control & guardrails | 2025 | Other companies |
| Velatir | Runtime control & guardrails | 2025 | Other companies |
| White Circle | Runtime control & guardrails | 2025 | Other companies |
| Willow | Runtime control & guardrails | 2025 | Other companies |
| agen.co | Runtime control & guardrails | 2026 | Other companies |
| ZeroDrift | Runtime control & guardrails | 2026 | Other companies |
| IBM watsonx.governance | Governance & compliance | 1911 | Other companies |
| Software Improvement Group (Sigrid Axis, Guardrails, Auto-Fix, AI Code Governance) | Governance & compliance | 2000 | Other companies |
| Collibra (AI Command Center / Guardian Agents) | Governance & compliance | 2008 | Other companies |
| Rencore | Governance & compliance | 2013 | Other companies |
| Corridor Platforms (GenGuardX) | Governance & compliance | 2017 | Other companies |
| Aveni | Governance & compliance | 2018 | Other companies |
| Ferrum Health | Governance & compliance | 2018 | Other companies |
| ModelOp | Governance & compliance | 2018 | Other companies |
| Modulos | Governance & compliance | 2018 | Other companies |
| Truyo | Governance & compliance | 2018 | Other companies |
| Monitaur | Governance & compliance | 2019 | Other companies |
| Portal26 | Governance & compliance | 2019 | Other companies |
| Credo AI | Governance & compliance | 2020 | Other companies |
| Deeploy | Governance & compliance | 2020 | Other companies |
| FairPlay AI | Governance & compliance | 2020 | Other companies |
| Holistic AI | Governance & compliance | 2020 | Other companies |
| LatticeFlow AI | Governance & compliance | 2020 | Other companies |
| Enzai | Governance & compliance | 2021 | Other companies |
| Calvin Risk | Governance & compliance | 2022 | Other companies |
| EQTY Lab | Governance & compliance | 2022 | Other companies |
| Lumenova AI | Governance & compliance | 2022 | Other companies |
| Signal 1 (AIMS) | Governance & compliance | 2022 | Other companies |
| Validaitor | Governance & compliance | 2022 | Other companies |
| ValidMind | Governance & compliance | 2022 | Other companies |
| Ethos (model risk management) | Governance & compliance | 2023 | Other companies |
| Kosmoy | Governance & compliance | 2023 | Other companies |
| LuminosAI | Governance & compliance | 2023 | Other companies |
| AIQURIS | Governance & compliance | 2024 | Other companies |
| Darwin AI | Governance & compliance | 2024 | Other companies |
| Pacific AI | Governance & compliance | 2024 | Other companies |
| VerifyWise | Governance & compliance | 2024 | Other companies |
| Asenion (formerly Fairly AI) | Governance & compliance | 2025 | Other companies |
| JetStream Security | Governance & compliance | 2025 | Other companies |
| Microsoft (Foundry, Defender AI-SPM, Purview, Agent 365, Agent Governance Toolkit) | Platform/cloud feature | 1975 | Other companies |
| NVIDIA (NeMo Guardrails) | Platform/cloud feature | 1993 | Other companies |
| ServiceNow AI Control Tower | Platform/cloud feature | 2004 | Other companies |
| Dynatrace | Platform/cloud feature | 2005 | Other companies |
| MuleSoft Agent Fabric (Salesforce) | Platform/cloud feature | 2006 | Other companies |
| Cloudflare AI Gateway / Firewall for AI | Platform/cloud feature | 2009 | Other companies |
| Datadog LLM Observability | Platform/cloud feature | 2010 | Other companies |
| Databricks Unity AI Gateway | Platform/cloud feature | 2013 | Other companies |
| OpenAI (Evals, trace grading, AgentKit; Promptfoo) | Platform/cloud feature | 2015 | Other companies |
| Anthropic (eval tooling, Petri, Bloom) | Platform/cloud feature | 2021 | Other companies |
| Azure AI Content Safety / Foundry guardrails | Platform/cloud feature | 2023 | Other companies |
| AWS Bedrock Guardrails | Platform/cloud feature | 2024 | Other companies |
| Salesforce Agentforce Testing Center (and eVerse) | Platform/cloud feature | 2024 | Other companies |
| AWS AgentCore (Evaluations, Policy, Agent Registry) | Platform/cloud feature | 2025 | Other companies |
| Handshake AI | Expert data & RL environments | 2014 | Other companies |
| Scale AI (SEAL) | Expert data & RL environments | 2016 | Other companies |
| Turing | Expert data & RL environments | 2018 | Other companies |
| Snorkel AI | Expert data & RL environments | 2019 | Other companies |
| Surge AI | Expert data & RL environments | 2020 | Other companies |
| micro1 | Expert data & RL environments | 2022 | Other companies |
| Collinear | Expert data & RL environments | 2023 | Other companies |
| Mercor | Expert data & RL environments | 2023 | Other companies |
| Patronus AI | Expert data & RL environments | 2023 | Other companies |
| Prime Intellect | Expert data & RL environments | 2023 | Other companies |
| Halluminate | Expert data & RL environments | 2024 | Other companies |
| HUD | Expert data & RL environments | 2025 | Other companies |
| Klavis AI | Expert data & RL environments | 2025 | Other companies |
| Mechanize | Expert data & RL environments | 2025 | Other companies |
| Cyara (Botium) | Agent simulation & voice testing | 2006 | Other companies |
| TestMu AI (formerly LambdaTest) | Agent simulation & voice testing | 2017 | Other companies |
| Cekura | Agent simulation & voice testing | 2024 | Other companies |
| Coval | Agent simulation & voice testing | 2024 | Other companies |
| Drizz Labs | Agent simulation & voice testing | 2024 | Other companies |
| Era by Eon | Agent simulation & voice testing | 2024 | Other companies |
| Hamming AI | Agent simulation & voice testing | 2024 | Other companies |
| Veris AI | Agent simulation & voice testing | 2024 | Other companies |
| Arga Labs | Agent simulation & voice testing | 2025 | Other companies |
| Bluejay | Agent simulation & voice testing | 2025 | Other companies |
| Kaggle (Benchmarks, Community Benchmarks, Game Arena) | Leaderboards & independent evaluators | 2010 | Other companies |
| Hugging Face (lighteval, leaderboards) | Leaderboards & independent evaluators | 2016 | Other companies |
| Advai | Leaderboards & independent evaluators | 2020 | Other companies |
| QuantPi | Leaderboards & independent evaluators | 2020 | Other companies |
| Epoch AI | Leaderboards & independent evaluators | 2022 | Other companies |
| Arena (LMArena) | Leaderboards & independent evaluators | 2023 | Other companies |
| Artificial Analysis | Leaderboards & independent evaluators | 2023 | Other companies |
| OpenRouter | Leaderboards & independent evaluators | 2023 | Other companies |
| Resaro | Leaderboards & independent evaluators | 2023 | Other companies |
| Vals AI | Leaderboards & independent evaluators | 2023 | Other companies |
| Armilla AI | Insurance & certification | 2019 | Other companies |
| Warden AI | Insurance & certification | 2023 | Other companies |
| AIUC | Insurance & certification | 2025 | Other companies |
| Harbor | Insurance & certification | 2025 | Other companies |
| Humanos | Insurance & certification | 2025 | Other companies |
| Klaimee | Insurance & certification | 2025 | Other companies |
| Redberry Labs | Insurance & certification | 2025 | Other companies |
| METR | Safety evaluators | 2022 | Other companies |
| Apollo Research (Watcher) | Safety evaluators | 2023 | Other companies |
| Irregular | Safety evaluators | 2023 | Other companies |
| MLCommons (AILuminate) | Institution | 2020 | Other companies |
| UK AI Security Institute (Inspect) | Institution | 2023 | Other companies |
Two in three eval companies are American
Directory rows by HQ country. Tap a tile for the count.
Hover over, tap or tab to a tile for details.
Directory rows by HQ country
- 100 or more
- 10–99
- 3–9
- 1–2
Data table
| Country or region | Directory rows by HQ country | Value | Note |
|---|---|---|---|
| Canada | 3–9 | 5 | 5 rows (2%) |
| United States | 100 or more | 171 | 171 rows (67%) |
| Denmark | 1–2 | 1 | 1 row (<1%) |
| Finland | 1–2 | 1 | 1 row (<1%) |
| Ireland | 1–2 | 1 | 1 row (<1%) |
| United Kingdom | 10–99 | 15 | 15 rows (6%) |
| Netherlands | 3–9 | 5 | 5 rows (2%) |
| France | 3–9 | 3 | 3 rows (1%) |
| Belgium | 1–2 | 1 | 1 row (<1%) |
| Germany | 3–9 | 7 | 7 rows (3%) |
| Portugal | 1–2 | 1 | 1 row (<1%) |
| Spain | 3–9 | 4 | 4 rows (2%) |
| Switzerland | 3–9 | 5 | 5 rows (2%) |
| Italy | 1–2 | 2 | 2 rows (1%) |
| Israel | 10–99 | 24 | 24 rows (9%) |
| India | 3–9 | 3 | 3 rows (1%) |
| South Korea | 3–9 | 3 | 3 rows (1%) |
| Japan | 1–2 | 1 | 1 row (<1%) |
| Taiwan | 1–2 | 1 | 1 row (<1%) |
| Singapore | 1–2 | 2 | 2 rows (1%) |
Deals hit builder evals and security; governance stayed independent
One column per segment; column width shows its size, colour shows status. 5 November 2026
- Acquired or pending deal
- Product line of a larger firm
- Independent
- Pivoted, non-profit or defunct
Column width = companies in the segment; height = share by status
-
Rows by HQ country
HQ country Rows Share US 171 67% Israel 24 9% UK 15 6% Germany 7 3% Canada 5 2% Netherlands 5 2% Switzerland 5 2% Spain 4 2% South Korea 3 1% India 3 1% France 3 1% Italy 2 1% Singapore 2 1% Japan 1 <1% Finland 1 <1% Taiwan 1 <1% Ireland 1 <1% Denmark 1 <1% Belgium 1 <1% Portugal 1 <1% Directory rows by HQ country. Two US/Israel rows count as Israel. Calypso AI (now F5) is listed in Dublin, so the EU count includes it. Source: Ascending Labs company directory, 5 November 2026. Rows by segment and HQ region
Segment US EU Israel UK & Switzerland Rest of world AI security & red-teaming 49 2 16 3 4 Builder evals & observability 28 7 4 3 4 Runtime control & guardrails 26 8 2 2 1 Governance & compliance 17 7 0 7 3 Platform/cloud feature 17 0 0 0 0 Expert data & RL environments 14 0 0 0 0 Agent simulation & voice testing 8 0 1 0 1 Leaderboards & independent evaluators 7 1 0 1 1 Insurance & certification 3 1 0 2 1 Safety evaluators 1 0 1 1 0 Institution 1 0 0 1 0 Total 171 26 24 20 15 EU firms concentrate in runtime control (8), builder evals (7) and governance (7). Source: Ascending Labs company directory, 5 November 2026.
Search the directory
Search by company, product or buyer; the search also matches the "What it does" text. Filter by segment, HQ region, status and what a product evaluates. Sort any column. Open a row for who pays, funding, status details and sources.
| Expand rows | Evaluates | ||||||
|---|---|---|---|---|---|---|---|
| AIMon Labs (now DataFramer) –Funding not verified | Builder evals & observability | US | 2023 | Pivoted | Not verified | ||
| Arize AI ✓Checked | Builder evals & observability | US | 2020 | Acquired or pending | ~US$131M VC; Dynatrace paid US$915M (signed 13 Aug 2026) | ||
| Arthur AI –Funding not verified | Builder evals & observability | US | 2018 | Independent | Not verified | ||
| AvonAI –Funding not verified | Builder evals & observability | Israel | 2025 | Independent | Not verified | ||
| Braintrust ✓Checked | Builder evals & observability | US | 2023 | Independent | US$80M Series B, Feb 2026, ICONIQ; ~US$800M post (press); ~US$121M total | ||
| Citadel AI –Funding not verified | Builder evals & observability | Rest of world | 2020 | Independent | Not verified | ||
| Comet Opik –Funding not verified | Builder evals & observability | US | 2017 | Independent | Not verified | ||
| Composo –Funding not verified | Builder evals & observability | UK & Switzerland | 2023 | Independent | Not verified | ||
| Confident AI (DeepEval) –Funding not verified | Builder evals & observability | US | 2023 | Independent | Not verified | ||
| Datumo –Funding not verified | Builder evals & observability | Rest of world | 2018 | Independent | Not verified | ||
| Deepchecks (now Check Point) ✓Checked | Builder evals & observability | Israel | 2019 | Acquired or pending | ~US$14M raised; price estimated at US$10–20M (press) | ||
| Evidently AI –Funding not verified | Builder evals & observability | US | 2020 | Independent | Not verified | ||
| Fiddler AI ✓Checked | Builder evals & observability | US | 2018 | Acquired or pending | US$30M Series C led by RPS Ventures, 27 Jan 2026; US$100M total | ||
| Freeplay ✓Checked | Builder evals & observability | US | 2022 | Independent | US$5.6M (Renegade), ~US$12M total, 2025 | ||
| Future AGI ✓Checked | Builder evals & observability | US | 2024 | Independent | US$1.6M pre-seed, Feb 2025 | ||
| Galileo (Cisco) ✓Checked | Builder evals & observability | US | 2021 | Acquired or pending | ~US$68M raised; price undisclosed | ||
| Galtea –Funding not verified | Builder evals & observability | EU | 2024 | Independent | Not verified | ||
| Helicone †General knowledge | Builder evals & observability | US | 2023 | Acquired or pending | YC-backed; price undisclosed | ||
| HoneyHive ✓Checked | Builder evals & observability | US | 2022 | Independent | US$7.4M total seed, Apr 2025 (Insight Partners) | ||
| Humanloop †General knowledge | Builder evals & observability | UK & Switzerland | 2020 | Defunct | US$7.91M seed across two rounds (YC, Index; PitchBook) | ||
| Jetty –Funding not verified | Builder evals & observability | Rest of world | 2025 | Independent | Not verified | ||
| Judgment Labs ✓Checked | Builder evals & observability | US | 2025 | Independent | US$32M seed + Series A, May 2026 (Lightspeed) | ||
| Laminar –Funding not verified | Builder evals & observability | US | 2024 | Independent | Not verified | ||
| Langfuse (ClickHouse) –Funding not verified | Builder evals & observability | EU | 2022 | Acquired or pending | Not verified | ||
| LangSmith (LangChain) ✓Checked | Builder evals & observability | US | 2022 | Independent | US$125M Series B at US$1.25B, Oct 2025 (IVP) | ||
Showing 256 of 256 rows
Download all rows: · (CC BY 4.0)
How to read the table
Verification marker
- ✓ Checked (127 rows). A dated source confirms the funding or deal figure, or the row rests on a cited source.
- – Funding not verified (111 rows). We found no dated source for funding, so the table shows "Not verified".
- † General knowledge (18 rows). HQ or founding year comes from general knowledge, which we did not check in this pass.
HQ and founding year for rows from the third-party market map come from that map. We did not re-check them.
What it evaluates
- QCore check
- QPartial check
- QNot checked
Q quality · C compliance · S security · $ cost. Tick "Include partial" to filter on partial checks too.
Deals, pivots and shutdowns
Ownership changes fast in this market. These rows changed owner or focus before 5 November 2026.
-
Acquisitions and pending deals
Company Segment Buyer Status Arize AI Builder evals & observability Dynatrace acquired by Dynatrace (closed 1 Oct 2026) Deepchecks (now Check Point) Builder evals & observability Check Point acquired (team and IP) by Check Point, May 2026; site banner confirms Fiddler AI Builder evals & observability CrowdStrike being acquired by CrowdStrike (signed 3 Nov 2026; close expected CrowdStrike Q4 FY27) Galileo (Cisco) Builder evals & observability Cisco acquired by Cisco (closed 22 May 2026) Helicone Builder evals & observability Mintlify acquired by Mintlify (3 Mar 2026), maintenance mode; site now says "no longer part of Mintlify" (unexplained, 5 Nov 2026) Langfuse (ClickHouse) Builder evals & observability ClickHouse acquired by ClickHouse (16 Jan 2026); site banner confirms Quotient AI Builder evals & observability Databricks acquired by Databricks (announced 11 Mar 2026); quotientai.co did not respond on 5 Nov 2026 Traceloop (OpenLLMetry) Builder evals & observability ServiceNow acquired by ServiceNow (announced Mar 2026; closing reported 5 May 2026, no primary confirmation) TruEra (TruLens) Builder evals & observability Snowflake acquired by Snowflake (announced 22 May 2024); truera.com shows join-Snowflake banner Weights & Biases Weave (CoreWeave) Builder evals & observability CoreWeave acquired by CoreWeave (closed 5 May 2025) Bosch AIShield AI security & red-teaming Protectt.ai majority-owned by Protectt.ai (not verified); Bosch-incubated Dreadnode AI security & red-teaming CrowdStrike acquisition pending: CrowdStrike agreed to buy, 3 Nov 2026 Enkrypt AI (Anaconda) AI security & red-teaming Anaconda acquired by Anaconda (4 Aug 2026); site banner confirms Haize Labs AI security & red-teaming Beacon Software acquired by Beacon Software (17 Sep 2026); team forms Beacon's Applied AI Research Group Invariant Labs AI security & red-teaming Snyk acquired by Snyk (24 Jun 2025) Promptfoo (OpenAI) AI security & red-teaming OpenAI acquired by OpenAI (announced 9 Mar 2026; now closed, README says "now part of OpenAI") Protect AI AI security & red-teaming Palo Alto Networks acquired by Palo Alto Networks (closed 22 Jul 2025); site redirects to Prisma AIRS SPLX AI security & red-teaming Zscaler acquired by Zscaler (Nov 2025); site banner confirms TrojAI AI security & red-teaming A10 Networks acquired by A10 Networks (announced 15 Jun 2026; terms undisclosed) Virtue AI AI security & red-teaming Fortinet acquired by Fortinet (17 Aug 2026); site redirects to fortinet.com Calypso AI (F5) Runtime control & guardrails F5 acquired by F5 (closed 26 Sep 2025); URL redirects to f5.com Lakera (Check Point) Runtime control & guardrails Check Point acquired by Check Point (closed 22 Oct 2025); site footer confirms Portkey Runtime control & guardrails Palo Alto Networks acquired by Palo Alto Networks (closed 29 May 2026); site confirms The 23 directory rows that were bought or face a pending deal, as of 5 November 2026. Each row's source sits in the table above. Source: Ascending Labs company directory, 5 November 2026.
-
Pivots and shutdowns
Company Segment What changed AIMon Labs (now DataFramer) Builder evals & observability pivoted (AIMon Labs now sells as DataFramer) Humanloop Builder evals & observability defunct: team joined Anthropic Aug 2025; platform sunset Veris AI Agent simulation & voice testing pivoted (simulation platform retired 15 Oct 2026) Klavis AI Expert data & RL environments pivoted (MCP tooling to RL environments) Patronus AI Expert data & RL environments pivoted (eval platform, API, Lynx retired) Relyance AI Runtime control & guardrails independent (repositioned: homepage now leads with AI evals and guardrails) "Pivoted" counts firms that left their eval product or changed their main pitch. Source: Ascending Labs company directory, 5 November 2026.
Cite as: Ascending Labs, AI Evals Company Directory (256 companies), State of AI Evals 2026, snapshot of 5 November 2026. Corrections: see the methodology.