DeepEval logo
Open SourceVC-backedSeed
San Francisco, USA · Founded 2023

DeepEval

The open source LLM evaluation framework

Visit deepeval.com← Back to Index

About DeepEval

DeepEval is an open-source framework for evaluating LLM outputs. Define and run 14+ built-in metrics (faithfulness, relevancy, bias, toxicity) with just a few lines of Python. Integrates with CI/CD pipelines for continuous LLM quality testing.

DeepEval website preview

Screenshot of DeepEval (deepeval.com) — The open source LLM evaluation framework

Company facts

Category
Open Source
Funding stage
Seed
Total raised
$3.5M
Founded
2023
Team size
10-50
HQ
San Francisco
Country
USA
Website
deepeval.com

Founders of DeepEval

  • Jeffrey Ip

Investors backing DeepEval

  • Y Combinator

Frequently asked questions

What does DeepEval do?

DeepEval is an open-source framework for evaluating LLM outputs. Define and run 14+ built-in metrics (faithfulness, relevancy, bias, toxicity) with just a few lines of Python. Integrates with CI/CD pipelines for continuous LLM quality testing.

Where is DeepEval based?

DeepEval is based in San Francisco, USA.

When was DeepEval founded?

DeepEval was founded in 2023.

How much has DeepEval raised?

DeepEval has raised $3.5M in their Seed round.

Who founded DeepEval?

DeepEval was founded by Jeffrey Ip.

Who has invested in DeepEval?

DeepEval is backed by Y Combinator.

More Open Source startups