Repeatable Benchmarking: An Exploration of OpenSearch vs Elasticsearch

title	Repeatable Benchmarking: An Exploration of OpenSearch vs Elasticsearch
date	2025-09-08
authors	Evan Downing
conference	OpenSearchCon North America 2025
resources	label path Slides Repeatable Benchmarking: An Exploration of OpenSearch vs Elasticsearch.pdf label url Recording https://youtu.be/QF0eCS1xr8I label url Blog Post https://blog.trailofbits.com/2025/03/06/benchmarking-opensearch-and-elasticsearch/

This talk presents Trail of Bits' automated benchmarking framework for running OpenSearch Benchmark using GitHub Actions and AWS to make benchmarking OpenSearch and Elasticsearch easy. Using this framework, the team reveals performance inconsistencies and outliers that impacted results, with preliminary findings on newer releases suggesting improved performance for both engines.