spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maxim Gekk <>
Subject unify benchmarks in 2.4 and regenerate results
Date Tue, 04 Feb 2020 10:48:57 GMT
Hi All,

Currently, most of benchmark results are embedded into benchmark source
codes in Spark 2.4.x. This makes comparison of the results between 2.4
releases and master pretty inconvenient. I would like to propose to unify
benchmarks in branch-2.4 by backporting the changes made in the master: and regenerate all
results in the same environment. This will allow to compare Spark 3.0 to
Spark 2.4.x, and minor releases of 2.4.x.

Maxim Gekk

Software Engineer

Databricks, Inc.

View raw message