spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hyukjin Kwon (Jira)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-25475) Refactor all benchmark to save the result as a separate file
Date Tue, 08 Oct 2019 04:35:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Hyukjin Kwon resolved SPARK-25475.
----------------------------------
    Resolution: Done

> Refactor all benchmark to save the result as a separate file
> ------------------------------------------------------------
>
>                 Key: SPARK-25475
>                 URL: https://issues.apache.org/jira/browse/SPARK-25475
>             Project: Spark
>          Issue Type: Improvement
>          Components: Tests
>    Affects Versions: 3.0.0
>            Reporter: Dongjoon Hyun
>            Priority: Major
>
> This is an umbrella issue to refactor all benchmarks to use a common style using main-method
(instead of `test` method) and saving the result as a separate file (instead of embedding
as comments). This is not only for consistency, but also for making the benchmark-automation
easy. SPARK-25339 is finished as a reference model.
> *Completed*
> - FilterPushdownBenchmark.scala (SPARK-25339)
> *Candidates*
> - AggregateBenchmark.scala
> - AvroWriteBenchmark.scala (SPARK-24777)
> - ColumnarBatchBenchmark.scala
> - CompressionSchemeBenchmark.scala
> - DataSourceReadBenchmark.scala
> - DataSourceWriteBenchmark.scala (SPARK-24777)
> - DatasetBenchmark.scala
> - ExternalAppendOnlyUnsafeRowArrayBenchmark.scala
> - HashBenchmark.scala
> - HashByteArrayBenchmark.scala
> - JoinBenchmark.scala
> - KryoBenchmark.scala
> - MiscBenchmark.scala
> - ObjectHashAggregateExecBenchmark.scala
> - OrcReadBenchmark.scala
> - PrimitiveArrayBenchmark.scala
> - SortBenchmark.scala
> - SynthBenchmark.scala
> - TPCDSQueryBenchmark.scala
> - UDTSerializationBenchmark.scala
> - UnsafeArrayDataBenchmark.scala
> - UnsafeProjectionBenchmark.scala
> - WideSchemaBenchmark.scala
> Candidates will be reviewed and converted as a subtask of this JIRA.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message