spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jun Zheng (JIRA)" <>
Subject [jira] [Commented] (SPARK-12347) Write script to run all MLlib examples for testing
Date Sun, 03 Jan 2016 22:57:39 GMT


Jun Zheng commented on SPARK-12347:

1. How to programmatically detect if a test requires input? I can see a ".required()" keyword
in OptionParser indicates the test needs input, but not all test that needs input have this

2. How to set input file names other than hard-coding?

> Write script to run all MLlib examples for testing
> --------------------------------------------------
>                 Key: SPARK-12347
>                 URL:
>             Project: Spark
>          Issue Type: Test
>          Components: ML, MLlib, PySpark, SparkR, Tests
>            Reporter: Joseph K. Bradley
> It would facilitate testing to have a script which runs all MLlib examples for all languages.
> Design sketch to ensure all examples are run:
> * Generate a list of examples to run programmatically (not from a fixed list).
> * Use a list of special examples to handle examples which require command line arguments.
> * Make sure data, etc. used are small to keep the tests quick.
> This could be broken into subtasks for each language, though it would be nice to provide
a single script.
> Not sure where the script should live; perhaps in {{bin/}}?

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message