spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From shane knapp <skn...@berkeley.edu>
Subject Re: Jenkins commands?
Date Thu, 07 Feb 2019 04:47:33 GMT
the PRB executes the following scripts:
./dev/run-tests-jenkins
./build/sbt unsafe/test

SBT QA tests:
./dev/run-tests

maven QA tests:
ZINC_PORT=$(python -S -c "import random; print random.randrange(3030,4030)")
MVN="build/mvn --force -DzincPort=$ZINC_PORT"
$MVN \
    -DskipTests \
    -P"hadoop-2.7" \
    -Pyarn \
    -Phive \
    -Phive-thriftserver \
    -Pkinesis-asl \
    -Pmesos \
    clean package
$MVN \
    -P"hadoop-2.7" \
    -Pyarn \
    -Phive \
    -Phive-thriftserver \
    -Pkinesis-asl \
    -Pmesos \
    --fail-at-end \
    test

there some some specific rise/amp-lab variables involved (grep -r AMPLAB
spark/*) for the build system, but this should cover it.

On Wed, Feb 6, 2019 at 3:55 PM Tom Graves <tgraves_cs@yahoo.com.invalid>
wrote:

> I'm curious if we have it documented anywhere or if there is a good place
> to look, what exact commands Spark runs in the pull request builds and the
> QA builds?
>
>
> Thanks,
> Tom
>


-- 
Shane Knapp
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu

Mime
View raw message