spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alonso Isidoro Roman <alons...@gmail.com>
Subject a newbee trying to compile and execute examples from 0.9.0-incubating-SNAPSHOT
Date Wed, 22 Jan 2014 12:05:57 GMT
hi, i had imported the examples from incubator-spark/examples into eclipse
and it is giving me errors because spark-parent-0.9.0-incubating-SNAPSHOT.jar
is NOT on maven-central and i can't find it so i can`t upload it into my
local nexus repo. What can  i do? i can only see version 0.7.0 in
maven-central

http://mvnrepository.com/artifact/org.spark-project/spark-core_2.9.2/0.7.0

If i launch ./sbt/sbt test command, it returns me this log, with errors:

MacBook-Pro-Retina-de-Alonso:incubator-spark aironman$ ./sbt/sbt test

Launching sbt from sbt/sbt-launch-0.12.4.jar

[info] Loading project definition from
/Users/aironman/Dropbox/incubator-spark/project/project

[info] Loading project definition from
/Users/aironman/Dropbox/incubator-spark/project

[info] Set current project to root (in build
file:/Users/aironman/Dropbox/incubator-spark/)

[info] Updating {file:/Users/aironman/Dropbox/incubator-spark/}root...

[info] Resolving commons-io#commons-io;2.4 ...

[info] downloading
http://repo1.maven.org/maven2/org/scala-lang/scala-reflect/2.10.0/scala-reflect-2.10.0.jar...

[info] [SUCCESSFUL ] org.scala-lang#scala-reflect;2.10.0!scala-reflect.jar
(4375ms)

[info] Done updating.

[info] No tests to run for root/test:test

[info] Compiling 68 Scala sources and 1 Java source to
/Users/aironman/Dropbox/incubator-spark/core/target/scala-2.10/test-classes...

[info] Compiling 1 Scala source to
/Users/aironman/Dropbox/incubator-spark/bagel/target/scala-2.10/test-classes...

[info] Compiling 9 Scala sources and 8 Java sources to
/Users/aironman/Dropbox/incubator-spark/mllib/target/scala-2.10/test-classes...

[info] Compiling 14 Scala sources to
/Users/aironman/Dropbox/incubator-spark/graphx/target/scala-2.10/test-classes...

[info] Compiling 1 Scala source to
/Users/aironman/Dropbox/incubator-spark/repl/target/scala-2.10/test-classes...

[info] Compiling 10 Scala sources and 2 Java sources to
/Users/aironman/Dropbox/incubator-spark/streaming/target/scala-2.10/test-classes...

[info] No tests to run for tools/test:test

[info] No tests to run for assembly/test:test

[info] Compiling 44 Scala sources and 14 Java sources to
/Users/aironman/Dropbox/incubator-spark/examples/target/scala-2.10/classes...

[info] ReplSuite:

[warn] there were 2 feature warning(s); re-run with -feature for details

[warn] one warning found

2014-01-22 12:29:05.561 java[1153:1303] Unable to load realm info from
SCDynamicStore

[info] - propagation of local properties (9 seconds, 357 milliseconds)

[warn]
/Users/aironman/Dropbox/incubator-spark/streaming/src/test/scala/org/apache/spark/streaming/InputStreamsSuite.scala:305:
method connect in class IOManager is deprecated: use the new implementation
in package akka.io instead

[warn]   override def preStart = IOManager(context.system).connect(new
InetSocketAddress(port))

[warn]                                                     ^

[info] - simple foreach with accumulator (6 seconds, 913 milliseconds)

[warn] warning: [options] bootstrap class path not set in conjunction with
-source 1.6

[warn] 1 warning

[warn] there were 1 feature warning(s); re-run with -feature for details

[warn] one warning found

[info] - external vars (6 seconds, 46 milliseconds)

[warn] warning: [options] bootstrap class path not set in conjunction with
-source 1.6

[warn] 1 warning

[warn] there were 4 feature warning(s); re-run with -feature for details

[warn] two warnings found

[info] - external classes (4 seconds, 10 milliseconds)

[warn] warning: [options] bootstrap class path not set in conjunction with
-source 1.6

[warn] Note:
/Users/aironman/Dropbox/incubator-spark/streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java
uses unchecked or unsafe operations.

[warn] Note: Recompile with -Xlint:unchecked for details.

[warn] 1 warning

[info] Compiling 1 Scala source and 1 Java source to
/Users/aironman/Dropbox/incubator-spark/external/kafka/target/scala-2.10/test-classes...

[info] Compiling 1 Scala source and 1 Java source to
/Users/aironman/Dropbox/incubator-spark/external/twitter/target/scala-2.10/test-classes...

[info] Compiling 1 Scala source and 1 Java source to
/Users/aironman/Dropbox/incubator-spark/external/flume/target/scala-2.10/test-classes...

[info] Compiling 1 Scala source and 1 Java source to
/Users/aironman/Dropbox/incubator-spark/external/mqtt/target/scala-2.10/test-classes...

[info] Compiling 1 Scala source and 1 Java source to
/Users/aironman/Dropbox/incubator-spark/external/zeromq/target/scala-2.10/test-classes...

[warn] warning: [options] bootstrap class path not set in conjunction with
-source 1.6

[warn] 1 warning

[info] - external functions (6 seconds, 19 milliseconds)

[warn] warning: [options] bootstrap class path not set in conjunction with
-source 1.6

[warn] 1 warning

[warn] warning: [options] bootstrap class path not set in conjunction with
-source 1.6

[warn] 1 warning

[warn] warning: [options] bootstrap class path not set in conjunction with
-source 1.6

[warn] 1 warning

[warn] warning: [options] bootstrap class path not set in conjunction with
-source 1.6

[warn] 1 warning

[info] - external functions that access vars (3 seconds, 683 milliseconds)

[warn]
/Users/aironman/Dropbox/incubator-spark/core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala:51:
method mapPartitionsWithSplit in class RDD is deprecated: use
mapPartitionsWithIndex

[warn]     val partitionSumsWithSplit = nums.mapPartitionsWithSplit {

[warn]                                       ^

[info] - broadcast vars (2 seconds, 619 milliseconds)

[info] - interacting with files (2 seconds, 480 milliseconds)

[warn] there were 35 feature warning(s); re-run with -feature for details

[warn] two warnings found

[info] - local-cluster mode (5 seconds, 514 milliseconds)

[warn] warning: [options] bootstrap class path not set in conjunction with
-source 1.6

[warn] Note:
/Users/aironman/Dropbox/incubator-spark/core/src/test/scala/org/apache/spark/JavaAPISuite.java
uses unchecked or unsafe operations.

[warn] Note: Recompile with -Xlint:unchecked for details.

[warn] 1 warning

[info] Passed: : Total 9, Failed 0, Errors 0, Passed 9, Skipped 0

[info] BagelSuite:

2014-01-22 12:29:50.813 java[1179:1903] Unable to load realm info from
SCDynamicStore

[info] - halting by voting (1 second, 808 milliseconds)

[info] - halting by message silence (446 milliseconds)

[info] - large number of iterations (2 seconds, 627 milliseconds)

[info] - using non-default persistence level (1 second, 999 milliseconds)

[info] Passed: : Total 4, Failed 0, Errors 0, Passed 4, Skipped 0

[info] SVMSuite:

2014-01-22 12:30:02.983 java[1183:1b03] Unable to load realm info from
SCDynamicStore

[info] - SVM using local random SGD (3 seconds, 522 milliseconds)

[info] - SVM local random SGD with initial weights (2 seconds, 512
milliseconds)

[info] - SVM with invalid labels (2 seconds, 404 milliseconds)

[info] GradientDescentSuite:

[info] - Assert the loss is decreasing. (369 milliseconds)

[info] LogisticRegressionSuite:

[info] - logistic regression (579 milliseconds)

[info] - logistic regression with initial weights (315 milliseconds)

[info] NaiveBayesSuite:

[info] - Naive Bayes (201 milliseconds)

[info] KMeansSuite:

[info] - single cluster (822 milliseconds)

[info] - single cluster with big dataset (1 second, 449 milliseconds)

[info] - k-means|| initialization (263 milliseconds)

[info] RidgeRegressionSuite:

[info] - regularization with skewed weights (2 seconds, 527 milliseconds)

[info] ALSSuite:

[info] - rank-1 matrices (1 second, 165 milliseconds)

[info] - rank-1 matrices bulk (792 milliseconds)

[info] - rank-2 matrices (716 milliseconds)

[info] - rank-2 matrices bulk (865 milliseconds)

[info] - rank-1 matrices implicit (1 second, 20 milliseconds)

[info] - rank-1 matrices implicit bulk (1 second, 98 milliseconds)

[info] - rank-2 matrices implicit (1 second, 13 milliseconds)

[info] - rank-2 matrices implicit bulk (1 second, 142 milliseconds)

[info] LassoSuite:

[info] - Lasso local random SGD (559 milliseconds)

[info] - Lasso local random SGD with initial weights (488 milliseconds)

[info] LinearRegressionSuite:

[info] - linear regression (4 seconds, 294 milliseconds)

[info] Passed: : Total 40, Failed 0, Errors 0, Passed 40, Skipped 0

[info] TriangleCountSuite:

2014-01-22 12:31:23.863 java[1198:1903] Unable to load realm info from
SCDynamicStore

[info] - Count a single triangle (3 seconds, 861 milliseconds)

[info] - Count two triangles (1 second, 690 milliseconds)

[info] - Count two triangles with bi-directed edges (1 second, 604
milliseconds)

[info] - Count a single triangle with duplicate edges (1 second, 643
milliseconds)

[info] PageRankSuite:

[info] - Star PageRank (2 seconds, 182 milliseconds)

[info] - Grid PageRank (5 seconds, 62 milliseconds)

[info] - Chain PageRank (2 seconds, 549 milliseconds)

[info] VertexPartitionSuite:

[info] - isDefined, filter (1 millisecond)

[info] - isActive, numActives, replaceActives (0 milliseconds)

[info] - map (1 millisecond)

[info] - diff (0 milliseconds)

[info] - leftJoin (2 milliseconds)

[info] - innerJoin (2 milliseconds)

[info] - createUsingIndex (0 milliseconds)

[info] - innerJoinKeepLeft (0 milliseconds)

[info] - aggregateUsingIndex (1 millisecond)

[info] - reindex (2 milliseconds)

[info] StronglyConnectedComponentsSuite:

[info] - Island Strongly Connected Components (1 second, 665 milliseconds)

[info] - Cycle Strongly Connected Components (4 seconds, 94 milliseconds)

[info] - 2 Cycle Strongly Connected Components (2 seconds, 539 milliseconds)

[info] PregelSuite:

[info] - 1 iteration (1 second, 357 milliseconds)

[info] - chain propagation (1 second, 824 milliseconds)

[info] SVDPlusPlusSuite:

[info] - Test SVD++ with mean square error on training set (1 second, 547
milliseconds)

[info] SerializerSuite:

[info] - IntVertexBroadcastMsgSerializer (1 millisecond)

[info] - LongVertexBroadcastMsgSerializer (1 millisecond)

[info] - DoubleVertexBroadcastMsgSerializer (2 milliseconds)

[info] - IntAggMsgSerializer (0 milliseconds)

[info] - LongAggMsgSerializer (1 millisecond)

[info] - DoubleAggMsgSerializer (0 milliseconds)

[info] - TestShuffleVertexBroadcastMsg (1 second, 279 milliseconds)

[info] - variable long encoding (1 millisecond)

[info] VertexRDDSuite:

[info] - filter (1 second, 274 milliseconds)

[info] - mapValues (1 second, 285 milliseconds)

[info] - diff (1 second, 288 milliseconds)

[info] - leftJoin (1 second, 314 milliseconds)

[info] - innerJoin (1 second, 314 milliseconds)

[info] - aggregateUsingIndex (1 second, 283 milliseconds)

[info] GraphOpsSuite:

[info] - joinVertices (1 second, 284 milliseconds)

[info] - collectNeighborIds (1 second, 371 milliseconds)

[info] - filter (1 second, 315 milliseconds)

[info] BytecodeUtilsSuite:

[info] - closure invokes a method (2 milliseconds)

[info] - closure inside a closure invokes a method (1 millisecond)

[info] - closure inside a closure inside a closure invokes a method (2
milliseconds)

[info] - closure calling a function that invokes a method (1 millisecond)

[info] - closure calling a function that invokes a method which uses
another closure (1 millisecond)

[info] - nested closure (2 milliseconds)

[info] GraphSuite:

[info] - Graph.fromEdgeTuples (1 second, 287 milliseconds)

[info] - Graph.fromEdges (1 second, 222 milliseconds)

[info] - Graph.apply (1 second, 261 milliseconds)

[info] - triplets (1 second, 301 milliseconds)

[info] - partitionBy (3 seconds, 130 milliseconds)

[info] - mapVertices (1 second, 258 milliseconds)

[info] - mapEdges (1 second, 233 milliseconds)

[info] - mapTriplets (1 second, 297 milliseconds)

[info] - reverse (1 second, 295 milliseconds)

[info] - subgraph (1 second, 319 milliseconds)

[info] - mask (1 second, 278 milliseconds)

[info] - groupEdges (1 second, 282 milliseconds)

[info] - mapReduceTriplets (1 second, 720 milliseconds)

[info] - outerJoinVertices (1 second, 388 milliseconds)

[info] ConnectedComponentsSuite:

[info] - Grid Connected Components (2 seconds, 403 milliseconds)

[info] - Reverse Grid Connected Components (2 seconds, 384 milliseconds)

[info] - Chain Connected Components (2 seconds, 449 milliseconds)

[info] - Reverse Chain Connected Components (2 seconds, 527 milliseconds)

[info] - Connected Components on a Toy Connected Graph (1 second, 366
milliseconds)

[info] EdgePartitionSuite:

[info] - reverse (2 milliseconds)

[info] - map (1 millisecond)

[info] - groupEdges (1 millisecond)

[info] - indexIterator (1 millisecond)

[info] - innerJoin (1 millisecond)

[info] Passed: : Total 70, Failed 0, Errors 0, Passed 70, Skipped 0

[info] No tests to run for examples/test:test

[info] BasicOperationsSuite:

2014-01-22 12:32:40.280 java[1214:1903] Unable to load realm info from
SCDynamicStore

[info] - map (4 seconds, 72 milliseconds)

[info] - flatMap (2 seconds, 813 milliseconds)

[info] - filter (2 seconds, 801 milliseconds)

[info] - glom (2 seconds, 803 milliseconds)

[info] - mapPartitions (2 seconds, 790 milliseconds)

[info] - repartition (more partitions) (2 seconds, 947 milliseconds)

[info] - repartition (fewer partitions) (2 seconds, 893 milliseconds)

[info] - groupByKey (2 seconds, 894 milliseconds)

[info] - reduceByKey (2 seconds, 830 milliseconds)

[info] - reduce (2 seconds, 833 milliseconds)

[info] - count (2 seconds, 934 milliseconds)

[info] - countByValue (2 seconds, 826 milliseconds)

[info] - mapValues (2 seconds, 836 milliseconds)

[info] - flatMapValues (2 seconds, 831 milliseconds)

[info] - union (2 seconds, 777 milliseconds)

[info] - StreamingContext.union (2 seconds, 774 milliseconds)

[info] - transform (2 seconds, 772 milliseconds)

[info] - transformWith (2 seconds, 881 milliseconds)

[info] - StreamingContext.transform (2 seconds, 768 milliseconds)

[info] - cogroup (2 seconds, 820 milliseconds)

[info] - join (2 seconds, 824 milliseconds)

[info] - leftOuterJoin (2 seconds, 817 milliseconds)

[info] - rightOuterJoin (2 seconds, 821 milliseconds)

[info] - updateStateByKey (2 seconds, 874 milliseconds)

[info] - updateStateByKey - object lifecycle (2 seconds, 817 milliseconds)

[info] - slice (5 seconds, 277 milliseconds)

[info] - rdd cleanup - map and window (2 seconds, 870 milliseconds)

[info] - rdd cleanup - updateStateByKey (2 seconds, 966 milliseconds)

[info] RateLimitedOutputStreamSuite:

[info] - write (5 seconds, 6 milliseconds)

[info] StreamingListenerSuite:

[info] - basic BatchInfo generation (3 seconds, 146 milliseconds)

[info] FailureSuite:


[info] - multiple failures with map (40 seconds, 430 milliseconds)

[info] - multiple failures with updateStateByKey (36 seconds, 142
milliseconds)

[info] StreamingContextSuite:

[info] - from no conf constructor (23 milliseconds)

[info] - from no conf + spark home (25 milliseconds)

[info] - from no conf + spark home + env (30 milliseconds)

[info] - from conf without ttl set (28 milliseconds)

[info] - from conf with ttl set (30 milliseconds)

[info] - from existing SparkContext without ttl set (27 milliseconds)

[info] - from existing SparkContext with ttl set (25 milliseconds)

[info] - from checkpoint (1 second, 291 milliseconds)

[info] - start multiple times (1 second, 33 milliseconds)

[info] - stop multiple times (2 seconds, 212 milliseconds)

[info] - stop only streaming context (1 second, 33 milliseconds)

[info] - awaitTermination (3 seconds, 54 milliseconds)

[info] - awaitTermination with error in task (2 seconds, 9 milliseconds)

[info] - awaitTermination with error in job generation (1 second, 806
milliseconds)

[info] InputStreamsSuite:

[info] - socket input stream (6 seconds, 724 milliseconds)

[info] - file input stream (14 seconds, 230 milliseconds)

[info] - actor input stream (8 seconds, 721 milliseconds)

[info] - multi-thread receiver (3 seconds, 415 milliseconds)

[info] CheckpointSuite:

[info] - basic rdd checkpoints + dstream graph checkpoint recovery (15
seconds, 222 milliseconds)

[info] - persistence of conf through checkpoints (1 second, 227
milliseconds)

[info] - recovery with map and reduceByKey operations (9 seconds, 434
milliseconds)

[info] - recovery with invertible reduceByKeyAndWindow operation (11
seconds, 448 milliseconds)

[info] - recovery with updateStateByKey operation (11 seconds, 448
milliseconds)

[info] - recovery with file input stream (17 seconds, 300 milliseconds)

[info] WindowOperationsSuite:

[info] - window - basic window (2 seconds, 759 milliseconds)

[info] - window - tumbling window (2 seconds, 757 milliseconds)

[info] - window - larger window (2 seconds, 756 milliseconds)

[info] - window - non-overlapping window (2 seconds, 759 milliseconds)

[info] - window - persistence level (1 second, 207 milliseconds)

[info] - reduceByKeyAndWindow - basic reduction (2 seconds, 765
milliseconds)

[info] - reduceByKeyAndWindow - key already in window and new value added
into window (2 seconds, 760 milliseconds)

[info] - reduceByKeyAndWindow - new key added into window (2 seconds, 757
milliseconds)

[info] - reduceByKeyAndWindow - key removed from window (2 seconds, 764
milliseconds)

[info] - reduceByKeyAndWindow - larger slide time (2 seconds, 811
milliseconds)

[info] - reduceByKeyAndWindow - big test (2 seconds, 860 milliseconds)

[info] - reduceByKeyAndWindow with inverse function - basic reduction (2
seconds, 762 milliseconds)

[info] - reduceByKeyAndWindow with inverse function - key already in window
and new value added into window (2 seconds, 760 milliseconds)

[info] - reduceByKeyAndWindow with inverse function - new key added into
window (2 seconds, 763 milliseconds)

[info] - reduceByKeyAndWindow with inverse function - key removed from
window (2 seconds, 811 milliseconds)

[info] - reduceByKeyAndWindow with inverse function - larger slide time (2
seconds, 814 milliseconds)

[info] - reduceByKeyAndWindow with inverse function - big test (2 seconds,
914 milliseconds)

[info] - reduceByKeyAndWindow with inverse and filter functions - big test
(2 seconds, 965 milliseconds)

[info] - groupByKeyAndWindow (2 seconds, 913 milliseconds)

[info] - countByWindow (2 seconds, 868 milliseconds)

[info] - countByValueAndWindow (2 seconds, 816 milliseconds)

[info] Passed: : Total 122, Failed 0, Errors 0, Passed 122, Skipped 0

[info] MQTTStreamSuite:

2014-01-22 12:40:36.195 java[1328:1903] Unable to load realm info from
SCDynamicStore

[info] - mqtt input stream (2 seconds, 750 milliseconds)

[info] Passed: : Total 2, Failed 0, Errors 0, Passed 2, Skipped 0

[info] TwitterStreamSuite:

2014-01-22 12:40:40.534 java[1330:1903] Unable to load realm info from
SCDynamicStore

[info] - twitter input stream (2 seconds, 364 milliseconds)

[info] Passed: : Total 2, Failed 0, Errors 0, Passed 2, Skipped 0

[info] KafkaStreamSuite:

SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in
[jar:file:/Users/aironman/Dropbox/incubator-spark/lib_managed/jars/slf4j-log4j12-1.7.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in
[jar:file:/Users/aironman/Dropbox/incubator-spark/lib_managed/jars/slf4j-simple-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.

SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

2014-01-22 12:40:44.919 java[1333:1903] Unable to load realm info from
SCDynamicStore

[info] - kafka input stream (2 seconds, 354 milliseconds)

[info] Passed: : Total 2, Failed 0, Errors 0, Passed 2, Skipped 0

[info] ZeroMQStreamSuite:

2014-01-22 12:40:49.344 java[1334:1903] Unable to load realm info from
SCDynamicStore

[info] - zeromq input stream (2 seconds, 401 milliseconds)

[info] Passed: : Total 2, Failed 0, Errors 0, Passed 2, Skipped 0

[info] FlumeStreamSuite:

2014-01-22 12:40:53.764 java[1336:1903] Unable to load realm info from
SCDynamicStore

[info] - flume input stream (8 seconds, 75 milliseconds)

[info] Passed: : Total 2, Failed 0, Errors 0, Passed 2, Skipped 0

[info] DistributionSuite:

[info] - summary (22 milliseconds)

[info] PrimitiveVectorSuite:

[info] - primitive value (7 milliseconds)

[info] - non-primitive value (7 milliseconds)

[info] - ideal growth (9 milliseconds)

[info] - ideal size (52 milliseconds)

[info] - resizing (5 milliseconds)

[info] SizeEstimatorSuite:

[info] - simple classes (1 millisecond)

[info] - strings (1 millisecond)

[info] - primitive arrays (1 millisecond)

[info] - object arrays (11 milliseconds)

[info] - 32-bit arch (7 milliseconds)

[info] - 64-bit arch with no compressed oops (1 millisecond)

[info] ClosureCleanerSuite:

2014-01-22 12:41:04.236 java[1340:1903] Unable to load realm info from
SCDynamicStore

[info] - closures inside an object (2 seconds, 495 milliseconds)

[info] - closures inside a class (1 second, 278 milliseconds)

[info] - closures inside a class with no default constructor (1 second, 261
milliseconds)

[info] - closures that don't use fields of the outer class (1 second, 252
milliseconds)

[info] - nested closures inside an object (1 second, 289 milliseconds)

[info] - nested closures inside a class (1 second, 277 milliseconds)

[info] UISuite:

[info] - jetty port increases under contention (170 milliseconds)

[info] - jetty binds to port 0 correctly (2 milliseconds)

[info] AccumulatorSuite:

[info] - basic accumulation (240 milliseconds)

[info] - value not assignable from tasks (245 milliseconds)

[info] - add value to collection accumulators (3 seconds, 373 milliseconds)

[info] - value not readable in tasks (2 seconds, 812 milliseconds)

[info] - collection accumulators (5 seconds, 214 milliseconds)

[info] - localValue readable in tasks (2 seconds, 838 milliseconds)

[info] ThreadingSuite:

[info] - accessing SparkContext form a different thread (207 milliseconds)

[info] - accessing SparkContext form multiple threads (257 milliseconds)

[info] - accessing multi-threaded SparkContext form multiple threads (240
milliseconds)

[info] - parallel job execution (316 milliseconds)

[info] - set local properties in different thread (200 milliseconds)

[info] - set and get local properties in parent-children thread (196
milliseconds)

[info] VectorSuite:

[info] - random with default random number generator (3 milliseconds)

[info] - random with given random number generator (1 millisecond)

[info] CheckpointSuite:

[info] - basic checkpointing (68 milliseconds)

[info] - RDDs with one-to-one dependencies (1 second, 209 milliseconds)

[info] - ParallelCollection (37 milliseconds)

[info] - BlockRDD (33 milliseconds)

[info] - ShuffledRDD (73 milliseconds)

[info] - UnionRDD (168 milliseconds)

[info] - CartesianRDD (452 milliseconds)

[info] - CoalescedRDD (146 milliseconds)

[info] - CoGroupedRDD (187 milliseconds)

[info] - ZippedRDD (203 milliseconds)

[info] - PartitionerAwareUnionRDD (201 milliseconds)

[info] - CheckpointRDD with zero partitions (3 milliseconds)

[info] SparkListenerSuite:

[info] - basic creation of StageInfo (18 milliseconds)

[info] - StageInfo with fewer tasks than partitions (10 milliseconds)

[info] - local metrics (4 seconds, 392 milliseconds)

[info] - onTaskGettingResult() called when result fetched remotely (1
second, 111 milliseconds)

[info] - onTaskGettingResult() not called when result sent directly (7
milliseconds)

[info] PipedRDDSuite:

[info] - basic pipe (43 milliseconds)

[info] - advanced pipe (68 milliseconds)

[info] - pipe with env variable (59 milliseconds)

[info] - pipe with non-zero exit status (12 milliseconds)

[info] DAGSchedulerSuite:

[info] - zero split job (3 milliseconds)

[info] - run trivial job (5 milliseconds)

[info] - local job (1 millisecond)

[info] - run trivial job w/ dependency (1 millisecond)

[info] - cache location preferences w/ dependency (3 milliseconds)

[info] - trivial job failure (1 millisecond)

[info] - run trivial shuffle (7 milliseconds)

[info] - run trivial shuffle with fetch failure (8 milliseconds)

[info] - ignore late map task completions (4 milliseconds)

[info] - run trivial shuffle with out-of-band failure and retry (5
milliseconds)

[info] - recursive shuffle failures (7 milliseconds)

[info] - cached post-shuffle (5 milliseconds)

[info] JobCancellationSuite:

[info] - local mode, FIFO scheduler (219 milliseconds)

[info] - local mode, fair scheduler (226 milliseconds)

[info] - cluster mode, FIFO scheduler (3 seconds, 312 milliseconds)

[info] - cluster mode, fair scheduler (2 seconds, 777 milliseconds)

[info] - job group (194 milliseconds)

[info] AsyncRDDActionsSuite:

[info] - countAsync (8 milliseconds)

[info] - collectAsync (8 milliseconds)

[info] - foreachAsync (9 milliseconds)

[info] - foreachPartitionAsync (10 milliseconds)

[info] - takeAsync (1 second, 793 milliseconds)

[info] - async success handling (21 milliseconds)

[info] - async failure handling (6 milliseconds)

[info] - FutureAction result, infinite wait (4 milliseconds)

[info] - FutureAction result, finite wait (4 milliseconds)

[info] - FutureAction result, timeout (23 milliseconds)

[info] DoubleRDDSuite:

[info] - WorksOnEmpty (16 milliseconds)

[info] - WorksWithOutOfRangeWithOneBucket (8 milliseconds)

[info] - WorksInRangeWithOneBucket (12 milliseconds)

[info] - WorksInRangeWithOneBucketExactMatch (9 milliseconds)

[info] - WorksWithOutOfRangeWithTwoBuckets (7 milliseconds)

[info] - WorksWithOutOfRangeWithTwoUnEvenBuckets (4 milliseconds)

[info] - WorksInRangeWithTwoBuckets (9 milliseconds)

[info] - WorksInRangeWithTwoBucketsAndNaN (8 milliseconds)

[info] - WorksInRangeWithTwoUnevenBuckets (5 milliseconds)

[info] - WorksMixedRangeWithTwoUnevenBuckets (4 milliseconds)

[info] - WorksMixedRangeWithFourUnevenBuckets (4 milliseconds)

[info] - WorksMixedRangeWithUnevenBucketsAndNaN (4 milliseconds)

[info] - WorksMixedRangeWithUnevenBucketsAndNaNAndNaNRange (4 milliseconds)

[info] - WorksMixedRangeWithUnevenBucketsAndNaNAndNaNRangeAndInfity (4
milliseconds)

[info] - WorksWithOutOfRangeWithInfiniteBuckets (4 milliseconds)

[info] - ThrowsExceptionOnInvalidBucketArray (1 millisecond)

[info] - WorksWithoutBucketsBasic (29 milliseconds)

[info] - WorksWithoutBucketsBasicSingleElement (9 milliseconds)

[info] - WorksWithoutBucketsBasicNoRange (10 milliseconds)

[info] - WorksWithoutBucketsBasicTwo (10 milliseconds)

[info] - WorksWithoutBucketsWithMoreRequestedThanElements (10 milliseconds)

[info] - ThrowsExceptionOnInvalidRDDs (13 milliseconds)

Created root dirs: 1390390964961-0,1390390964962-0

[info] DiskBlockManagerSuite:

[info] - basic block creation (1 millisecond)

[info] - block appending (0 milliseconds)

[info] - block remapping (0 milliseconds)

[info] OpenHashMapSuite:

[info] - size for specialized, primitive value (int) (7 milliseconds)

[info] - initialization (1 millisecond)

[info] - primitive value (28 milliseconds)

[info] - non-primitive value (21 milliseconds)

[info] - null keys (1 millisecond)

[info] - null values (1 millisecond)

[info] - changeValue (8 milliseconds)

[info] - inserting in capacity-1 map (2 milliseconds)

[info] PrimitiveKeyOpenHashMapSuite:

[info] - size for specialized, primitive key, value (int, int) (2
milliseconds)

[info] - initialization (0 milliseconds)

[info] - basic operations (30 milliseconds)

[info] - null values (1 millisecond)

[info] - changeValue (5 milliseconds)

[info] - inserting in capacity-1 map (1 millisecond)

[info] SizeTrackingAppendOnlyMapSuite:

[info] - fixed size insertions (910 milliseconds)

[info] - variable size insertions (834 milliseconds)

[info] - updates (801 milliseconds)

[info] PartitionPruningRDDSuite:

[info] - Pruned Partitions inherit locality prefs correctly (2 milliseconds)

[info] - Pruned Partitions can be unioned  (12 milliseconds)

[info] ClusterSchedulerSuite:

[info] - FIFO Scheduler Test (185 milliseconds)

[info] - Fair Scheduler Test (194 milliseconds)

[info] - Nested Pool Test (182 milliseconds)

[info] JobLoggerSuite:

[info] - inner method (185 milliseconds)

[info] - inner variables (204 milliseconds)

[info] - interface functions (204 milliseconds)

[info] FileServerSuite:

[info] - Distributing files locally (309 milliseconds)

[info] - Distributing files locally using URL as input (242 milliseconds)

[info] - Dynamically adding JARS locally (223 milliseconds)

[info] - Distributing files on a standalone cluster (2 seconds, 177
milliseconds)

[info] - Dynamically adding JARS on a standalone cluster (2 seconds, 450
milliseconds)

[info] - Dynamically adding JARS on a standalone cluster using local: URL
(1 second, 984 milliseconds)

[info] XORShiftRandomSuite:

[info] - XORShift generates valid random numbers (1 second, 963
milliseconds)

[info] SparkConfSuite:

[info] - loading from system properties (0 milliseconds)

[info] - initializing without loading defaults (1 millisecond)

[info] - named set methods (1 millisecond)

[info] - basic get and set (1 millisecond)

[info] - creating SparkContext without master and app name (0 milliseconds)

[info] - creating SparkContext without master (1 millisecond)

[info] - creating SparkContext without app name (0 milliseconds)

[info] - creating SparkContext with both master and app name (186
milliseconds)

[info] - SparkContext property overriding (183 milliseconds)

[info] - nested property names (0 milliseconds)

[info] UnpersistSuite:

[info] - unpersist RDD (201 milliseconds)

[info] WorkerWatcherSuite:

[INFO] [01/22/2014 12:43:17.819] [test-akka.actor.default-dispatcher-4]
[akka://test/deadLetters] Message
[org.apache.spark.deploy.DeployMessages$SendHeartbeat$] from
TestActor[akka://test/user/$$a] to Actor[akka://test/deadLetters] was not
delivered. [1] dead letters encountered. This logging can be turned off or
adjusted with configuration settings 'akka.log-dead-letters' and
'akka.log-dead-letters-during-shutdown'.

[info] - WorkerWatcher shuts down on valid disassociation (21 milliseconds)

[INFO] [01/22/2014 12:43:17.826] [test-akka.actor.default-dispatcher-3]
[akka://test/deadLetters] Message
[org.apache.spark.deploy.DeployMessages$SendHeartbeat$] from
TestActor[akka://test/user/$$b] to Actor[akka://test/deadLetters] was not
delivered. [1] dead letters encountered. This logging can be turned off or
adjusted with configuration settings 'akka.log-dead-letters' and
'akka.log-dead-letters-during-shutdown'.

[info] - WorkerWatcher stays alive on invalid disassociation (6
milliseconds)

[info] MapOutputTrackerSuite:

[info] - compressSize (0 milliseconds)

[info] - decompressSize (1 millisecond)

[info] - master start and stop (4 milliseconds)

[info] - master register and fetch (6 milliseconds)

[info] - master register and unregister and fetch (5 milliseconds)

[info] - remote fetch (49 milliseconds)

[info] ShuffleSuite:

[info] - groupByKey without compression (205 milliseconds)

[info] - shuffle non-zero block size (2 seconds, 399 milliseconds)

[info] - shuffle serializer (2 seconds, 461 milliseconds)

[info] - zero sized blocks (2 seconds, 599 milliseconds)

[info] - zero sized blocks without kryo (2 seconds, 737 milliseconds)

[info] - shuffle using mutable pairs (2 seconds, 767 milliseconds)

[info] - sorting using mutable pairs (2 seconds, 762 milliseconds)

[info] - cogroup using mutable pairs (2 seconds, 713 milliseconds)

[info] - subtract mutable pairs (2 seconds, 426 milliseconds)

[info] BroadcastSuite:

[info] - Using HttpBroadcast locally (190 milliseconds)

[info] - Accessing HttpBroadcast variables from multiple threads (198
milliseconds)

[info] - Accessing HttpBroadcast variables in a local cluster (3 seconds,
144 milliseconds)

[info] - Using TorrentBroadcast locally (192 milliseconds)

[info] - Accessing TorrentBroadcast variables from multiple threads (197
milliseconds)

[info] - Accessing TorrentBroadcast variables in a local cluster (3
seconds, 42 milliseconds)

[info] BlockManagerSuite:

[info] - StorageLevel object caching (0 milliseconds)

[info] - BlockManagerId object caching (0 milliseconds)

[info] - master + 1 manager interaction (4 milliseconds)

[info] - master + 2 managers interaction (101 milliseconds)

[info] - removing block (17 milliseconds)

[info] - removing rdd (7 milliseconds)

[info] - reregistration on heart beat (7 milliseconds)

[info] - reregistration on block update (5 milliseconds)

[info] - reregistration doesn't dead lock (198 milliseconds)

[info] - in-memory LRU storage (6 milliseconds)

[info] - in-memory LRU storage with serialization (21 milliseconds)

[info] - in-memory LRU for partitions of same RDD (5 milliseconds)

[info] - in-memory LRU for partitions of multiple RDDs (4 milliseconds)

[info] - on-disk storage (19 milliseconds)

[info] - disk and memory storage (11 milliseconds)

[info] - disk and memory storage with getLocalBytes (14 milliseconds)

[info] - disk and memory storage with serialization (18 milliseconds)

[info] - disk and memory storage with serialization and getLocalBytes (13
milliseconds)

[info] - LRU with mixed storage levels (27 milliseconds)

[info] - in-memory LRU with streams (4 milliseconds)

[info] - LRU with mixed storage levels and streams (35 milliseconds)

[info] - negative byte values in ByteBufferInputStream (1 millisecond)

[info] - overly large block (7 milliseconds)

[info] - block compression (21 milliseconds)

[info] - block store put failure (7 milliseconds)

[info] BitSetSuite:

[info] - basic set and get (2 milliseconds)

[info] - 100% full bit set (5 milliseconds)

[info] - nextSetBit (0 milliseconds)

[info] DriverSuite:

2014-01-22 12:44:06.257 java[1589:1903] Unable to load realm info from
SCDynamicStore

2014-01-22 12:44:08.667 java[1607:1903] Unable to load realm info from
SCDynamicStore

[info] - driver should exit after finishing (6 seconds, 962 milliseconds)

[info] UtilsSuite:

[info] - bytesToString (0 milliseconds)

[info] - copyStream (10 milliseconds)

[info] - memoryStringToMb (1 millisecond)

[info] - splitCommandString (0 milliseconds)

[info] - string formatting of time durations *** FAILED *** (3 milliseconds)

[info]   "1[,]0 s" did not equal "1[.]0 s" (UtilsSuite.scala:103)

[info]   org.scalatest.exceptions.TestFailedException:

[info]   at
org.scalatest.Assertions$class.newAssertionFailedException(Assertions.scala:318)

[info]   at
org.apache.spark.util.UtilsSuite.newAssertionFailedException(UtilsSuite.scala:28)

[info]   at org.scalatest.Assertions$class.assert(Assertions.scala:401)

[info]   at org.apache.spark.util.UtilsSuite.assert(UtilsSuite.scala:28)

[info]   at
org.apache.spark.util.UtilsSuite$$anonfun$5.apply$mcV$sp(UtilsSuite.scala:103)

[info]   at
org.apache.spark.util.UtilsSuite$$anonfun$5.apply(UtilsSuite.scala:96)

[info]   at
org.apache.spark.util.UtilsSuite$$anonfun$5.apply(UtilsSuite.scala:96)

[info]   at org.scalatest.FunSuite$$anon$1.apply(FunSuite.scala:1265)

[info]   at org.scalatest.Suite$class.withFixture(Suite.scala:1974)

[info]   at
org.apache.spark.util.UtilsSuite.withFixture(UtilsSuite.scala:28)

[info]   at
org.scalatest.FunSuite$class.invokeWithFixture$1(FunSuite.scala:1262)

[info]   at
org.scalatest.FunSuite$$anonfun$runTest$1.apply(FunSuite.scala:1271)

[info]   at
org.scalatest.FunSuite$$anonfun$runTest$1.apply(FunSuite.scala:1271)

[info]   at org.scalatest.SuperEngine.runTestImpl(Engine.scala:198)

[info]   at org.scalatest.FunSuite$class.runTest(FunSuite.scala:1271)

[info]   at org.apache.spark.util.UtilsSuite.runTest(UtilsSuite.scala:28)

[info]   at
org.scalatest.FunSuite$$anonfun$runTests$1.apply(FunSuite.scala:1304)

[info]   at
org.scalatest.FunSuite$$anonfun$runTests$1.apply(FunSuite.scala:1304)

[info]   at
org.scalatest.SuperEngine$$anonfun$org$scalatest$SuperEngine$$runTestsInBranch$1.apply(Engine.scala:260)

[info]   at
org.scalatest.SuperEngine$$anonfun$org$scalatest$SuperEngine$$runTestsInBranch$1.apply(Engine.scala:249)

[info]   at scala.collection.immutable.List.foreach(List.scala:318)

[info]   at org.scalatest.SuperEngine.org
$scalatest$SuperEngine$$runTestsInBranch(Engine.scala:249)

[info]   at org.scalatest.SuperEngine.runTestsImpl(Engine.scala:326)

[info]   at org.scalatest.FunSuite$class.runTests(FunSuite.scala:1304)

[info]   at org.apache.spark.util.UtilsSuite.runTests(UtilsSuite.scala:28)

[info]   at org.scalatest.Suite$class.run(Suite.scala:2303)

[info]   at org.apache.spark.util.UtilsSuite.org
$scalatest$FunSuite$$super$run(UtilsSuite.scala:28)

[info]   at org.scalatest.FunSuite$$anonfun$run$1.apply(FunSuite.scala:1310)

[info]   at org.scalatest.FunSuite$$anonfun$run$1.apply(FunSuite.scala:1310)

[info]   at org.scalatest.SuperEngine.runImpl(Engine.scala:362)

[info]   at org.scalatest.FunSuite$class.run(FunSuite.scala:1310)

[info]   at org.apache.spark.util.UtilsSuite.run(UtilsSuite.scala:28)

[info]   at
org.scalatest.tools.ScalaTestFramework$ScalaTestRunner.run(ScalaTestFramework.scala:214)

[info]   at sbt.ForkMain$Run.runTest(ForkMain.java:176)

[info]   at sbt.ForkMain$Run.runTestSafe(ForkMain.java:166)

[info]   at sbt.ForkMain$Run.runTests(ForkMain.java:158)

[info]   at sbt.ForkMain$Run.run(ForkMain.java:186)

[info]   at sbt.ForkMain.main(ForkMain.java:84)

[info] - reading offset bytes of a file (8 milliseconds)

[info] - deserialize long value (0 milliseconds)

[info] KryoSerializerSuite:

[info] - basic types (12 milliseconds)

[info] - pairs (3 milliseconds)

[info] - Scala data structures (10 milliseconds)

[info] - ranges (14 milliseconds)

[info] - custom registrator (12 milliseconds)

[info] - kryo with collect (22 milliseconds)

[info] - kryo with parallelize (14 milliseconds)

[info] - kryo with parallelize for specialized tuples (14 milliseconds)

[info] - kryo with parallelize for primitive arrays (10 milliseconds)

[info] - kryo with collect for specialized tuples (10 milliseconds)

[info] - kryo with SerializableHyperLogLog (20 milliseconds)

[info] - kryo with reduce (17 milliseconds)

[info] - kryo with fold !!! IGNORED !!!

[info] TaskResultGetterSuite:

[info] - handling results smaller than Akka frame size (189 milliseconds)

[info] - handling results larger than Akka frame size (322 milliseconds)

[info] - task retried if result missing from block manager (391
milliseconds)

[info] OpenHashSetSuite:

[info] - size for specialized, primitive int (4 milliseconds)

[info] - primitive int (0 milliseconds)

[info] - primitive long (1 millisecond)

[info] - non-primitive (0 milliseconds)

[info] - non-primitive set growth (3 milliseconds)

[info] - primitive set growth (3 milliseconds)

[info] DistributedSuite:

[info] - task throws not serializable exception (3 seconds, 937
milliseconds)

[info] - local-cluster format (13 seconds, 813 milliseconds)

[info] - simple groupByKey (2 seconds, 548 milliseconds)

[info] - groupByKey where map output sizes exceed maxMbInFlight (2 seconds,
683 milliseconds)

[info] - accumulators (2 seconds, 235 milliseconds)

[info] - broadcast variables (2 seconds, 424 milliseconds)

[info] - repeatedly failing task (2 seconds, 278 milliseconds)

Job aborted: Task 0.0:0 failed 4 times (most recent failure: unknown)

[info] - repeatedly failing task that crashes JVM (5 seconds, 475
milliseconds)

[info] - caching (2 seconds, 467 milliseconds)

[info] - caching on disk (2 seconds, 375 milliseconds)

[info] - caching in memory, replicated (2 seconds, 544 milliseconds)

[info] - caching in memory, serialized, replicated (2 seconds, 806
milliseconds)

[info] - caching on disk, replicated (2 seconds, 337 milliseconds)

[info] - caching in memory and disk, replicated (2 seconds, 593
milliseconds)

[info] - caching in memory and disk, serialized, replicated (2 seconds, 544
milliseconds)

[info] - compute without caching when no partitions fit in memory (6
seconds, 133 milliseconds)

[info] - compute when only some partitions fit in memory (5 seconds, 409
milliseconds)

[info] - passing environment variables to cluster (2 seconds, 173
milliseconds)

[info] - recover from node failures (4 seconds, 812 milliseconds)

[info] - recover from repeated node failures during shuffle-map (5 seconds,
930 milliseconds)

[info] - recover from repeated node failures during shuffle-reduce (11
seconds, 633 milliseconds)

[info] - recover from node failures with replication (10 seconds, 626
milliseconds)

[info] - unpersist RDDs (2 seconds, 715 milliseconds)

[info] RDDSuite:

[info] - basic operations (158 milliseconds)

[info] - countApproxDistinct (141 milliseconds)

[info] - SparkContext.union (18 milliseconds)

[info] - partitioner aware union (38 milliseconds)

[info] - aggregate (7 milliseconds)

[info] - basic caching (10 milliseconds)

[info] - caching with failures (8 milliseconds)

[info] - empty RDD (61 milliseconds)

[info] - repartitioned RDDs (215 milliseconds)

[info] - coalesced RDDs (111 milliseconds)

[info] - coalesced RDDs with locality (42 milliseconds)

[info] - coalesced RDDs with locality, large scale (10K partitions) (490
milliseconds)

[info] - zipped RDDs (8 milliseconds)

[info] - partition pruning (4 milliseconds)

[info] - mapWith (6 milliseconds)

[info] - flatMapWith (6 milliseconds)

[info] - filterWith (6 milliseconds)

[info] - take (2 seconds, 744 milliseconds)

[info] - top with predefined ordering (66 milliseconds)

[info] - top with custom ordering (14 milliseconds)

[info] - takeOrdered with predefined ordering (5 milliseconds)

[info] - takeOrdered with custom ordering (6 milliseconds)

[info] - takeSample (143 milliseconds)

[info] - runJob on an invalid partition (1 millisecond)

[info] CompressionCodecSuite:

[info] - default compression codec (2 milliseconds)

[info] - lzf compression codec (1 millisecond)

[info] - snappy compression codec (37 milliseconds)

[info] SortingSuite:

[info] - sortByKey (22 milliseconds)

[info] - large array (52 milliseconds)

[info] - large array with one split (28 milliseconds)

[info] - large array with many partitions (75 milliseconds)

[info] - sort descending (35 milliseconds)

[info] - sort descending with one split (23 milliseconds)

[info] - sort descending with many partitions (75 milliseconds)

[info] - more partitions than elements (120 milliseconds)

[info] - empty RDD (15 milliseconds)

[info] - partition balancing (48 milliseconds)

[info] - partition balancing for descending sort (47 milliseconds)

[info] ZippedPartitionsSuite:

[info] - print sizes (14 milliseconds)

[info] DriverRunnerTest:

[info] - Process succeeds instantly (142 milliseconds)

[info] - Process failing several times and then succeeding (6 milliseconds)

[info] - Process doesn't restart if not supervised (2 milliseconds)

[info] - Process doesn't restart if killed (3 milliseconds)

[info] - Reset of backoff counter (8 milliseconds)

[info] FileSuite:

[info] - text files (251 milliseconds)

[info] - text files (compressed) (391 milliseconds)

[info] - SequenceFiles (227 milliseconds)

[info] - SequenceFile (compressed) (245 milliseconds)

[info] - SequenceFile with writable key (214 milliseconds)

[info] - SequenceFile with writable value (205 milliseconds)

[info] - SequenceFile with writable key and value (201 milliseconds)

[info] - implicit conversions in reading SequenceFiles (221 milliseconds)

[info] - object files of ints (207 milliseconds)

[info] - object files of complex types (212 milliseconds)

[info] - write SequenceFile using new Hadoop API (212 milliseconds)

[info] - read SequenceFile using new Hadoop API (213 milliseconds)

[info] - file caching (195 milliseconds)

[info] PairRDDFunctionsSuite:

[info] - groupByKey (12 milliseconds)

[info] - groupByKey with duplicates (7 milliseconds)

[info] - groupByKey with negative key hash codes (7 milliseconds)

[info] - groupByKey with many output partitions (17 milliseconds)

[info] - reduceByKey (10 milliseconds)

[info] - reduceByKey with collectAsMap (8 milliseconds)

[info] - reduceByKey with many output partitons (17 milliseconds)

[info] - reduceByKey with partitioner (10 milliseconds)

[info] - countApproxDistinctByKey (2 seconds, 435 milliseconds)

[info] - join (11 milliseconds)

[info] - join all-to-all (9 milliseconds)

[info] - leftOuterJoin (10 milliseconds)

[info] - rightOuterJoin (10 milliseconds)

[info] - join with no matches (8 milliseconds)

[info] - join with many output partitions (19 milliseconds)

[info] - groupWith (8 milliseconds)

[info] - zero-partition RDD (5 milliseconds)

[info] - keys and values (8 milliseconds)

[info] - default partitioner uses partition size (4 milliseconds)

[info] - default partitioner uses largest partitioner (10 milliseconds)

[info] - subtract (17 milliseconds)

[info] - subtract with narrow dependency (26 milliseconds)

[info] - subtractByKey (13 milliseconds)

[info] - subtractByKey with narrow dependency (15 milliseconds)

[info] - foldByKey (11 milliseconds)

[info] - foldByKey with mutable result type (15 milliseconds)

[info] JdbcRDDSuite:

[info] - basic functionality (258 milliseconds)

[info] TaskSetManagerSuite:

[info] - TaskSet with no preferences (185 milliseconds)

[info] - multiple offers with no preferences (188 milliseconds)

[info] - basic delay scheduling (183 milliseconds)

[info] - delay scheduling with fallback (180 milliseconds)

[info] - delay scheduling with failed hosts (180 milliseconds)

[info] - task result lost (184 milliseconds)

[info] - repeated failures lead to task set abortion (188 milliseconds)

[info] JsonProtocolSuite:

[info] - writeApplicationInfo (26 milliseconds)

[info] - writeWorkerInfo (4 milliseconds)

[info] - writeApplicationDescription (3 milliseconds)

[info] - writeExecutorRunner (2 milliseconds)

[info] - writeMasterState (12 milliseconds)

[info] - writeWorkerState (8 milliseconds)

[info] SparkContextSchedulerCreationSuite:

[info] - bad-master (184 milliseconds)

[info] - local (181 milliseconds)

[info] - local-n (179 milliseconds)

[info] - local-n-failures (181 milliseconds)

[info] - simr (184 milliseconds)

[info] - local-cluster (213 milliseconds)

[info] - yarn-standalone (188 milliseconds)

[info] - yarn-client (186 milliseconds)

Failed to load native Mesos library from
/Users/aironman/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.

[info] - mesos fine-grained (185 milliseconds)

Failed to load native Mesos library from
/Users/aironman/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.

[info] - mesos coarse-grained (183 milliseconds)

Failed to load native Mesos library from
/Users/aironman/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.

[info] - mesos with zookeeper (183 milliseconds)

[info] ExecutorRunnerTest:

[info] - command includes appId (52 milliseconds)

[info] NextIteratorSuite:

[info] - one iteration (3 milliseconds)

[info] - two iterations (1 millisecond)

[info] - empty iteration (0 milliseconds)

[info] - close is called once for empty iterations (0 milliseconds)

[info] - close is called once for non-empty iterations (1 millisecond)

[info] MetricsConfigSuite:

[info] - MetricsConfig with default properties (2 milliseconds)

[info] - MetricsConfig with properties set (0 milliseconds)

[info] - MetricsConfig with subProperties (0 milliseconds)

[info] CacheManagerSuite:

[info] - get uncached rdd (6 milliseconds)

[info] - get cached rdd (1 millisecond)

[info] - get uncached local rdd (1 millisecond)

[info] FailureSuite:

[info] - failure in a single-stage job (215 milliseconds)

[info] - failure in a two-stage job (204 milliseconds)

[info] - failure because task results are not serializable (200
milliseconds)

[info] - failure because task closure is not serializable (205 milliseconds)

[info] MetricsSystemSuite:

[info] - MetricsSystem with default config (1 millisecond)

[info] - MetricsSystem with sources add (8 milliseconds)

[info] ParallelCollectionSplitSuite:

[info] - one element per slice (0 milliseconds)

[info] - one slice (0 milliseconds)

[info] - equal slices (0 milliseconds)

[info] - non-equal slices (0 milliseconds)

[info] - splitting exclusive range (0 milliseconds)

[info] - splitting inclusive range (0 milliseconds)

[info] - empty data (1 millisecond)

[info] - zero slices (0 milliseconds)

[info] - negative number of slices (0 milliseconds)

[info] - exclusive ranges sliced into ranges (0 milliseconds)

[info] - inclusive ranges sliced into ranges (1 millisecond)

[info] - large ranges don't overflow (1 millisecond)

[info] - random array tests (152 milliseconds)

[info] - random exclusive range tests (30 milliseconds)

[info] - random inclusive range tests (23 milliseconds)

[info] - exclusive ranges of longs (2 milliseconds)

[info] - inclusive ranges of longs (1 millisecond)

[info] - exclusive ranges of doubles (1 millisecond)

[info] - inclusive ranges of doubles (1 millisecond)

[info] SparkContextInfoSuite:

[info] - getPersistentRDDs only returns RDDs that are marked as cached (182
milliseconds)

[info] - getPersistentRDDs returns an immutable map (182 milliseconds)

[info] - getRDDStorageInfo only reports on RDDs that actually persist data
(193 milliseconds)

[info] JobProgressListenerSuite:

[info] - test executor id to summary (183 milliseconds)

[info] ShuffleNettySuite:

[info] - groupByKey without compression (387 milliseconds)

[info] - shuffle non-zero block size (4 seconds, 803 milliseconds)

[info] - shuffle serializer (4 seconds, 742 milliseconds)

[info] - zero sized blocks (3 seconds, 734 milliseconds)

[info] - zero sized blocks without kryo (3 seconds, 592 milliseconds)

[info] - shuffle using mutable pairs (3 seconds, 528 milliseconds)

[info] - sorting using mutable pairs (3 seconds, 666 milliseconds)

[info] - cogroup using mutable pairs (3 seconds, 592 milliseconds)

[info] - subtract mutable pairs (3 seconds, 631 milliseconds)

[info] PartitioningSuite:

[info] - HashPartitioner equality (0 milliseconds)

[info] - RangePartitioner equality (37 milliseconds)

[info] - HashPartitioner not equal to RangePartitioner (8 milliseconds)

[info] - partitioner preservation (24 milliseconds)

[info] - partitioning Java arrays should fail (8 milliseconds)

[info] - zero-length partitions should be correctly handled (78
milliseconds)

[info] AppendOnlyMapSuite:

[info] - initialization (1 millisecond)

[info] - object keys and values (3 milliseconds)

[info] - primitive keys and values (1 millisecond)

[info] - null keys (0 milliseconds)

[info] - null values (1 millisecond)

[info] - changeValue (3 milliseconds)

[info] - inserting in capacity-1 map (0 milliseconds)

[info] - destructive sort (7 milliseconds)

[info] ExternalAppendOnlyMapSuite:

[info] - simple insert (233 milliseconds)

[info] - insert with collision (245 milliseconds)

[info] - ordering (244 milliseconds)

[info] - null keys and values (234 milliseconds)

[info] - simple aggregator (257 milliseconds)

[info] - simple cogroup (253 milliseconds)

[info] - spilling (4 seconds, 873 milliseconds)

[info] TaskContextSuite:

[info] - Calls executeOnCompleteCallbacks after failure (238 milliseconds)

[info] BlockIdSuite:

[info] - test-bad-deserialization (0 milliseconds)

[info] - rdd (0 milliseconds)

[info] - shuffle (0 milliseconds)

[info] - broadcast (0 milliseconds)

[info] - taskresult (0 milliseconds)

[info] - stream (0 milliseconds)

[info] - test (0 milliseconds)

ene 22, 2014 12:49:37 PM
org.jboss.netty.util.internal.SharedResourceMisuseDetector

Advertencia: You are creating too many HashedWheelTimer instances.
HashedWheelTimer is a shared resource that must be reused across the
application, so that only a few instances are created.

[error] Failed: : Total 483, Failed 1, Errors 0, Passed 481, Skipped 1

[error] Failed tests:

[error] org.apache.spark.util.UtilsSuite

[error] (core/test:test) sbt.TestsFailedException: Tests unsuccessful

[error] Total time: 1270 s, completed 22-ene-2014 12:49:42

MacBook-Pro-Retina-de-Alonso:incubator-spark aironman$

Alonso Isidoro Roman.

Mis citas preferidas (de hoy) :
"Si depurar es el proceso de quitar los errores de software, entonces
programar debe ser el proceso de introducirlos..."
 -  Edsger Dijkstra

My favorite quotes (today):
"If debugging is the process of removing software bugs, then programming
must be the process of putting ..."
  - Edsger Dijkstra

"If you pay peanuts you get monkeys"

Mime
View raw message