See Changes: [Matthias Boehm] [SYSTEMML-568] Fix various issues w/ mlcontext frame support [npansar] [SYSTEMML-209] Added documentation for MLPipeline scala wrappers for ------------------------------------------ [...truncated 7660 lines...] 16/08/29 17:24:25 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 225.0, whose tasks have all completed, from pool 16/08/29 17:24:25 INFO storage.BlockManagerInfo: Removed broadcast_208_piece0 on localhost:35854 in memory (size: 2029.0 B, free: 1092.4 MB) 16/08/29 17:24:25 INFO spark.ContextCleaner: Cleaned shuffle 64 16/08/29 17:24:25 INFO storage.BlockManagerInfo: Removed broadcast_209_piece0 on localhost:35854 in memory (size: 3.1 KB, free: 1092.4 MB) 16/08/29 17:24:25 INFO scheduler.DAGScheduler: Registering RDD 618 (flatMapToPair at RDDConverterUtilsExt.java:501) 16/08/29 17:24:25 INFO scheduler.DAGScheduler: Got job 143 (collectAsList at MLContextTest.java:1232) with 1 output partitions (allowLocal=false) 16/08/29 17:24:25 INFO scheduler.DAGScheduler: Final stage: ResultStage 227(collectAsList at MLContextTest.java:1232) 16/08/29 17:24:25 INFO scheduler.DAGScheduler: Parents of final stage: List(ShuffleMapStage 226) 16/08/29 17:24:25 INFO scheduler.DAGScheduler: Missing parents: List(ShuffleMapStage 226) 16/08/29 17:24:25 INFO scheduler.DAGScheduler: Submitting ShuffleMapStage 226 (MapPartitionsRDD[618] at flatMapToPair at RDDConverterUtilsExt.java:501), which has no missing parents 16/08/29 17:24:25 INFO storage.MemoryStore: ensureFreeSpace(3616) called with curMem=712468, maxMem=1145485393 16/08/29 17:24:25 INFO storage.MemoryStore: Block broadcast_210 stored as values in memory (estimated size 3.5 KB, free 1091.7 MB) 16/08/29 17:24:25 INFO storage.MemoryStore: ensureFreeSpace(2027) called with curMem=716084, maxMem=1145485393 16/08/29 17:24:25 INFO storage.MemoryStore: Block broadcast_210_piece0 stored as bytes in memory (estimated size 2027.0 B, free 1091.7 MB) 16/08/29 17:24:25 INFO storage.BlockManagerInfo: Added broadcast_210_piece0 in memory on localhost:35854 (size: 2027.0 B, free: 1092.4 MB) 16/08/29 17:24:25 INFO spark.SparkContext: Created broadcast 210 from broadcast at DAGScheduler.scala:874 16/08/29 17:24:25 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 226 (MapPartitionsRDD[618] at flatMapToPair at RDDConverterUtilsExt.java:501) 16/08/29 17:24:25 INFO scheduler.TaskSchedulerImpl: Adding task set 226.0 with 1 tasks 16/08/29 17:24:25 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 226.0 (TID 292, localhost, PROCESS_LOCAL, 1616 bytes) 16/08/29 17:24:25 INFO executor.Executor: Running task 0.0 in stage 226.0 (TID 292) 16/08/29 17:24:25 INFO executor.Executor: Finished task 0.0 in stage 226.0 (TID 292). 879 bytes result sent to driver 16/08/29 17:24:25 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 226.0 (TID 292) in 5 ms on localhost (1/1) 16/08/29 17:24:25 INFO scheduler.DAGScheduler: ShuffleMapStage 226 (flatMapToPair at RDDConverterUtilsExt.java:501) finished in 0.004 s 16/08/29 17:24:25 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 226.0, whose tasks have all completed, from pool 16/08/29 17:24:25 INFO scheduler.DAGScheduler: looking for newly runnable stages 16/08/29 17:24:25 INFO scheduler.DAGScheduler: running: Set() 16/08/29 17:24:25 INFO scheduler.DAGScheduler: waiting: Set(ResultStage 227) 16/08/29 17:24:25 INFO scheduler.DAGScheduler: failed: Set() 16/08/29 17:24:25 INFO scheduler.DAGScheduler: Missing parents for ResultStage 227: List() 16/08/29 17:24:25 INFO scheduler.DAGScheduler: Submitting ResultStage 227 (MapPartitionsRDD[623] at collectAsList at MLContextTest.java:1232), which is now runnable 16/08/29 17:24:25 INFO storage.MemoryStore: ensureFreeSpace(6312) called with curMem=718111, maxMem=1145485393 16/08/29 17:24:25 INFO storage.MemoryStore: Block broadcast_211 stored as values in memory (estimated size 6.2 KB, free 1091.7 MB) 16/08/29 17:24:25 INFO storage.MemoryStore: ensureFreeSpace(3175) called with curMem=724423, maxMem=1145485393 16/08/29 17:24:25 INFO storage.MemoryStore: Block broadcast_211_piece0 stored as bytes in memory (estimated size 3.1 KB, free 1091.7 MB) 16/08/29 17:24:25 INFO storage.BlockManagerInfo: Added broadcast_211_piece0 in memory on localhost:35854 (size: 3.1 KB, free: 1092.3 MB) 16/08/29 17:24:25 INFO spark.SparkContext: Created broadcast 211 from broadcast at DAGScheduler.scala:874 16/08/29 17:24:25 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from ResultStage 227 (MapPartitionsRDD[623] at collectAsList at MLContextTest.java:1232) 16/08/29 17:24:25 INFO scheduler.TaskSchedulerImpl: Adding task set 227.0 with 1 tasks 16/08/29 17:24:25 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 227.0 (TID 293, localhost, PROCESS_LOCAL, 1165 bytes) 16/08/29 17:24:25 INFO executor.Executor: Running task 0.0 in stage 227.0 (TID 293) 16/08/29 17:24:25 INFO storage.ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks 16/08/29 17:24:25 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms 16/08/29 17:24:25 INFO executor.Executor: Finished task 0.0 in stage 227.0 (TID 293). 2074 bytes result sent to driver 16/08/29 17:24:25 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 227.0 (TID 293) in 6 ms on localhost (1/1) 16/08/29 17:24:25 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 227.0, whose tasks have all completed, from pool 16/08/29 17:24:25 INFO scheduler.DAGScheduler: ResultStage 227 (collectAsList at MLContextTest.java:1232) finished in 0.007 s 16/08/29 17:24:26 INFO storage.BlockManagerInfo: Removed broadcast_211_piece0 on localhost:35854 in memory (size: 3.1 KB, free: 1092.4 MB) 16/08/29 17:24:26 INFO storage.BlockManagerInfo: Removed broadcast_210_piece0 on localhost:35854 in memory (size: 2027.0 B, free: 1092.4 MB) 16/08/29 17:24:26 INFO spark.ContextCleaner: Cleaned shuffle 65 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/metrics/json,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/stage/kill,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/api,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/static,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors/threadDump/json,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors/threadDump,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors/json,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/environment/json,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/environment,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage/rdd/json,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage/rdd,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage/json,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/pool/json,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/pool,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/stage/json,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/stage,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/json,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs/job/json,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs/job,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs/json,null} 16/08/29 17:24:26 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs,null} 16/08/29 17:24:26 INFO ui.SparkUI: Stopped Spark web UI at http://169.54.146.43:4040 16/08/29 17:24:26 INFO scheduler.DAGScheduler: Stopping DAGScheduler 16/08/29 17:24:26 INFO spark.MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 16/08/29 17:24:26 INFO util.Utils: path = /tmp/spark-ee9e100f-5975-4156-8e66-9b202bdff925/blockmgr-e5274cc5-b91c-4cca-9042-5d3c8e012a61, already present as root for deletion. 16/08/29 17:24:26 INFO storage.MemoryStore: MemoryStore cleared 16/08/29 17:24:26 INFO storage.BlockManager: BlockManager stopped 16/08/29 17:24:26 INFO storage.BlockManagerMaster: BlockManagerMaster stopped 16/08/29 17:24:26 INFO scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 16/08/29 17:24:26 INFO spark.SparkContext: Successfully stopped SparkContext Running org.apache.sysml.test.integration.mlcontext.MLContextTest 16/08/29 17:24:26 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 16/08/29 17:24:26 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. Tests run: 124, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.062 sec - in org.apache.sysml.test.integration.mlcontext.MLContextTest 16/08/29 17:24:26 INFO util.Utils: Shutdown hook called 16/08/29 17:24:26 INFO util.Utils: Deleting directory /tmp/spark-ee9e100f-5975-4156-8e66-9b202bdff925 16/08/29 17:24:26 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. Running org.apache.sysml.test.integration.applications.dml.ArimaDMLTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 79.32 sec - in org.apache.sysml.test.integration.applications.dml.ArimaDMLTest Running org.apache.sysml.test.integration.applications.parfor.ParForCVMulticlassSVMTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.973 sec - in org.apache.sysml.test.integration.applications.parfor.ParForCVMulticlassSVMTest Running org.apache.sysml.test.integration.scalability.LinearRegressionTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.938 sec - in org.apache.sysml.test.integration.scalability.LinearRegressionTest Running org.apache.sysml.test.integration.scalability.PageRankTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.85 sec - in org.apache.sysml.test.integration.scalability.PageRankTest Running org.apache.sysml.test.integration.applications.parfor.ParForUnivariateStatsTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.223 sec - in org.apache.sysml.test.integration.applications.parfor.ParForUnivariateStatsTest Running org.apache.sysml.test.integration.functions.quaternary.WeightedSigmoidTest Tests run: 56, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,018.69 sec - in org.apache.sysml.test.integration.functions.quaternary.WeightedSigmoidTest 16/08/29 17:28:03 INFO util.Utils: Shutdown hook called 16/08/29 17:28:03 INFO util.Utils: Deleting directory /tmp/spark-7c148dff-dae1-4421-ad3f-a64cd0709349 Running org.apache.sysml.test.integration.functions.indexing.LeftIndexingTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 676.84 sec - in org.apache.sysml.test.integration.functions.indexing.LeftIndexingTest Running org.apache.sysml.test.integration.functions.append.AppendVectorTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 528.699 sec - in org.apache.sysml.test.integration.functions.append.AppendVectorTest Running org.apache.sysml.test.integration.applications.parfor.ParForCorrelationTest Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 288.806 sec - in org.apache.sysml.test.integration.applications.parfor.ParForCorrelationTest Running org.apache.sysml.test.integration.applications.descriptivestats.UnivariateUnweightedScaleDenseTest Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 348.082 sec - in org.apache.sysml.test.integration.applications.descriptivestats.UnivariateUnweightedScaleDenseTest Running org.apache.sysml.test.integration.applications.parfor.ParForCorrelationTestLarge Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.389 sec - in org.apache.sysml.test.integration.applications.parfor.ParForCorrelationTestLarge Running org.apache.sysml.test.integration.functions.indexing.Jdk7IssueRightIndexingTest Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 839.664 sec - in org.apache.sysml.test.integration.functions.indexing.Jdk7IssueRightIndexingTest Running org.apache.sysml.test.integration.functions.reorg.FullOrderTest Tests run: 132, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,391.408 sec - in org.apache.sysml.test.integration.functions.reorg.FullOrderTest Running org.apache.sysml.test.integration.functions.quaternary.WeightedDivMatrixMultTest Tests run: 90, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,515.194 sec - in org.apache.sysml.test.integration.functions.quaternary.WeightedDivMatrixMultTest 16/08/29 17:35:53 INFO util.Utils: Shutdown hook called 16/08/29 17:35:53 INFO util.Utils: Deleting directory /tmp/spark-008fffd3-4904-40ae-8faa-409a662f4457 Running org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleDenseTest Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 369.113 sec - in org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleDenseTest Running org.apache.sysml.test.integration.functions.append.AppendChainTest Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,114.516 sec - in org.apache.sysml.test.integration.functions.append.AppendChainTest Running org.apache.sysml.test.integration.applications.parfor.ParForNaiveBayesTest Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 536.458 sec - in org.apache.sysml.test.integration.applications.parfor.ParForNaiveBayesTest Running org.apache.sysml.test.integration.applications.descriptivestats.UnivariateUnweightedScaleSparseTest Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 290.961 sec - in org.apache.sysml.test.integration.applications.descriptivestats.UnivariateUnweightedScaleSparseTest Running org.apache.sysml.test.integration.applications.dml.HITSDMLTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 88.867 sec - in org.apache.sysml.test.integration.applications.dml.HITSDMLTest Running org.apache.sysml.test.integration.functions.append.AppendMatrixTest Tests run: 22, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,596.059 sec - in org.apache.sysml.test.integration.functions.append.AppendMatrixTest Running org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleSparseTest Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 366.335 sec - in org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleSparseTest Running org.apache.sysml.test.integration.applications.pydml.ArimaPyDMLTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.662 sec - in org.apache.sysml.test.integration.applications.pydml.ArimaPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.HITSPyDMLTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 77.07 sec - in org.apache.sysml.test.integration.applications.pydml.HITSPyDMLTest Running org.apache.sysml.test.integration.applications.dml.LinearRegressionDMLTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.102 sec - in org.apache.sysml.test.integration.applications.dml.LinearRegressionDMLTest Running org.apache.sysml.test.integration.applications.pydml.CsplineDSPyDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.869 sec - in org.apache.sysml.test.integration.applications.pydml.CsplineDSPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.LinearLogRegPyDMLTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 106.218 sec - in org.apache.sysml.test.integration.applications.pydml.LinearLogRegPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.NaiveBayesPyDMLTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.029 sec - in org.apache.sysml.test.integration.applications.pydml.NaiveBayesPyDMLTest Running org.apache.sysml.test.integration.applications.dml.CsplineCGDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.139 sec - in org.apache.sysml.test.integration.applications.dml.CsplineCGDMLTest Running org.apache.sysml.test.integration.applications.dml.L2SVMDMLTest Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.695 sec - in org.apache.sysml.test.integration.applications.dml.L2SVMDMLTest Running org.apache.sysml.test.integration.applications.pydml.MDABivariateStatsPyDMLTest Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 292.8 sec - in org.apache.sysml.test.integration.applications.pydml.MDABivariateStatsPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.PageRankPyDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.323 sec - in org.apache.sysml.test.integration.applications.pydml.PageRankPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.NaiveBayesParforPyDMLTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.431 sec - in org.apache.sysml.test.integration.applications.pydml.NaiveBayesParforPyDMLTest Running org.apache.sysml.test.integration.applications.dml.NaiveBayesDMLTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.647 sec - in org.apache.sysml.test.integration.applications.dml.NaiveBayesDMLTest Running org.apache.sysml.test.integration.applications.dml.MDABivariateStatsDMLTest Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 295.162 sec - in org.apache.sysml.test.integration.applications.dml.MDABivariateStatsDMLTest Running org.apache.sysml.test.integration.applications.dml.PageRankDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.448 sec - in org.apache.sysml.test.integration.applications.dml.PageRankDMLTest Running org.apache.sysml.test.integration.applications.pydml.GLMPyDMLTest Tests run: 30, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 587.216 sec - in org.apache.sysml.test.integration.applications.pydml.GLMPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.MultiClassSVMPyDMLTest Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 89.4 sec - in org.apache.sysml.test.integration.applications.pydml.MultiClassSVMPyDMLTest Running org.apache.sysml.test.integration.applications.dml.ID3DMLTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 379.979 sec - in org.apache.sysml.test.integration.applications.dml.ID3DMLTest Running org.apache.sysml.test.integration.applications.dml.GLMDMLTest Tests run: 30, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 896.839 sec - in org.apache.sysml.test.integration.applications.dml.GLMDMLTest Running org.apache.sysml.test.integration.applications.pydml.CsplineCGPyDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.274 sec - in org.apache.sysml.test.integration.applications.pydml.CsplineCGPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.WelchTPyDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.594 sec - in org.apache.sysml.test.integration.applications.pydml.WelchTPyDMLTest Running org.apache.sysml.test.integration.applications.dml.MultiClassSVMDMLTest Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 90.355 sec - in org.apache.sysml.test.integration.applications.dml.MultiClassSVMDMLTest Running org.apache.sysml.test.integration.applications.dml.CsplineDSDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.527 sec - in org.apache.sysml.test.integration.applications.dml.CsplineDSDMLTest Running org.apache.sysml.test.integration.applications.pydml.ApplyTransformPyDMLTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.237 sec - in org.apache.sysml.test.integration.applications.pydml.ApplyTransformPyDMLTest Running org.apache.sysml.test.integration.applications.dml.NaiveBayesParforDMLTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.655 sec - in org.apache.sysml.test.integration.applications.dml.NaiveBayesParforDMLTest Running org.apache.sysml.test.integration.applications.pydml.L2SVMPyDMLTest Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.225 sec - in org.apache.sysml.test.integration.applications.pydml.L2SVMPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.LinearRegressionPyDMLTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.274 sec - in org.apache.sysml.test.integration.applications.pydml.LinearRegressionPyDMLTest Running org.apache.sysml.test.integration.applications.dml.LinearLogRegDMLTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.881 sec - in org.apache.sysml.test.integration.applications.dml.LinearLogRegDMLTest Running org.apache.sysml.test.integration.applications.dml.GNMFDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.505 sec - in org.apache.sysml.test.integration.applications.dml.GNMFDMLTest Running org.apache.sysml.test.integration.applications.dml.WelchTDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.676 sec - in org.apache.sysml.test.integration.applications.dml.WelchTDMLTest Running org.apache.sysml.test.integration.applications.dml.ApplyTransformDMLTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.578 sec - in org.apache.sysml.test.integration.applications.dml.ApplyTransformDMLTest Running org.apache.sysml.test.integration.applications.pydml.ID3PyDMLTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 326.953 sec - in org.apache.sysml.test.integration.applications.pydml.ID3PyDMLTest Running org.apache.sysml.test.integration.applications.pydml.GNMFPyDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.918 sec - in org.apache.sysml.test.integration.applications.pydml.GNMFPyDMLTest Results : Failed tests: RightIndexingMatrixTest>AutomatedTestBase.tearDown:1468 Detailed matrices characteristics: ! B-DML<->B-R # stored values in B-R: 1 ! B-DML<->B-R # stored values in B-DML: 1 ! B-DML<->B-R identical values(z=0): 0 ! B-DML<->B-R wrong values(z=1.0E-10): 1 ! B-DML<->B-R min error: 28.29499265352624 ! B-DML<->B-R max error: 28.29499265352624 C-DML<->C-R # stored values in C-R: 170 C-DML<->C-R # stored values in C-DML: 170 C-DML<->C-R identical values(z=0): 170 C-DML<->C-R wrong values(z=1.0E-10): 0 C-DML<->C-R min error: 0.0 C-DML<->C-R max error: 0.0 D-DML<->D-R # stored values in D-R: 215 D-DML<->D-R # stored values in D-DML: 215 D-DML<->D-R identical values(z=0): 215 D-DML<->D-R wrong values(z=1.0E-10): 0 D-DML<->D-R min error: 0.0 D-DML<->D-R max error: 0.0 Tests run: 5812, Failures: 1, Errors: 0, Skipped: 0 [INFO] [INFO] --- maven-failsafe-plugin:2.17:verify (default) @ systemml --- [INFO] Failsafe report directory: [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:21 h [INFO] Finished at: 2016-08-29T18:32:32-05:00 [INFO] Final Memory: 63M/2190M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-failsafe-plugin:2.17:verify (default) on project systemml: There are test failures. [ERROR] [ERROR] Please refer to for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException Build step 'Execute shell' marked build as failure Run condition [Always] enabling perform for step [[]]