From dev-return-789-apmail-systemml-dev-archive=systemml.apache.org@systemml.incubator.apache.org Fri Sep 2 23:00:32 2016 Return-Path: X-Original-To: apmail-systemml-dev-archive@minotaur.apache.org Delivered-To: apmail-systemml-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 126B819B9B for ; Fri, 2 Sep 2016 23:00:32 +0000 (UTC) Received: (qmail 95218 invoked by uid 500); 2 Sep 2016 23:00:32 -0000 Delivered-To: apmail-systemml-dev-archive@systemml.apache.org Received: (qmail 95171 invoked by uid 500); 2 Sep 2016 23:00:31 -0000 Mailing-List: contact dev-help@systemml.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@systemml.incubator.apache.org Delivered-To: mailing list dev@systemml.incubator.apache.org Received: (qmail 95154 invoked by uid 99); 2 Sep 2016 23:00:31 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Sep 2016 23:00:31 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 265D7C3193 for ; Fri, 2 Sep 2016 23:00:31 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.298 X-Spam-Level: * X-Spam-Status: No, score=1.298 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 2gHprw7jlxK8 for ; Fri, 2 Sep 2016 23:00:27 +0000 (UTC) Received: from mx0a-001b2d01.pphosted.com (mx0b-001b2d01.pphosted.com [148.163.158.5]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id AE3165F610 for ; Fri, 2 Sep 2016 23:00:27 +0000 (UTC) Received: from pps.filterd (m0098420.ppops.net [127.0.0.1]) by mx0b-001b2d01.pphosted.com (8.16.0.17/8.16.0.17) with SMTP id u82Mr7D4041437 for ; Fri, 2 Sep 2016 19:00:27 -0400 Received: from e19.ny.us.ibm.com (e19.ny.us.ibm.com [129.33.205.209]) by mx0b-001b2d01.pphosted.com with ESMTP id 2576ntqvn3-1 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=NOT) for ; Fri, 02 Sep 2016 19:00:26 -0400 Received: from localhost by e19.ny.us.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Fri, 2 Sep 2016 19:00:26 -0400 Received: from d01dlp02.pok.ibm.com (9.56.250.167) by e19.ny.us.ibm.com (146.89.104.206) with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted; Fri, 2 Sep 2016 19:00:24 -0400 X-IBM-Helo: d01dlp02.pok.ibm.com X-IBM-MailFrom: gweidner@us.ibm.com Received: from b01cxnp22035.gho.pok.ibm.com (b01cxnp22035.gho.pok.ibm.com [9.57.198.25]) by d01dlp02.pok.ibm.com (Postfix) with ESMTP id CFFE26E8041 for ; Fri, 2 Sep 2016 19:00:01 -0400 (EDT) Received: from b01ledav005.gho.pok.ibm.com (b01ledav005.gho.pok.ibm.com [9.57.199.110]) by b01cxnp22035.gho.pok.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id u82N04KR17301850 for ; Fri, 2 Sep 2016 23:00:23 GMT Received: from b01ledav005.gho.pok.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 4D197AE034 for ; Fri, 2 Sep 2016 19:00:23 -0400 (EDT) Received: from d50lp31.co.us.ibm.com (unknown [9.17.249.32]) by b01ledav005.gho.pok.ibm.com (Postfix) with ESMTPS id F0B61AE03C for ; Fri, 2 Sep 2016 19:00:22 -0400 (EDT) Received: from localhost by d50lp31.co.us.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Fri, 2 Sep 2016 17:00:22 -0600 Received: from smtp.notes.na.collabserv.com (192.155.248.75) by d50lp31.co.us.ibm.com (192.168.2.141) with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted; (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128/128) Fri, 2 Sep 2016 17:00:20 -0600 X-IBM-Helo: smtp.notes.na.collabserv.com X-IBM-MailFrom: gweidner@us.ibm.com Received: from localhost by smtp.notes.na.collabserv.com with smtp.notes.na.collabserv.com ESMTP for from ; Fri, 2 Sep 2016 23:00:19 -0000 Received: from us1a3-smtp05.a3.dal06.isc4sb.com (10.146.71.159) by smtp.notes.na.collabserv.com (10.106.227.123) with smtp.notes.na.collabserv.com ESMTP; Fri, 2 Sep 2016 23:00:17 -0000 X-IBM-Helo: us1a3-smtp05.a3.dal06.isc4sb.com X-IBM-MailFrom: gweidner@us.ibm.com Received: from us1a3-mail52.a3.dal06.isc4sb.com ([10.146.77.168]) by us1a3-smtp05.a3.dal06.isc4sb.com with ESMTP id 2016090223001719-416061 ; Fri, 2 Sep 2016 23:00:17 +0000 MIME-Version: 1.0 Subject: NPE running GLM-predict.dml in spark mode To: dev@systemml.incubator.apache.org From: "Glenn Weidner" Date: Fri, 2 Sep 2016 16:00:09 -0700 X-KeepSent: 31FA87D0:09C6203C-00258022:007C2100; type=4; name=$KeepSent X-Mailer: IBM Notes Release 9.0.1FP5 SHF190 February 24, 2016 X-LLNOutbound: False X-Disclaimed: 9871 X-TNEFEvaluated: 1 Content-type: multipart/alternative; Boundary="0__=8FBB0AB1DFEFA7908f9e8a93df938690918c8FBB0AB1DFEFA790" Content-Disposition: inline x-cbid: 16090223-0056-0000-0000-0000013E58F3 X-IBM-ISS-SpamDetectors: Score=0.439231; BY=0; FL=0; FP=0; FZ=0; HX=0; KW=0; PH=0; SC=0.439231; ST=0; TS=0; UL=0; ISC= X-IBM-ISS-DetailInfo: BY=3.00005699; HX=3.00000240; KW=3.00000007; PH=3.00000004; SC=3.00000184; SDB=6.00753097; UDB=6.00356118; UTC=2016-09-02 23:00:18 x-cbparentid: 16090223-3816-0000-0000-000000539475 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused X-TM-AS-GCONF: 00 X-Content-Scanned: Fidelis XPS MAILER X-IBM-SpamModules-Scores: X-IBM-SpamModules-Versions: BY=3.00005699; HX=3.00000240; KW=3.00000007; PH=3.00000004; SC=3.00000184; SDB=6.00753097; UDB=6.00356118; IPR=6.00525746; BA=6.00004687; NDR=6.00000001; ZLA=6.00000005; ZF=6.00000009; ZB=6.00000000; ZP=6.00000000; ZH=6.00000000; ZU=6.00000002; MB=3.00012562; XFM=3.00000011; UTC=2016-09-02 23:00:24 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused Message-Id: X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2016-09-02_08:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 spamscore=0 suspectscore=1 malwarescore=0 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1604210000 definitions=main-1609020310 --0__=8FBB0AB1DFEFA7908f9e8a93df938690918c8FBB0AB1DFEFA790 Content-Transfer-Encoding: quoted-printable Content-type: text/plain; charset=ISO-8859-1 When running Linear Regression example described at https://apache.github.io/incubator-systemml/standalone-guide.html#linear-re= gression-example , everything works well with spark-submit under hybrid=5Fspark mode. However, when running the very last step GLM-predict with -exec spark, a null pointer exception occurs. spark-submit --master yarn --deploy-mode client --class org.apache.sysml.api.DMLScript systemml.jar -f GLM-predict.dml -exec spark -nvargs X=3DlinRegData.test.data.csv Y=3DlinRegData.test.labels.csv B=3Dbet= as.csv fmt=3Dcsv 16/09/02 15:35:10 ERROR DMLScript: Failed to execute DML script. org.apache.sysml.lops.LopsException: ERROR: line 240, column 30 -- Problem generating simple inst - SPARK=B0cdf=B0dist=3Dnormal=B0target=3D=B6=5FVar23= 7=B6=B0 =5FVar238=B7SCALAR=B7DOUBLE at org.apache.sysml.lops.compile.Dag.generateControlProgramJobs (Dag.java:1529) at org.apache.sysml.lops.compile.Dag.doGreedyGrouping(Dag.java:1194) at org.apache.sysml.lops.compile.Dag.getJobs(Dag.java:268) at org.apache.sysml.parser.DMLProgram.createRuntimeProgramBlock (DMLProgram.java:530) at org.apache.sysml.parser.DMLProgram.createRuntimeProgramBlock (DMLProgram.java:327) at org.apache.sysml.parser.DMLProgram.getRuntimeProgram (DMLProgram.java:196) at org.apache.sysml.api.DMLScript.execute(DMLScript.java:625) at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:337) at org.apache.sysml.api.DMLScript.main(DMLScript.java:192) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy $SparkSubmit$$runMain(SparkSubmit.scala:731) at org.apache.spark.deploy.SparkSubmit$.doRunMain$1 (SparkSubmit.scala:181) at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) Caused by: java.lang.NullPointerException at org.apache.sysml.runtime.instructions.SPInstructionParser.parseSingleInstru= ction (SPInstructionParser.java:284) at org.apache.sysml.runtime.instructions.InstructionParser.parseSingleInstruct= ion (InstructionParser.java:47) at org.apache.sysml.lops.compile.Dag.generateControlProgramJobs (Dag.java:1516) ... 17 more Exception in thread "main" org.apache.sysml.api.DMLException: org.apache.sysml.lops.LopsException: ERROR: line 240, column 30 -- Problem generating simple inst - SPARK=B0cdf=B0dist=3Dnormal=B0target=3D=B6=5FVar23= 7=B6=B0 =5FVar238=B7SCALAR=B7DOUBLE at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:351) at org.apache.sysml.api.DMLScript.main(DMLScript.java:192) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy $SparkSubmit$$runMain(SparkSubmit.scala:731) at org.apache.spark.deploy.SparkSubmit$.doRunMain$1 (SparkSubmit.scala:181) at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) Caused by: org.apache.sysml.lops.LopsException: ERROR: line 240, column 30 -- Problem generating simple inst - SPARK=B0cdf=B0dist=3Dnormal=B0target=3D= =B6=5FVar237=B6=B0 =5FVar238=B7SCALAR=B7DOUBLE at org.apache.sysml.lops.compile.Dag.generateControlProgramJobs (Dag.java:1529) at org.apache.sysml.lops.compile.Dag.doGreedyGrouping(Dag.java:1194) at org.apache.sysml.lops.compile.Dag.getJobs(Dag.java:268) at org.apache.sysml.parser.DMLProgram.createRuntimeProgramBlock (DMLProgram.java:530) at org.apache.sysml.parser.DMLProgram.createRuntimeProgramBlock (DMLProgram.java:327) at org.apache.sysml.parser.DMLProgram.getRuntimeProgram (DMLProgram.java:196) at org.apache.sysml.api.DMLScript.execute(DMLScript.java:625) at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:337) ... 10 more Caused by: java.lang.NullPointerException at org.apache.sysml.runtime.instructions.SPInstructionParser.parseSingleInstru= ction (SPInstructionParser.java:284) at org.apache.sysml.runtime.instructions.InstructionParser.parseSingleInstruct= ion (InstructionParser.java:47) at org.apache.sysml.lops.compile.Dag.generateControlProgramJobs (Dag.java:1516) ... 17 more 16/09/02 15:35:10 INFO SparkContext: Invoking stop() from shutdown hook Although I first hit the null pointer exception running newer code against Spark 2.0, the stack trace above corresponds to 0.10.0 release against Spark 1.6.1. No problem occurs if run with -exec hybrid=5Fspark. I only used -exec spark to force different scenario and just checking if anyone else has seen this before opening a JIRA. Thanks, Glenn --0__=8FBB0AB1DFEFA7908f9e8a93df938690918c8FBB0AB1DFEFA790--