From dev-return-524-apmail-systemml-dev-archive=systemml.apache.org@systemml.incubator.apache.org Thu May 19 00:30:58 2016 Return-Path: X-Original-To: apmail-systemml-dev-archive@minotaur.apache.org Delivered-To: apmail-systemml-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7119F19D4A for ; Thu, 19 May 2016 00:30:58 +0000 (UTC) Received: (qmail 96377 invoked by uid 500); 19 May 2016 00:30:58 -0000 Delivered-To: apmail-systemml-dev-archive@systemml.apache.org Received: (qmail 96333 invoked by uid 500); 19 May 2016 00:30:58 -0000 Mailing-List: contact dev-help@systemml.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@systemml.incubator.apache.org Delivered-To: mailing list dev@systemml.incubator.apache.org Received: (qmail 96321 invoked by uid 99); 19 May 2016 00:30:58 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 May 2016 00:30:58 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 963061A076D for ; Thu, 19 May 2016 00:30:57 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id D67wox6OqFAD for ; Thu, 19 May 2016 00:30:55 +0000 (UTC) Received: from mail-oi0-f41.google.com (mail-oi0-f41.google.com [209.85.218.41]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id E131A5F1E7 for ; Thu, 19 May 2016 00:30:54 +0000 (UTC) Received: by mail-oi0-f41.google.com with SMTP id v145so103993995oie.0 for ; Wed, 18 May 2016 17:30:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to; bh=1jskPAQA3XCCKELWYiDaaov33kV5tj6nnSPhbMpPVec=; b=TXVlHslGcVYJuhFEGPcUOTVMgeKXFswHkvVcRNE/LrUalntuKntNqspNBlg0pkuwFm JzeOQWPrz+tUBbK3NNYkDC/FMv0tEoAeLUUuO0rL8XZBuG/BDGHvk9mbvYj5MavfeZBt Q3CHdFp12ahQqqma2i8nQ+nFF5qj85YyYPzd2DA8+NoZHTRNX24RI+J0LGXIIy4ITy+U 09sX7FPI99pBWBnrm2ay9ycEIbRZqlTgKarVgY6y1FfgK+P5SdnB4X8WltDFefMCxlmX hxCaGBoooCA7WEXudFHIGW5hmEfLbgQE6JqyEak1A0BiGgamjePxvQ+h6+xlEZMt2B6T rLKQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to; bh=1jskPAQA3XCCKELWYiDaaov33kV5tj6nnSPhbMpPVec=; b=XKhRU10cfY9wlvZsd2jERRLqdhFhPfvQLPqZxzGXBsqVrdz7zILW8bTYce3cRQks6C oG/fMK/2zK8QJdEmSKnp4+oWbnLpt1TLujO4lP+oz8GKTBDuLtR6gw4Rct3Bdvemnt3J dLJSv3uJmQXhpfjUHHsAH8ZWNg235e87Ys2RU0DqvgTBO/VoheQ11avIkzkUl56Cz462 nP5AnioXe56uRc18xM0lgKvnyXfAS3Ob63h5zF9EG3mK345yskhsX/i8aZEYPNm2JiZQ +C2EBWje8DAIkydueW7WgsBnV0kVsJRcVgj2QjyNhpvTsCIDRPGshecqfMSYVJSdz4df WeUg== X-Gm-Message-State: AOPr4FXkLufTTqccjXR2E5SKWqyFqo0wmZ53vZgx1HIoRJ0oBpbbPUAfdhB/f76beFwVxLRKLXKiLMXz2ncJ7g== MIME-Version: 1.0 X-Received: by 10.157.26.24 with SMTP id a24mr5737775ote.54.1463617847959; Wed, 18 May 2016 17:30:47 -0700 (PDT) Received: by 10.202.1.72 with HTTP; Wed, 18 May 2016 17:30:47 -0700 (PDT) In-Reply-To: <201605182030.u4IKUoZT027065@d01av02.pok.ibm.com> References: <201605182021.u4IKLiuI027001@d01av01.pok.ibm.com> <201605182030.u4IKUoZT027065@d01av02.pok.ibm.com> Date: Wed, 18 May 2016 17:30:47 -0700 Message-ID: Subject: Re: package dml files in folders in jars for 0.10.0? From: Deron Eriksson To: dev@systemml.incubator.apache.org Content-Type: multipart/alternative; boundary=001a11463fd2ea256a053327157e --001a11463fd2ea256a053327157e Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi, I created https://github.com/apache/incubator-systemml/pull/167 to address these issues. Deron On Wed, May 18, 2016 at 1:30 PM, Matthias Boehm wrote: > +1 for the cleanup of packaged scripts. You might want to also remove > obsolete algorithms. > > Regards, > Matthias > > [image: Inactive hide details for Niketan Pansare---05/18/2016 01:21:57 > PM---Hi Deron, I am fine with the latter tree structure.]Niketan > Pansare---05/18/2016 01:21:57 PM---Hi Deron, I am fine with the latter tr= ee > structure. > > From: Niketan Pansare/Almaden/IBM@IBMUS > To: dev@systemml.incubator.apache.org > Date: 05/18/2016 01:21 PM > Subject: Re: package dml files in folders in jars for 0.10.0? > ------------------------------ > > > > Hi Deron, > > I am fine with the latter tree structure. > systemml-0.10.0-incubating-SNAPSHOT > =E2=94=9C=E2=94=80=E2=94=80 META-INF > =E2=94=9C=E2=94=80=E2=94=80 com > =E2=94=9C=E2=94=80=E2=94=80 org > =E2=94=94=E2=94=80=E2=94=80 scripts > > May be, we can include the datagen and utils folder too. Please remember > we need to update "org.apache.sysml.api.ml.ScriptsUtils" once we change > the folder structure. > > Thanks, > > Niketan Pansare > IBM Almaden Research Center > E-mail: npansar At us.ibm.com > *http://researcher.watson.ibm.com/researcher/view.php?person=3Dus-npansar= * > > > Deron Eriksson ---05/18/2016 01:15:36 PM---Hi, Currently the DML algorith= m > scripts are written to the base directory of > > From: Deron Eriksson > To: dev@systemml.incubator.apache.org > Date: 05/18/2016 01:15 PM > Subject: package dml files in folders in jars for 0.10.0? > ------------------------------ > > > > Hi, > > Currently the DML algorithm scripts are written to the base directory of > the following artifacts: > systemml-0.10.0-incubating-SNAPSHOT.jar > systemml-0.10.0-incubating-SNAPSHOT-inmemory.jar > systemml-0.10.0-incubating-SNAPSHOT-sources.jar > systemml-0.10.0-incubating-SNAPSHOT-standalone.jar > > This makes the base directory of these jars look similar to this: > > $ tree -L 1 systemml-0.10.0-incubating-SNAPSHOT > systemml-0.10.0-incubating-SNAPSHOT > =E2=94=9C=E2=94=80=E2=94=80 ALS-CG.dml > =E2=94=9C=E2=94=80=E2=94=80 ALS-DS.dml > =E2=94=9C=E2=94=80=E2=94=80 ALS_predict.dml > =E2=94=9C=E2=94=80=E2=94=80 ALS_topk_predict.dml > =E2=94=9C=E2=94=80=E2=94=80 Cox-predict.dml > =E2=94=9C=E2=94=80=E2=94=80 Cox.dml > =E2=94=9C=E2=94=80=E2=94=80 CsplineCG.dml > =E2=94=9C=E2=94=80=E2=94=80 CsplineDS.dml > =E2=94=9C=E2=94=80=E2=94=80 GLM-predict.dml > =E2=94=9C=E2=94=80=E2=94=80 GLM.dml > =E2=94=9C=E2=94=80=E2=94=80 KM.dml > =E2=94=9C=E2=94=80=E2=94=80 Kmeans-predict.dml > =E2=94=9C=E2=94=80=E2=94=80 Kmeans.dml > =E2=94=9C=E2=94=80=E2=94=80 LinearRegCG.dml > =E2=94=9C=E2=94=80=E2=94=80 LinearRegDS.dml > =E2=94=9C=E2=94=80=E2=94=80 META-INF > =E2=94=9C=E2=94=80=E2=94=80 MultiLogReg.dml > =E2=94=9C=E2=94=80=E2=94=80 PCA.dml > =E2=94=9C=E2=94=80=E2=94=80 StepGLM.dml > =E2=94=9C=E2=94=80=E2=94=80 StepLinearRegDS.dml > =E2=94=9C=E2=94=80=E2=94=80 Univar-Stats.dml > =E2=94=9C=E2=94=80=E2=94=80 apply-transform.dml > =E2=94=9C=E2=94=80=E2=94=80 bivar-stats.dml > =E2=94=9C=E2=94=80=E2=94=80 com > =E2=94=9C=E2=94=80=E2=94=80 decision-tree-predict.dml > =E2=94=9C=E2=94=80=E2=94=80 decision-tree.dml > =E2=94=9C=E2=94=80=E2=94=80 l2-svm-predict.dml > =E2=94=9C=E2=94=80=E2=94=80 l2-svm.dml > =E2=94=9C=E2=94=80=E2=94=80 m-svm-predict.dml > =E2=94=9C=E2=94=80=E2=94=80 m-svm.dml > =E2=94=9C=E2=94=80=E2=94=80 naive-bayes-predict.dml > =E2=94=9C=E2=94=80=E2=94=80 naive-bayes.dml > =E2=94=9C=E2=94=80=E2=94=80 obsolete > =E2=94=9C=E2=94=80=E2=94=80 org > =E2=94=9C=E2=94=80=E2=94=80 random-forest-predict.dml > =E2=94=9C=E2=94=80=E2=94=80 random-forest.dml > =E2=94=9C=E2=94=80=E2=94=80 stratstats.dml > =E2=94=94=E2=94=80=E2=94=80 transform.dml > > Should these instead be written to scripts/algorithms as in the case of > some of the other artifacts so that the base directories of these jars lo= ok > like the following? > > $ tree -L 1 systemml-0.10.0-incubating-SNAPSHOT > systemml-0.10.0-incubating-SNAPSHOT > =E2=94=9C=E2=94=80=E2=94=80 META-INF > =E2=94=9C=E2=94=80=E2=94=80 com > =E2=94=9C=E2=94=80=E2=94=80 org > =E2=94=94=E2=94=80=E2=94=80 scripts > > I created *https://issues.apache.org/jira/browse/SYSTEMML-688* > for this > issue. Perhaps this would be a good update for the 0.10.0 release? Any > thoughts? > > Deron > > > > > --001a11463fd2ea256a053327157e--