systemml-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Berthold Reinwald" <reinw...@us.ibm.com>
Subject Re: 'hello world' tests of the main distributions
Date Sat, 21 May 2016 22:51:25 GMT
Thanks. Adding more jars will not help in resolving the confusion. The 
documentation argument is valid but more applicable for a final release. 
Wrt local builds, I'd rather refer to the right snapshot jar. I see more 
people moving around snapshot jar files, as opposed to a SystemML.jar. Not 
a big deal, just my 2 cents.

Regards,
Berthold Reinwald
IBM Almaden Research Center
office: (408) 927 2208; T/L: 457 2208
e-mail: reinwald@us.ibm.com



From:   dusenberrymw@gmail.com
To:     dev@systemml.incubator.apache.org
Date:   05/21/2016 12:31 PM
Subject:        Re: 'hello world' tests of the main distributions



The `SystemML.jar` is a duplicate of the more verbosely-named JAR, 
however, it was purposefully added to local builds as people were confused 
by which JAR to use when building locally (non-distribution). Since all of 
our distribution builds and documentation refer to a `SystemML.jar` file, 
it's good to have that for local builds as well. 

--

Mike Dusenberry
GitHub: github.com/dusenberrymw
LinkedIn: linkedin.com/in/mikedusenberry

Sent from my iPhone.


> On May 21, 2016, at 9:25 AM, Deron Eriksson <deroneriksson@gmail.com> 
wrote:
> 
> Hi Berthold,
> 
> I agree that those examples are simply a way to test the integrity of 
the
> various build artifacts at only the most basic level. I wanted to post 
that
> information in case it could help save anyone a few minutes when 
verifying
> our latest release candidates.
> 
> The SystemML.jar appears in target/ as part of the build process (it is
> identical to the other main jar), since it is included with that name in 
a
> couple of the build artifacts. However, it's not included with the 
release
> candidate files (
> 
https://dist.apache.org/repos/dist/dev/incubator/systemml/0.10.0-incubating-rc1/
),
> so it can probably stay. It would be fine to delete it at the end of the
> build process, if someone wants to tackle it.
> 
> Deron
> 
> 
> On Sat, May 21, 2016 at 1:04 AM, Berthold Reinwald <reinwald@us.ibm.com>
> wrote:
> 
>> resending due to 'text/html' issue.
>> 
>> 
>> Regards,
>> Berthold Reinwald
>> IBM Almaden Research Center
>> office: (408) 927 2208; T/L: 457 2208
>> e-mail: reinwald@us.ibm.com
>> ----- Forwarded by Berthold Reinwald/Almaden/IBM on 05/21/2016 12:59 AM
>> -----
>> 
>> From:   Berthold Reinwald/Almaden/IBM
>> To:     dev@systemml.incubator.apache.org
>> Date:   05/21/2016 12:39 AM
>> Subject:        Re: 'hello world' tests of the main distributions
>> 
>> 
>> 
>> Thanks, Deron.
>> 
>> we should include this in the build process.
>> this is useful to test the integrity of the jar files, but nothing 
beyond
>> that.
>> aren't systemml-0.10.0-incubating-SNAPSHOT.jar and SystemML.jar 
identical,
>> and we should drop one of these artifacts.
>> 
>> Regards,
>> Berthold Reinwald
>> IBM Almaden Research Center
>> office: (408) 927 2208; T/L: 457 2208
>> e-mail: reinwald@us.ibm.com
>> 
>> 
>> -----Deron Eriksson <deroneriksson@gmail.com> wrote: -----
>> To: dev@systemml.incubator.apache.org
>> From: Deron Eriksson <deroneriksson@gmail.com>
>> Date: 05/20/2016 03:33PM
>> Subject: 'hello world' tests of the main distributions
>> 
>> Hi,
>> 
>> We have a test suite of 5000+ tests but I don't think we have a 
standard
>> way of testing the distribution artifacts once they are built. I just 
did
>> some 'hello world' tests of the various distribution artifacts to be 
sure
>> that I could run a 'hello world' DML script using the various
>> distributions. In case it's helpful to others, here are the various 
things
>> I did (on OS X).
>> 
>> # build distribution artifacts
>> mvn clean package -P distribution
>> 
>> cd target
>> 
>> # verify jar works
>> java -cp ./lib/*:systemml-0.10.0-incubating-SNAPSHOT.jar
>> org.apache.sysml.api.DMLScript -s "print('hello world');"
>> 
>> # verify SystemML.jar works
>> java -cp ./lib/*:SystemML.jar org.apache.sysml.api.DMLScript -s
>> "print('hello world');"
>> 
>> # verify standalone jar works
>> java -jar systemml-0.10.0-incubating-SNAPSHOT-standalone.jar -s
>> "print('hello world');"
>> 
>> # verify src works
>> tar -xvzf systemml-0.10.0-incubating-SNAPSHOT-src.tar.gz
>> cd systemml-0.10.0-incubating-SNAPSHOT-src
>> mvn clean package -P distribution
>> cd target/
>> java -cp ./lib/*:systemml-0.10.0-incubating-SNAPSHOT.jar
>> org.apache.sysml.api.DMLScript -s "print('hello world');"
>> java -cp ./lib/*:SystemML.jar org.apache.sysml.api.DMLScript -s
>> "print('hello world');"
>> java -jar systemml-0.10.0-incubating-SNAPSHOT-standalone.jar -s
>> "print('hello world');"
>> cd ..
>> cd ..
>> 
>> # verify in-memory jar works
>> echo "import org.apache.sysml.api.jmlc.*;public class JMLCEx {public
>> static
>> void main(String[] args) throws Exception {Connection conn = new
>> Connection();PreparedScript script = conn.prepareScript(\"print('hello
>> world');\", new String[]{}, new String[]{},
>> false);script.executeScript();}}" > JMLCEx.java
>> javac -cp systemml-0.10.0-incubating-SNAPSHOT-inmemory.jar JMLCEx.java
>> java -cp .:systemml-0.10.0-incubating-SNAPSHOT-inmemory.jar JMLCEx
>> 
>> # verify standalone tar.gz works
>> tar -xvzf systemml-0.10.0-incubating-SNAPSHOT-standalone.tar.gz
>> cd systemml-0.10.0-incubating-SNAPSHOT-standalone
>> echo "print('hello world');" > hello.dml
>> ./runStandaloneSystemML.sh hello.dml
>> cd ..
>> 
>> # verify distrib tar.gz works
>> tar -xvzf systemml-0.10.0-incubating-SNAPSHOT.tar.gz
>> cd systemml-0.10.0-incubating-SNAPSHOT
>> java -cp ../lib/*:SystemML.jar org.apache.sysml.api.DMLScript -s
>> "print('hello world');"
>> 
>> export SPARK_HOME=/Users/deroneriksson/spark-1.5.1-bin-hadoop2.6
>> $SPARK_HOME/bin/spark-submit SystemML.jar -s "print('hello world');" 
-exec
>> hybrid_spark
>> 
>> hadoop jar SystemML.jar -s "print('hello world');"
>> cd ..
>> 
>> Deron
>> 
>> 
>> 





Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message