Excellent, I'll start experimenting with this in our deep learning work.
Question: what is the relationship between codegen and our rewrite rules?
--
Mike Dusenberry
GitHub: github.com/dusenberrymw
LinkedIn: linkedin.com/in/mikedusenberry
Sent from my iPhone.
> On Apr 20, 2017, at 8:32 AM, Berthold Reinwald <reinwald@us.ibm.com> wrote:
>
> This is awesome!
>
> Regards,
> Berthold Reinwald
> IBM Almaden Research Center
> office: (408) 927 2208; T/L: 457 2208
> e-mail: reinwald@us.ibm.com
>
>
>
> From: Matthias Boehm <mboehm7@googlemail.com>
> To: dev@systemml.incubator.apache.org
> Date: 04/20/2017 02:41 AM
> Subject: Experimental code generation
>
>
>
> Hi all,
>
> meanwhile our new code generation feature is sufficiently stable to enter
> a
> broader testing with the goal to further improve its capabilities. If
> you're interesting, you can enable this feature via
>
> <codegen.enabled>true</codegen.enabled>
>
> in your SystemML-config.xml file. The major advantages are fewer
> intermediates (read and write, incl. potentially fewer evictions), fewer
> scans of inputs and intermediates, and better sparsity exploitation across
> chains of operations.
>
> On our mainstream algorithms, we see significant improvements compared to
> existing fused operators for scenarios with few features, i.e., when the
> vector and matrix intermediates become the bottleneck, or scripts with
> missing sparsity-exploiting operations. For example, on a 100M x 10 (8GB)
> scenario of L2SVM w/ 20 outer iterations, codegen improves performance
> from
> 219s (496s without hand-coded fused operators) to 32s.
>
> So please bring your favorite expressions. If you have interesting
> scripts,
> please give it a try and share any issues or patterns that we're currently
> not handling very well. Thanks.
>
>
> Regards,
> Matthias
>
>
>
>
|