metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nick Allen <n...@nickallen.org>
Subject Re: Maven Exec REPL with all Metron Dependencies
Date Thu, 31 Aug 2017 17:01:17 GMT
My use case is a little different than #690.  I just want to be able to
test things in the REPL during development.  I am just trying to find the
quickest way to go from code change to executing that code change in the
REPL.

On Thu, Aug 31, 2017 at 11:02 AM Otto Fowler <ottobackwards@gmail.com>
wrote:

> If this is over doing it based on your question, I apologize ahead of time.
>
> There are a few things here:
>
> * the way the stellar functions in metron are package with regards to
> dependencies and usage
> * the way the functions are categorized ( ie. should some functions even
> try to load based on running local )
> * the use cases of running local to cluster, local only, or from code
> * if running local to cluster, what is the best way to execute management
> functions against the cluster security and network wise?  [ see stellar /
> rest api discussions ]
>
> There are a number of things that can be done, but without having a handle
> on these things it is tough.
>
> That is why 690 is only the base functions.
>
>
> On August 31, 2017 at 10:48:36, Otto Fowler (ottobackwards@gmail.com)
> wrote:
>
>
> So there is https://github.com/apache/metron/pull/690, but that is not
> what you are asking.
> The issue is that even if you -pl metron-platform/metron-management  it
> does not bring in
> all the dependencies ( you are getting FSDataInputStream or some other
> error right?).  I can get both to load by
> doing two -pl statements, but there are these problems.
>
> While working on this PR, I had a version that *did* package management
> and it’s dependencies
> and deployment.  But I had questions about if it was correct or not given
> the class path and hadoop configuration issues etc.
> So I took it out.
>
>
>
>
>
>
> On August 31, 2017 at 10:23:53, Nick Allen (nick@nickallen.org) wrote:
>
> Previously, I found that you could run the REPL from the Metron source by
> running the following command from the
> ​source root ​
> directory. This is useful because it lets you run the REPL with the
> libraries that will be available
> ​during Enrichment.​
>
> mvn exec:java \
> -Dexec.mainClass="org.apache.metron.stellar.common.shell.StellarShell" \
> -pl metron-platform/metron-enrichment
>
>
> Unfortunately, this does not include the useful management functions that
> you really need to work in the REPL like SHELL_EDIT. I have tried a
> million different ways to run the REPL
> ​directly ​
> from
> ​ the​
> Metron sources
> ​and​
> include all Metron libraries, but have been unable to find a way.
>
> Anyone know
> ​a magical incantation​
> to do that?
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message