spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "lior.c" <>
Subject Using Log4j2 in spark executors
Date Wed, 11 Mar 2015 15:40:03 GMT

I'd like to allow using log4j2 in executor code.
As spark contains dependencies to log4j 1.2, I would like to support spark
build with log4j2 instead of log4j 1.2. 
To accomplish that, I suggest creating a new profile for log4j2 in
The default profile (log4j12), would include dependencies for log4j and
slf4j-log4j12 with default scope (I would remove the dependencies from sub
modules of spark-parent).
The log4j2 profile would instead include same dependencies with scope
provided (to avoid the shading plugin add those jars as a result of
transitive dependencies from other jars that depend on log4j 12), and in
addition would include the dependencies required to log4j2.

Already tested it and it seems to work properly, and I would like to offer
it as a pull request.
What do you think of this solution?


View this message in context:
Sent from the Apache Spark Developers List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message