I am not sure I know how to. Above should have worked. Apart from the trick every one knows that you can redirect stdout to stderr, knowing why do you need it would be great !

On Sat, Nov 30, 2013 at 2:53 PM, Wenlei Xie <wenlei.xie@gmail.com> wrote:
Hi Prashant,

I copied the log4j.properites.template to be log4j.preperties, but now all the information is in stdout rather than stderr.

How should I make it to output to the stderr? I have tried to change log4j.properties to be

log4j.rootCategory=INFO, stderr
log4j.appender.stderr.layout.ConversionPattern=%d{yy/MM/dd HH:mm:ss} %p %c{1}: %m%n

But it still prints to the stdout...

On Thu, Nov 28, 2013 at 10:39 AM, Prashant Sharma <scrapcodes@gmail.com> wrote:
I think all that is needed is an log4j.properties on the classpath http://logging.apache.org/log4j/1.2/faq.html#noconfig 

On Thu, Nov 28, 2013 at 11:52 PM, Patrick Wendell <pwendell@gmail.com> wrote:
Hey Wenlei,

There is some issue in master that is repressing the log output - I'm
trying to debug it before we release 0.8.1. Can you explain exactly
how you are running Spark? Are you running the shell or are you
running a standalone application?

- Patrick

On Thu, Nov 28, 2013 at 12:54 AM, Wenlei Xie <wenlei.xie@gmail.com> wrote:
> Hi,
> I remember Spark used to print detailed error log into the stderr (e.g.
> constructing RDD, evaluate it, how much memory each partition consumes). But
> I cannot find it anymore but only with the following information:
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/u/ytian/wenlei/dynamicGraph/graphx/examples/target/scala-2.9.3/spark-examples-assembly-0.9.0-incubating-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/u/ytian/wenlei/dynamicGraph/graphx/assembly/target/scala-2.9.3/spark-assembly-0.9.0-incubating-SNAPSHOT-hadoop1.0.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> log4j:WARN No appenders could be found for logger
> (akka.event.slf4j.Slf4jEventHandler).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
> What should I do for it?
> Thanks,
> Wenlei


Wenlei Xie (谢文磊)

Department of Computer Science
5132 Upson Hall, Cornell University
Ithaca, NY 14853, USA
Phone: (607) 255-5577