spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Rosen (JIRA)" <>
Subject [jira] [Commented] (SPARK-3075) Expose a way for users to parse event logs
Date Sat, 23 Jan 2016 23:36:39 GMT


Josh Rosen commented on SPARK-3075:

This seems out-of-scope / won't fix to me. I don't think we want to open up those internal
APIs; our JSON protocol is stable anyways and there are lots of nice tools for working with
this type of JSON data (including Spark SQL itself), so I'm going to resolve this as "Won't
Fix" for now.

> Expose a way for users to parse event logs
> ------------------------------------------
>                 Key: SPARK-3075
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 1.0.2
>            Reporter: Andrew Or
> Both ReplayListenerBus and util.JsonProtocol are private[spark], so the user wants to
parse the event logs themselves for analytics they will have to write their own JSON deserializers
(or do some crazy reflection to access these methods). We should expose an easy way for them
to do this.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message