spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bo yang <>
Subject Support structured plan logging
Date Fri, 12 Oct 2018 05:00:04 GMT
Hi All,

Are there any people interested in adding structured plan logging in Spark?
Currently the logical/physical plan could be logged as plain text via
explain() method, which has some issues, for example, string truncation and
difficult for tool/program to use.

This PR <> fixes the truncation
issue. A further step is to log the plan as structured content (e.g. json).
Do other people feel similar need?


View raw message