spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ulysses you (Jira)" <j...@apache.org>
Subject [jira] [Created] (SPARK-32827) Add spark.sql.maxMetadataStringLength config
Date Wed, 09 Sep 2020 04:30:00 GMT
ulysses you created SPARK-32827:
-----------------------------------

             Summary: Add spark.sql.maxMetadataStringLength config
                 Key: SPARK-32827
                 URL: https://issues.apache.org/jira/browse/SPARK-32827
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.1.0
            Reporter: ulysses you


Add a new config `spark.sql.maxMetadataStringLength`. This config aims to limit metadata value
length, e.g. file location.

Found that metadata has been abbreviated by `...` when tried to add some test in `SQLQueryTestSuite`.
That caused we can't replace the location value by `className` since the `className` has been
abbreviated.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message