spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dennis Hunziker (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-19465) Support custom Boolean values in CSV
Date Sun, 05 Feb 2017 17:52:41 GMT

    [ https://issues.apache.org/jira/browse/SPARK-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853293#comment-15853293
] 

Dennis Hunziker commented on SPARK-19465:
-----------------------------------------

I'll be raising a pull request for this soon. Not quite sure what priority to set this to
as users can work around the issue. It's relatively low risk though and could significantly
improve interoperability with other systems in a pipeline that's using csv files.

> Support custom Boolean values in CSV
> ------------------------------------
>
>                 Key: SPARK-19465
>                 URL: https://issues.apache.org/jira/browse/SPARK-19465
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.1.0
>            Reporter: Dennis Hunziker
>            Priority: Minor
>
> Support for custom Boolean values when reading from and writing to a csv data source.
This has been raised before against spark-csv which is now in maintenance mode: https://github.com/databricks/spark-csv/issues/104
> Example: encode Boolean values true/false as "yes"/"no" based on user supplied options
> "true"/"false" (case insensitive) will be the default encoding as per the current implementation.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message