phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Mahonin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-2196) phoenix-spark should automatically convert DataFrame field names to all caps
Date Thu, 03 Sep 2015 14:18:48 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729121#comment-14729121
] 

Josh Mahonin commented on PHOENIX-2196:
---------------------------------------

So essentially what happens is the field names go through the same normalization process the
query parser uses. Without surrounding quotes, the column name will get capitalized, but with
surrounding quotes, the column will be passed through as-is.

For your specific use case, I think if your CSV headers are surrounded by double quotes, they
should get passed through with the case kept in-tact.

> phoenix-spark should automatically convert DataFrame field names to all caps
> ----------------------------------------------------------------------------
>
>                 Key: PHOENIX-2196
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-2196
>             Project: Phoenix
>          Issue Type: Improvement
>            Reporter: Randy Gelhausen
>            Assignee: Josh Mahonin
>            Priority: Minor
>         Attachments: PHOENIX-2196.patch
>
>
> phoenix-spark will fail to save a DF into a Phoenix table if the DataFrame's fields are
not all capitalized. Since Phoenix internally capitalizes all column names, the DataFrame.save
method should automatically capitalize DF field names as a convenience to the end user.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message