parquet-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PARQUET-1534) [parquet-cli] Argument error: Illegal character in opaque part at index 2 on Windows
Date Mon, 11 Mar 2019 14:19:00 GMT

    [ https://issues.apache.org/jira/browse/PARQUET-1534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16789619#comment-16789619
] 

ASF GitHub Bot commented on PARQUET-1534:
-----------------------------------------

masayuki038 commented on pull request #627: PARQUET-1534:  [parquet-cli] Argument error: Illegal
character in opaque part at index 2 on Windows
URL: https://github.com/apache/parquet-mr/pull/627
 
 
   Some commands of parquet-cli don't work on Windows.
   
   ```
   $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main schema C:\Users\masayuki\Downloads\test.parquet
                                                              Argument error: Illegal character
in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet          
                                       
   $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main csv-schema C:\Users\masayuki\Downloads\test.csv
--record-name Test                                              
   Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.csv
             
   
   $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main convert-csv C:\Users\masayuki\Downlo
ads\test.csv -o C:\Users\masayuki\Downloads\test-csv.parquet
   Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.csv
   
   $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main convert C:\Users\masayuki\Downloads\
userdata1.avro -o C:\Users\masayuki\Downloads\userdata1.parquet
   Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\userdata1.avro
   
   $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main to-avro C:\Users\masayuki\Downloads\
test.parquet -o C:\Users\masayuki\Downloads\test.avro
   Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet
   
   $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main cat C:\Users\masayuki\Downloads\test.parquet
   Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet
   
   $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main head -n 10 C:\Users\masayuki\Downloa
ds\test.parquet
   Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet
   ```
   
   Calling BaseCommand#qualifiedURI with Windows file path,  java.net.URI.create throws IllegalArgumentException
and the command execution is aborted.
   
   This PR fixes the issue. With this PR, parquet-cli will work all commands on Windows.
   
   parquet-cli has no tests. I created PR to add simple tests for each command at https://github.com/apache/parquet-mr/pull/625.
Could you review that first?
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> [parquet-cli] Argument error: Illegal character in opaque part at index 2 on Windows
> ------------------------------------------------------------------------------------
>
>                 Key: PARQUET-1534
>                 URL: https://issues.apache.org/jira/browse/PARQUET-1534
>             Project: Parquet
>          Issue Type: Bug
>          Components: parquet-mr
>    Affects Versions: 1.11.0
>            Reporter: Masayuki Takahashi
>            Assignee: Masayuki Takahashi
>            Priority: Major
>              Labels: pull-request-available
>
> Some commands of parquet-cli don't work on Windows.
> {code}
> $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main schema C:\Users\masayuki\Downloads\test.parquet
                                                              Argument error: Illegal character
in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet          
>                                     
> $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main csv-schema
C:\Users\masayuki\Downloads\test.csv --record-name Test                                  
           
> Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.csv
             
> $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main convert-csv
C:\Users\masayuki\Downlo ads\test.csv -o C:\Users\masayuki\Downloads\test-csv.parquet
> Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.csv
> $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main convert C:\Users\masayuki\Downloads\
userdata1.avro -o C:\Users\masayuki\Downloads\userdata1.parquet
> Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\userdata1.avro
> $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main to-avro C:\Users\masayuki\Downloads\
test.parquet -o C:\Users\masayuki\Downloads\test.avro
> Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet
> $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main cat C:\Users\masayuki\Downloads\test.parquet
> Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet
> $ java -cp target/classes;target/dependency/* org.apache.parquet.cli.Main head -n 10
C:\Users\masayuki\Downloa ds\test.parquet
> Argument error: Illegal character in opaque part at index 2: C:\Users\masayuki\Downloads\test.parquet
> {code}
> The following commands work on Windows.
> * meta
> * pages
> * check-stats
> * column-index



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message