sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ahmed Kamal (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SQOOP-3147) Import data from MySQL To Hive Table in S3 in Parquet format
Date Wed, 08 Mar 2017 10:26:38 GMT

     [ https://issues.apache.org/jira/browse/SQOOP-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ahmed Kamal updated SQOOP-3147:
-------------------------------
    Summary: Import data from MySQL To Hive Table in S3 in Parquet format  (was: Import data
from MySQL To Hive External Table in S3 in Parquet format)

> Import data from MySQL To Hive Table in S3 in Parquet format
> ------------------------------------------------------------
>
>                 Key: SQOOP-3147
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3147
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 1.4.6
>            Reporter: Ahmed Kamal
>
> Using this command succeeds only if the Hive Table's location is HDFS. If the table is
backed by S3 it throws a strange exception
> sqoop import  --connect "jdbc:mysql://connectionUrl"   --table "tableName" --as-parquetfile
--verbose  --username=uname --password=pass --hive-import  --delete-target-dir --hive-database
dev_kamal --hive-table  customer_car_type --hive-overwrite -m 150
> *Exception :*
> 17/03/07 12:13:13 INFO hive.metastore: Trying to connect to metastore with URI thrift://ip-10-0-0-47.eu-west-1.compute.internal:9083
> 17/03/07 12:13:13 INFO hive.metastore: Opened a connection to metastore, current connections:
1
> 17/03/07 12:13:13 INFO hive.metastore: Connected to metastore.
> 17/03/07 12:13:17 DEBUG util.ClassLoaderStack: Restoring classloader: sun.misc.Launcher$AppClassLoader@3e9b1010
> 17/03/07 12:13:17 ERROR sqoop.Sqoop: Got exception running Sqoop: org.apache.avro.SchemaParseException:
org.codehaus.jackson.JsonParseException: Unexpected end-of-input: was expecting closing quote
for a string value
>  at [Source: java.io.StringReader@3fb42ec7; line: 1, column: 6001]
> org.apache.avro.SchemaParseException: org.codehaus.jackson.JsonParseException: Unexpected
end-of-input: was expecting closing quote for a string value
>  at [Source: java.io.StringReader@3fb42ec7; line: 1, column: 6001]
> 	at org.apache.avro.Schema$Parser.parse(Schema.java:929)
> 	at org.apache.avro.Schema$Parser.parse(Schema.java:917)
> 	at org.kitesdk.data.DatasetDescriptor$Builder.schemaLiteral(DatasetDescriptor.java:475)
> 	at org.kitesdk.data.spi.hive.HiveUtils.descriptorForTable(HiveUtils.java:154)
> 	at org.kitesdk.data.spi.hive.HiveAbstractMetadataProvider.load(HiveAbstractMetadataProvider.java:104)
> 	at org.kitesdk.data.spi.filesystem.FileSystemDatasetRepository.load(FileSystemDatasetRepository.java:192)
> 	at org.kitesdk.data.Datasets.load(Datasets.java:108)
> 	at org.kitesdk.data.Datasets.load(Datasets.java:165)
> 	at org.kitesdk.data.Datasets.load(Datasets.java:187)
> 	at org.apache.sqoop.mapreduce.ParquetJob.configureImportJob(ParquetJob.java:78)
> 	at org.apache.sqoop.mapreduce.DataDrivenImportJob.configureMapper(DataDrivenImportJob.java:108)
> 	at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:260)
> 	at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:673)
> 	at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:118)
> 	at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
> 	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
> 	at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> 	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
> 	at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
> Caused by: org.codehaus.jackson.JsonParseException: Unexpected end-of-input: was expecting
closing quote for a string value
>  at [Source: java.io.StringReader@3fb42ec7; line: 1, column: 6001]
> 	at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1433)
> 	at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:521)
> 	at org.codehaus.jackson.impl.JsonParserMinimalBase._reportInvalidEOF(JsonParserMinimalBase.java:454)
> 	at org.codehaus.jackson.impl.ReaderBasedParser._finishString2(ReaderBasedParser.java:1342)
> 	at org.codehaus.jackson.impl.ReaderBasedParser._finishString(ReaderBasedParser.java:1330)
> 	at org.codehaus.jackson.impl.ReaderBasedParser.getText(ReaderBasedParser.java:200)
> 	at org.codehaus.jackson.map.deser.std.BaseNodeDeserializer.deserializeObject(JsonNodeDeserializer.java:203)
> 	at org.codehaus.jackson.map.deser.std.BaseNodeDeserializer.deserializeArray(JsonNodeDeserializer.java:224)
> 	at org.codehaus.jackson.map.deser.std.BaseNodeDeserializer.deserializeObject(JsonNodeDeserializer.java:200)
> 	at org.codehaus.jackson.map.deser.std.JsonNodeDeserializer.deserialize(JsonNodeDeserializer.java:58)
> 	at org.codehaus.jackson.map.deser.std.JsonNodeDeserializer.deserialize(JsonNodeDeserializer.java:15)
> 	at org.codehaus.jackson.map.ObjectMapper._readValue(ObjectMapper.java:2704)
> 	at org.codehaus.jackson.map.ObjectMapper.readTree(ObjectMapper.java:1344)
> 	at org.apache.avro.Schema$Parser.parse(Schema.java:927)
> 	... 21 more



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message