sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 连海俊 (JIRA) <j...@apache.org>
Subject [jira] [Comment Edited] (SQOOP-3006) sqoop import
Date Tue, 06 Sep 2016 03:23:21 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-3006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15466244#comment-15466244
] 

连海俊 edited comment on SQOOP-3006 at 9/6/16 3:22 AM:
----------------------------------------------------

sometimes the log like this bellow:
  16/09/06 10:46:37 INFO tool.ImportTool:Destination directory t_test_table deleted.
  16/09/06 10:46:37 WARN manager.MySQLManager. It looks like you are importing form mysql.
  16/09/06 10:46:37 WARN manager.MySQLManager. this transfer can be faster! Use the --direct

  16/09/06 10:46:37 WARN manager.MySQLManager. option to exercise a MySQL-specific fast path.
  16/09/06 10:46:37 INFO mapreduce.importJobBase:Beginning import of t_test_table
  16/09/06 10:46:37 INFO impl.TimelineClientImpl:Timeline service address:
http://haoop01:8188/ws/v1/timeline/
  16/09/06 10:46:38 ERROR tool.ImportTool:Encountered IOException running import job:
   org.apache.hadoop.mapred.FileAlreadyExisitsException:Output directory 
  hdfs://hdfs/user/test/t_test_table exists 
   at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:146)
   at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:604)
   at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:474)
   at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1296)
   at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1293)

this is the  error log ,hadoop version is 2.6.0 
Does anyone encountered similar problems ? how can I solve this problem ?


was (Author: lianhaijun12310):
sometimes the log like this bellow:
  16/09/06 10:46:37 INFO tool.ImportTool:Destination directory t_test_table deleted.
  16/09/06 10:46:37 WARN manager.MySQLManager. It looks like you are importing form mysql.
  16/09/06 10:46:37 WARN manager.MySQLManager. this transfer can be faster! Use the --direct

  16/09/06 10:46:37 WARN manager.MySQLManager. option to exercise a MySQL-specific fast path.
  16/09/06 10:46:37 INFO mapreduce.importJobBase:Beginning import of t_test_table
  16/09/06 10:46:37 INFO impl.TimelineClientImpl:Timeline 

> sqoop import 
> -------------
>
>                 Key: SQOOP-3006
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3006
>             Project: Sqoop
>          Issue Type: Bug
>          Components: hive-integration
>    Affects Versions: 1.4.5
>            Reporter: Jason
>
> When I use sqoop-1.4.5 to import data, will be a small probability of File exist Hadoop,
I would have to ask how to solve?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message