sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sandipan.Ghosh <Sandipan.Gh...@target.com>
Subject fastest way-sqoop import from teradata
Date Wed, 07 May 2014 08:55:26 GMT
Hi All,

What is the fastest way of import a single Teradata table from Teradata to HDFS using sqoop?

I have a 200 gb table which is taking around 540 hours to transfer. I am in cloudera CDH.

I am using

sqoop import \
-D sqoop.teradata.import.use.temporary.table=false \
--connect jdbc:teradata://10.67.192.180/DATABASE=INOVBIDT,LOGMECH=LDAP \
--username z070061 --password ******* \
--compress \
--fields-terminated-by '|' \
--table inovbidt.Item_Loc_Day_Oh_Inv_41 \
--split-by GREG_D \
--target-dir /innovation/distribution_transportation/temp/Item_Loc_Day_Oh_Inv_str_41_2012
\
--mapreduce-job-name Item_Loc_Day_Oh_Inv_str_41_2012

Thanks
Sandipan

Mime
View raw message