sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "javalover123 (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-3000) Export hive to crate is much more slow than mysql
Date Thu, 18 Aug 2016 10:47:20 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15426251#comment-15426251
] 

javalover123 commented on SQOOP-3000:
-------------------------------------

sqoop export --connect jdbc:crate://10.1.136.125:4300 --driver io.crate.client.jdbc.CrateDriver
--table dm_list_play_d --export-dir /user/hive/warehouse/temp.db/dm_list_play_d_crate/dt=2016-07-30*/*
--fields-terminated-by '|' --null-non-string '' --null-string '' --input-null-non-string '\\N'
--input-null-string '\\N'

> Export hive to crate is much more slow than mysql
> -------------------------------------------------
>
>                 Key: SQOOP-3000
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3000
>             Project: Sqoop
>          Issue Type: Improvement
>    Affects Versions: 1.4.5
>         Environment: hadoop-2.7.1 on yarn
>            Reporter: javalover123
>
> Export 16 million row to mysql cost less than 10 minute´╝îexport to crate cost more than
70 minute.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message