sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Roberts <wiz...@gmail.com>
Subject Re: sqoop vs. copy
Date Fri, 13 Sep 2013 05:18:04 GMT
I would use pg_copy if the data is not already in HDFS.  Some parallelism in the copy might
be possible, but chunking files in shell isn't particularly hard.  Though if you do some benchmarking
I would love to see the results!

-Mark

On Sep 12, 2013, at 15:03, Matthieu Labour <matthieu@actionx.com> wrote:

> Hi
> When exporting data from S3 to Postgres, I wonder when to use Sqoop over COPY?
> Thank you for your help
> -matt
> 

Mime
View raw message