sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sumit Sarkar <Sumit.Sar...@progress.com>
Subject Re: Need info : Sqoop from MongoDB
Date Tue, 05 May 2015 13:33:16 GMT
There is a commercial MongoDB JDBC connector for Sqoop from DataDirect: https://www.progress.com/products/data-sources/mongodb

It will work with the Generic JDBC Connector to import data and supports timestamps.

On May 5, 2015, at 3:30 AM, Zhou, Richard <richard.zhou@intel.com<mailto:richard.zhou@intel.com>>

Hey Swati:

                Unfortunately, there is no MongoDB connector in Sqoop 1/2 now. We will discuss
the road map in the Sqoop developer meeting @22th May, and the Key-Value DB support is in
the topic list. I will keep you posted if there is any plan on it. Thanks.


From: Swati Ambulkar -X (sambulka - PERSISTENT SYSTEMS INC at Cisco) [mailto:sambulka@cisco.com]
Sent: Tuesday, May 05, 2015 12:04 AM
To: user@sqoop.apache.org<mailto:user@sqoop.apache.org>
Subject: RE: Need info : Sqoop from MongoDB


I assume , I will have to use objectId timestamp to get incremental data. Still waiting to
get access to new data source. So do not know if there is any timestamp field in JSON document
body yet.

Did not find much info on MongoDB & Sqoop connectivity. Does sqoop work with MongoDB Hadoop
Connector?  If sqoop works with mongoDB Hadoop connector how should the query look like to
pull incremental data?


From: Bradley Wright [mailto:bwright@progress.com]
Sent: Friday, May 01, 2015 11:41 AM
To: user@sqoop.apache.org<mailto:user@sqoop.apache.org>
Subject: Re: Need info : Sqoop from MongoDB

Do you mean the document objectId timestamp or a timestamp field in the JSON document body?

From: "Swati Ambulkar -X (sambulka - PERSISTENT SYSTEMS INC at Cisco)" <sambulka@cisco.com<mailto:sambulka@cisco.com>>
Reply-To: "user@sqoop.apache.org<mailto:user@sqoop.apache.org>" <user@sqoop.apache.org<mailto:user@sqoop.apache.org>>
Date: Friday, May 1, 2015 12:31 PM
To: "user@sqoop.apache.org<mailto:user@sqoop.apache.org>" <user@sqoop.apache.org<mailto:user@sqoop.apache.org>>
Subject: Need info : Sqoop from MongoDB


I am trying to find any information on using Sqoop to import data from MongoDB. I am looking
to do incremental import based on timestamp from MongoDB and want to import all document sets
into Hadoop. If anyone is doing this already, any pointers on how to do it, sample code, any
issues encountered will be helpful.

Thanks in advance,

View raw message