sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkat, Ankam" <Ankam.Ven...@centurylink.com>
Subject RE: Importing Table and Column comments
Date Tue, 30 Sep 2014 15:36:32 GMT
Thanks Pratik.

Looks like “Remarks” can be used in Oracle JDBC as well.

But, how do we use this in SQOOP?

Regards,
Venkat

From: pratik khadloya [mailto:tispratik@gmail.com]
Sent: Monday, September 29, 2014 9:48 AM
To: user@sqoop.apache.org
Subject: Re: Importing Table and Column comments

I realized that i was wrong about JDBC not providing the column comments information.
For mysql, It does provide that information through the mysql connector. You might have to
check one for your database.
Also check https://issues.apache.org/jira/browse/SQOOP-1456

Regards,
Pratik

On Fri, Sep 12, 2014 at 10:18 AM, pratik khadloya <tispratik@gmail.com<mailto:tispratik@gmail.com>>
wrote:
Sorry, JDBC does not support USER_COL_COMMENTS either (i think this is specific to oracle).
I don't think there is any tool currently available which can export mysql tables to hive
other than sqoop.

You might have to write your own custom code for backfilling the comments after sqoop is done
with its import.
Your custom tool can use something like http://stackoverflow.com/a/6752206/238880


~Pratik

On Fri, Sep 12, 2014 at 7:34 AM, Venkat, Ankam <Ankam.Venkat@centurylink.com<mailto:Ankam.Venkat@centurylink.com>>
wrote:
Thanks Pratik.

How about fetching comments from USER_COL_COMMENTS ?

If not Sqoop, is there any other way to fetch this data?

Regards,
Venkat

From: pratik khadloya [mailto:tispratik@gmail.com<mailto:tispratik@gmail.com>]
Sent: Thursday, September 11, 2014 6:09 PM
To: user@sqoop.apache.org<mailto:user@sqoop.apache.org>
Subject: Re: Importing Table and Column comments

The problem is that JDBC does not have support for column comments.
It is not a part of their API.
Ref: http://docs.oracle.com/javase/7/docs/api/java/sql/ResultSetMetaData.html

~Pratik

On Thu, Sep 11, 2014 at 3:13 PM, Venkat, Ankam <Ankam.Venkat@centurylink.com<mailto:Ankam.Venkat@centurylink.com>>
wrote:
Need this data for our enterprise metadata repository.

Any workaround for this?

Regards,
Venkat

From: pratik khadloya [mailto:tispratik@gmail.com<mailto:tispratik@gmail.com>]
Sent: Thursday, September 11, 2014 3:13 PM
To: user@sqoop.apache.org<mailto:user@sqoop.apache.org>
Subject: Re: Importing Table and Column comments

I don't think that happens today. I was wondering about the same thing.

On Thu, Sep 11, 2014 at 10:43 AM, Venkat, Ankam <Ankam.Venkat@centurylink.com<mailto:Ankam.Venkat@centurylink.com>>
wrote:
Is there a way to import table and column comments and store info on Hive?

Regards,
Venkat Ankam




Mime
View raw message