sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kate Ting <k...@cloudera.com>
Subject Re: [sqoop-user] Re: Sqoop incremental import issues
Date Thu, 03 Nov 2011 22:07:49 GMT
[For faster response, please subscribe to sqoop-user@incubator.apache.org]
This is a bug fixed by https://issues.apache.org/jira/browse/SQOOP-364.
Regards, Kate
On Thu, Nov 3, 2011 at 3:06 PM, Lazyiness <anson.abraham@gmail.com> wrote:
> I also forgot to mention, I can't do the --table option, b/c one field
> is a UUID which apparently isn't supported by SQOOP as of yet.  If so,
> it kept failing, until I did a full select converting the UUID column
> to varchar(36).
>
> On Nov 3, 6:03 pm, Lazyiness <anson.abra...@gmail.com> wrote:
>> I'm having issues of doing a sqoop incemental import to hdfs.  i get
>> failures from multiple ways:
>>
>> --connect 'jdbc:postgresql://www.example/dbname' --username blah --
>> query 'SELECT guidval::varchar(36), column2, datefield2,
>> lastmodifieddate from table foo WHERE $CONDITIONS' --target-dir /hdfs/
>> path --split-by datefield2 --check-column lastmodifieddata --last-
>> value '2011-11-03' --incremental lastmodified
>>
>> The error I get is Incremental requires an import.  So I'm assuming
>> I'm doing this incorrectly w/ the incremental import, where it won't
>> work w/ a query.
>>
>> So I tried this then:
>>
>> --connect 'jdbc:postgresql://www.example/dbname' --username blah --
>> query 'SELECT guidval::varchar(36), column2, datefield2,
>> lastmodifieddate from table foo WHERE $CONDITIONS or
>> (lastmodifieddate  > '2011-11-03')' --target-dir /hdfs/path --split-by
>> datefield2
>>
>> But I get an error of:
>> ERROR: cannot cast type integer to timestamp without time zone
>>
>> when i try to convert to timestamp, that doesn't work.
>>
>> trying this this:
>>
>> --connect 'jdbc:postgresql://www.example/dbname' --username blah --
>> query 'SELECT guidval::varchar(36), column2, datefield2,
>> lastmodifieddate from table foo' --where "lastmodifieddate  >
>> '2011-11-03' " --target-dir /hdfs/path --split-by datefield2
>>
>> But the error I get, requires that I put a $CONDITIONS clause, which
>> doesn't work either.
>>
>> I know this should not be difficult, but for some reason it's been a
>> thorn in my side.  Any help here would be greatly appreciated.
>> Thanks.
>
> --
> NOTE: The mailing list sqoop-user@cloudera.org is deprecated in favor of Apache Sqoop
mailing list sqoop-user@incubator.apache.org. Please subscribe to it by sending an email to
incubator-sqoop-user-subscribe@apache.org.
>

Mime
View raw message