sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jagrut Sharma <jagrutsha...@gmail.com>
Subject Getting upper bound in --incremental mode
Date Wed, 19 Jul 2017 19:02:58 GMT
Hi all - For --incremental mode with 'lastmodified' option, Sqoop (v 1.4.2)
generates a query like:
WHERE column >= last_modified_time and column < current_time

The --last-value is set to the current_time and gets used for the next run.

Here, the upper bound is always set to the current_time. In some cases,
this upper bound is required to be taken from the database table column
itself. So, the query is required of the form:
WHERE column >= last_modified_time and column < max_time_in_db_table_column

And the --last-value for next run needs to be set as
the max_time_in_db_table_column (and not the current_time).

Is this possible to set while running sqoop?  If no, is there any
workaround suggested for this?

Thanks a lot.
-- 
Jagrut

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message