sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jagrut Sharma <jagrutsha...@gmail.com>
Subject Modifying upper bound in --incremental mode
Date Wed, 24 Aug 2016 16:00:50 GMT
I am using --incremental mode via 'lastmodified' logic. The default sqoop
behavior is to generate a query where:
*column >= last_modified_time and column < current_time*

The upper_bound is always set to current_time. In some cases, for late
arriving transactions, it is needed to have the upper_bound be current_time
- some_duration (e.g. 5 minutes).

Is this possible to set while running sqoop?
If no, is there any workaround suggested for this?



  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message