sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jagrut Sharma <jagrutsha...@gmail.com>
Subject Modifying upper bound in --incremental mode
Date Mon, 29 Aug 2016 16:32:25 GMT
Hi Sqoop experts - I am using --incremental mode via 'lastmodified'
logic. The default sqoop behavior is to generate a query where:
*column >= last_modified_time and column < current_time*

The upper_bound is always set to current_time. In some cases, for late
arriving transactions, it is needed to have the upper_bound be current_time
- some_duration (e.g. 5 minutes).

Is this possible to set while running sqoop?
If no, is there any workaround suggested for this?

Thanks.

-- 
Jagrut

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message