sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arvind Prabhakar <arv...@apache.org>
Subject Re: problems importing from oracle\
Date Thu, 08 Mar 2012 00:28:19 GMT
Hi Bruce,

On Mon, Mar 5, 2012 at 6:50 PM, Bruce Bian <weidong.ban@gmail.com> wrote:
> any feedback on this?Shall I create a jira issue on this?
>
>
> On Thu, Mar 1, 2012 at 11:12 PM, Bruce Bian <weidong.ban@gmail.com> wrote:
>>
>> Hi Jarcec,
>> After looking at the code of sqoop, my previous split-by problem is caused
>> by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop command, and
>> the following code in org.apache.sqoop.manager.DefaultManagerFactory
>> initialized a GenericJdbcManager instead of OracleManager even after
>> --connection-manager OracleManager is specified
>>
>>     SqoopOptions options = data.getSqoopOptions();
>>     String manualDriver = options.getDriverClassName();
>>     if (manualDriver != null) {
>>       // User has manually specified JDBC implementation with --driver.
>>       // Just use GenericJdbcManager.
>>       return new GenericJdbcManager(manualDriver, options);
>>     }
>> Any reason why the code above appears before initializing the connection
>> manager specified by the user?Shouldn't it be put even after the connection
>> scheme is judged?

This is by design of the current implementation. When you specify an
explicit driver, the builtin connection manager selection defaults to
the generic connection manager. This allows you to use Sqoop with
databases that have compliant JDBC drivers but are not directly
supported by Sqoop.

Is there any particular reason why you must specify the --driver
option? By default the built in Oracle connection manager will chose
the very driver you are trying to pass in.

Thanks,
Arvind


>>
>>
>> On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho <jarcec@apache.org>
>> wrote:
>>>
>>> Ignored :-)
>>>
>>> I do not believe that you're hitting exactly SQOOP-204. It seems that
>>> SQOOP-204 has failed during creating Input Splits for your job. But you seem
>>> to be dying after your job is being executed on hadoop cluster.
>>>
>>> I'm afraid that I do not know how to help you at the moment. Would you
>>> mind upgrading on current 1.4.1 version?
>>>
>>> Jarcec
>>>
>>> On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
>>> > Hi Jarek ,
>>> > Please ignore my first problem for getting no hdfs results as it turns
>>> > out
>>> > to be my silly mistake during copying of the query. sorry for the
>>> > annoyance.
>>> > The second problem of adding --split-by turns out to be SQOOP-204, but
>>> > it
>>> > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it?
>>> >
>>> > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <weidong.ban@gmail.com>
>>> > wrote:
>>> >
>>> > > also when I'm adding the --split-by a.prod_inst_id to the sqoop
>>> > > command as
>>> > > in:
>>> > > QUERY="SELECT a.*,
>>> > >
>>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > > c.cust_code,c.root_cust_code,
>>> > >
>>> > >
>>> > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > > FROM prc_idap_pi_root a
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > > etl.etl_para_cfg_detail
>>> > > WHERE para_id=84) AND \$CONDITIONS"
>>> > > sqoop import \
>>> > > --verbose \
>>> > > --driver oracle.jdbc.OracleDriver \
>>> > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
>>> > > --username *** \
>>> > > --password ****** \
>>> > > --query "$QUERY" \
>>> > > --split-by a.prod_inst_id \
>>> > > --target-dir /home/wbian/test
>>> > >
>>> > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
>>> > > properly
>>> > > ended"   Exception is threw.
>>> > > And I'm testing this sqoop command on a stand-alone hadoop node.
>>> > > The output when adding the split-by is as follows:
>>> > >
>>> > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
>>> > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on
>>> > > the
>>> > > command-line is insecure. Consider using -P instead.
>>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
>>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
>>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
>>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
>>> > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of
>>> > > 1000
>>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
>>> > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
>>> > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
>>> > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
>>> > > specified. Using regular API for making connection.
>>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
>>> > > query: 1000
>>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
>>> > > SELECT
>>> > > a.*,
>>> > >
>>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > > c.cust_code,c.root_cust_code,
>>> > >
>>> > >
>>> > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > > FROM prc_idap_pi_root a
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > > etl.etl_para_cfg_detail
>>> > > WHERE para_id=84) AND  (1 = 0)
>>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
>>> > > query: 1000
>>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
>>> > > SELECT
>>> > > a.*,
>>> > >
>>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > > c.cust_code,c.root_cust_code,
>>> > >
>>> > >
>>> > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > > FROM prc_idap_pi_root a
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > > etl.etl_para_cfg_detail
>>> > > WHERE para_id=84) AND  (1 = 0)
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
>>> > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
>>> > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
>>> > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
>>> > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12,
>>> > > CARRIER_PROD_INST_NUM:12,
>>> > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
>>> > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12,
>>> > > GH_INSTALL_TP:12,
>>> > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
>>> > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
>>> > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12,
>>> > > DATA_INTERNET_FLG:12,
>>> > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
>>> > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
>>> > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2,
>>> > > SUB_AGR_ID:2,
>>> > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93,
>>> > > AGR_END_DT:93,
>>> > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2,
>>> > > DEV_GRID_ID:2,
>>> > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
>>> > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
>>> > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
>>> > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
>>> > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
>>> > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
>>> > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
>>> > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
>>> > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
>>> > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
>>> > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
>>> > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
>>> > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
>>> > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
>>> > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93,
>>> > > CREATE_BY:12,
>>> > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12,
>>> > > PI_SUB_STAT_TP:12,
>>> > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
>>> > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
>>> > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
>>> > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
>>> > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
>>> > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
>>> > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12,
>>> > > A_ACCESS_MODE:12,
>>> > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12,
>>> > > A_ATTR_USE:12,
>>> > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
>>> > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
>>> > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
>>> > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
>>> > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
>>> > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
>>> > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
>>> > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
>>> > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
>>> > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is
>>> > > QueryResult.java
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
>>> > > /usr/lib/hadoop
>>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar
>>> > > at:
>>> > > /usr/lib/hadoop/hadoop-core.jar
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with
>>> > > args:
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>>> > >
>>> > > /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>>> > > Note:
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>>> > > uses or overrides a deprecated API.
>>> > > Note: Recompile with -Xlint:deprecation for details.
>>> > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
>>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class
>>> > > files
>>> > > in directory:
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
>>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
>>> > > -> QueryResult.class
>>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar
>>> > > file
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
>>> > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query
>>> > > import.
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing
>>> > > class: QueryResult
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
>>> > > through URL:
>>> > >
>>> > > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader
>>> > > is
>>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
>>> > > QueryResult
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into
>>> > > current
>>> > > JVM:
>>> > >
>>> > > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for
>>> > > jar
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
>>> > > java.net.FactoryURLClassLoader@1638fff7
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table
>>> > > class:
>>> > > QueryResult
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using
>>> > > InputFormat:
>>> > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > >
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
>>> > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
>>> > > processName=JobTracker, sessionId=
>>> > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load
>>> > > native-hadoop
>>> > > library for your platform... using builtin-java classes where
>>> > > applicable
>>> > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
>>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db
>>> > > record
>>> > > reader for db product: ORACLE
>>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query:
>>> > > SELECT
>>> > > a.*,
>>> > >
>>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > > c.cust_code,c.root_cust_code,
>>> > >
>>> > >
>>> > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > > FROM prc_idap_pi_root a
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > > etl.etl_para_cfg_detail
>>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
>>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next
>>> > > query:
>>> > > 1000
>>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT
>>> > > a.*,
>>> > >
>>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > > c.cust_code,c.root_cust_code,
>>> > >
>>> > >
>>> > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > > FROM prc_idap_pi_root a
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > > etl.etl_para_cfg_detail
>>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
>>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
>>> > > auto-progress thread to quit.
>>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for
>>> > > progress
>>> > > thread shutdown...
>>> > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress
>>> > > thread
>>> > > is finished. keepGoing=false
>>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
>>> > > shutdown detected.
>>> > > 12/03/01 15:24:32 INFO mapred.Task:
>>> > > Task:attempt_local_0001_m_000000_0 is
>>> > > done. And is in the process of commiting
>>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
>>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
>>> > > attempt_local_0001_m_000000_0 is
>>> > > allowed to commit now
>>> > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of
>>> > > task
>>> > > 'attempt_local_0001_m_000000_0' to /home/wbian/test
>>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
>>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
>>> > > 'attempt_local_0001_m_000000_0'
>>> > > done.
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
>>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes
>>> > > in
>>> > > 2.9865 seconds (0 bytes/sec)
>>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
>>> > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
>>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
>>> > >
>>> > > Thanks&Regards,
>>> > > Bruce
>>> > >
>>> > >
>>> > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho
>>> > > <jarcec@apache.org>wrote:
>>> > >
>>> > >> Hi Bruce,
>>> > >> would you mind sending entire sqoop command that you've used as well
>>> > >> as
>>> > >> entire output that it generates with "--verbose" flag?
>>> > >>
>>> > >> Jarcec
>>> > >>
>>> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
>>> > >> > Hi there,
>>> > >> > When I'm using sqoop free-form query import to import the data
>>> > >> > from
>>> > >> Oracle
>>> > >> > to HDFS with some ETL process in the query, the results in HDFS
>>> > >> > contains
>>> > >> > nothing.
>>> > >> > The query is as follows:
>>> > >> >
>>> > >> > SELECT a.*,
>>> > >> >
>>> > >> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > >> > c.cust_code,c.root_cust_code,
>>> > >> >
>>> > >>
>>> > >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > >> > FROM prc_idap_pi_root a
>>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > >> etl.etl_para_cfg_detail
>>> > >> > WHERE para_id=84) AND \$CONDITIONS
>>> > >> >
>>> > >> > The same query has been executed successfully in oracle(without
>>> > >> > the
>>> > >> > $CONDITIONS of course). Is it because the query contains sub-query
>>> > >> > in
>>> > >> it?
>>> > >> >
>>> > >> > Thanks&Regards,
>>> > >> > Bruce
>>> > >>
>>> > >
>>> > >
>>
>>
>

Mime
View raw message