sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bruce Bian <weidong....@gmail.com>
Subject Re: problems importing from oracle\
Date Tue, 06 Mar 2012 02:50:57 GMT
any feedback on this?Shall I create a jira issue on this?

On Thu, Mar 1, 2012 at 11:12 PM, Bruce Bian <weidong.ban@gmail.com> wrote:

> Hi Jarcec,
> After looking at the code of sqoop, my previous split-by problem is caused
> by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop command, and
> the following code in org.apache.sqoop.manager.DefaultManagerFactory
> initialized a GenericJdbcManager instead of OracleManager even after
> --connection-manager OracleManager is specified
>
>     SqoopOptions options = data.getSqoopOptions();
>     String manualDriver = options.getDriverClassName();
>     if (manualDriver != null) {
>       // User has manually specified JDBC implementation with --driver.
>       // Just use GenericJdbcManager.
>       return new GenericJdbcManager(manualDriver, options);
>     }
> Any reason why the code above appears before initializing the connection
> manager specified by the user?Shouldn't it be put even after the connection
> scheme is judged?
>
>
> On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho <jarcec@apache.org>wrote:
>
>> Ignored :-)
>>
>> I do not believe that you're hitting exactly SQOOP-204. It seems that
>> SQOOP-204 has failed during creating Input Splits for your job. But you
>> seem to be dying after your job is being executed on hadoop cluster.
>>
>> I'm afraid that I do not know how to help you at the moment. Would you
>> mind upgrading on current 1.4.1 version?
>>
>> Jarcec
>>
>> On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
>> > Hi Jarek ,
>> > Please ignore my first problem for getting no hdfs results as it turns
>> out
>> > to be my silly mistake during copying of the query. sorry for the
>> annoyance.
>> > The second problem of adding --split-by turns out to be SQOOP-204, but
>> it
>> > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it?
>> >
>> > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <weidong.ban@gmail.com>
>> wrote:
>> >
>> > > also when I'm adding the --split-by a.prod_inst_id to the sqoop
>> command as
>> > > in:
>> > > QUERY="SELECT a.*,
>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > > c.cust_code,c.root_cust_code,
>> > >
>> > >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > > FROM prc_idap_pi_root a
>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > > WHERE para_id=84) AND \$CONDITIONS"
>> > > sqoop import \
>> > > --verbose \
>> > > --driver oracle.jdbc.OracleDriver \
>> > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
>> > > --username *** \
>> > > --password ****** \
>> > > --query "$QUERY" \
>> > > --split-by a.prod_inst_id \
>> > > --target-dir /home/wbian/test
>> > >
>> > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
>> properly
>> > > ended"   Exception is threw.
>> > > And I'm testing this sqoop command on a stand-alone hadoop node.
>> > > The output when adding the split-by is as follows:
>> > >
>> > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
>> > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on
>> the
>> > > command-line is insecure. Consider using -P instead.
>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
>> > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of
>> 1000
>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
>> > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
>> > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
>> > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
>> > > specified. Using regular API for making connection.
>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
>> > > query: 1000
>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
>> SELECT
>> > > a.*,
>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > > c.cust_code,c.root_cust_code,
>> > >
>> > >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > > FROM prc_idap_pi_root a
>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > > WHERE para_id=84) AND  (1 = 0)
>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
>> > > query: 1000
>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
>> SELECT
>> > > a.*,
>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > > c.cust_code,c.root_cust_code,
>> > >
>> > >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > > FROM prc_idap_pi_root a
>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > > WHERE para_id=84) AND  (1 = 0)
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
>> > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
>> > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
>> > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
>> > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, CARRIER_PROD_INST_NUM:12,
>> > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
>> > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12,
>> GH_INSTALL_TP:12,
>> > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
>> > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
>> > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12,
>> DATA_INTERNET_FLG:12,
>> > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
>> > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
>> > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2,
>> SUB_AGR_ID:2,
>> > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93,
>> AGR_END_DT:93,
>> > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2,
>> DEV_GRID_ID:2,
>> > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
>> > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
>> > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
>> > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
>> > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
>> > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
>> > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
>> > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
>> > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
>> > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
>> > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
>> > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
>> > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
>> > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
>> > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93,
>> CREATE_BY:12,
>> > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12,
>> PI_SUB_STAT_TP:12,
>> > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
>> > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
>> > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
>> > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
>> > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
>> > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
>> > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12,
>> A_ACCESS_MODE:12,
>> > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, A_ATTR_USE:12,
>> > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
>> > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
>> > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
>> > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
>> > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
>> > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
>> > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
>> > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
>> > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
>> > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is
>> QueryResult.java
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
>> > > /usr/lib/hadoop
>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar
>> at:
>> > > /usr/lib/hadoop/hadoop-core.jar
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with
>> args:
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>> > >
>> /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>> > > Note:
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>> > > uses or overrides a deprecated API.
>> > > Note: Recompile with -Xlint:deprecation for details.
>> > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class
>> files
>> > > in directory:
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
>> > > -> QueryResult.class
>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar
>> file
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
>> > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query
>> import.
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing
>> > > class: QueryResult
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
>> > > through URL:
>> > >
>> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader is
>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
>> > > QueryResult
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into current
>> > > JVM:
>> > >
>> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for
>> jar
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
>> > > java.net.FactoryURLClassLoader@1638fff7
>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table
>> class:
>> > > QueryResult
>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using
>> InputFormat:
>> > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > >
>> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
>> > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
>> > > processName=JobTracker, sessionId=
>> > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop
>> > > library for your platform... using builtin-java classes where
>> applicable
>> > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db record
>> > > reader for db product: ORACLE
>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query:
>> SELECT
>> > > a.*,
>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > > c.cust_code,c.root_cust_code,
>> > >
>> > >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > > FROM prc_idap_pi_root a
>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next
>> query:
>> > > 1000
>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT
>> a.*,
>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > > c.cust_code,c.root_cust_code,
>> > >
>> > >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > > FROM prc_idap_pi_root a
>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
>> > > auto-progress thread to quit.
>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for
>> progress
>> > > thread shutdown...
>> > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress
>> thread
>> > > is finished. keepGoing=false
>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
>> > > shutdown detected.
>> > > 12/03/01 15:24:32 INFO mapred.Task:
>> Task:attempt_local_0001_m_000000_0 is
>> > > done. And is in the process of commiting
>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
>> attempt_local_0001_m_000000_0 is
>> > > allowed to commit now
>> > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of
>> task
>> > > 'attempt_local_0001_m_000000_0' to /home/wbian/test
>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
>> 'attempt_local_0001_m_000000_0'
>> > > done.
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
>> > > 2.9865 seconds (0 bytes/sec)
>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
>> > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
>> > >
>> > > Thanks&Regards,
>> > > Bruce
>> > >
>> > >
>> > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <jarcec@apache.org
>> >wrote:
>> > >
>> > >> Hi Bruce,
>> > >> would you mind sending entire sqoop command that you've used as well
>> as
>> > >> entire output that it generates with "--verbose" flag?
>> > >>
>> > >> Jarcec
>> > >>
>> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
>> > >> > Hi there,
>> > >> > When I'm using sqoop free-form query import to import the data
from
>> > >> Oracle
>> > >> > to HDFS with some ETL process in the query, the results in HDFS
>> contains
>> > >> > nothing.
>> > >> > The query is as follows:
>> > >> >
>> > >> > SELECT a.*,
>> > >> >
>> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > >> > c.cust_code,c.root_cust_code,
>> > >> >
>> > >>
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > >> > FROM prc_idap_pi_root a
>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> > >> etl.etl_para_cfg_detail
>> > >> > WHERE para_id=84) AND \$CONDITIONS
>> > >> >
>> > >> > The same query has been executed successfully in oracle(without
the
>> > >> > $CONDITIONS of course). Is it because the query contains sub-query
>> in
>> > >> it?
>> > >> >
>> > >> > Thanks&Regards,
>> > >> > Bruce
>> > >>
>> > >
>> > >
>>
>
>

Mime
View raw message