sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bruce Bian <weidong....@gmail.com>
Subject Re: problems importing from oracle
Date Thu, 01 Mar 2012 08:59:48 GMT
Hi Jarek ,
Please ignore my first problem for getting no hdfs results as it turns out
to be my silly mistake during copying of the query. sorry for the annoyance.
The second problem of adding --split-by turns out to be SQOOP-204, but it
should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it?

On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <weidong.ban@gmail.com> wrote:

> also when I'm adding the --split-by a.prod_inst_id to the sqoop command as
> in:
> QUERY="SELECT a.*,
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> c.cust_code,c.root_cust_code,
>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> FROM prc_idap_pi_root a
>  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> WHERE para_id=84) AND \$CONDITIONS"
> sqoop import \
> --verbose \
> --driver oracle.jdbc.OracleDriver \
> --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
> --username *** \
> --password ****** \
> --query "$QUERY" \
> --split-by a.prod_inst_id \
> --target-dir /home/wbian/test
>
> A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not properly
> ended"   Exception is threw.
> And I'm testing this sqoop command on a stand-alone hadoop node.
> The output when adding the split-by is as follows:
>
> 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on the
> command-line is insecure. Consider using -P instead.
> 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
> com.cloudera.sqoop.manager.DefaultManagerFactory
> 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> com.cloudera.sqoop.manager.DefaultManagerFactory
> 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of 1000
> 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
> 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
> 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
> specified. Using regular API for making connection.
> 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> query: 1000
> 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: SELECT
> a.*,
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> c.cust_code,c.root_cust_code,
>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> FROM prc_idap_pi_root a
>  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> WHERE para_id=84) AND  (1 = 0)
> 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> query: 1000
> 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: SELECT
> a.*,
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> c.cust_code,c.root_cust_code,
>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> FROM prc_idap_pi_root a
>  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> WHERE para_id=84) AND  (1 = 0)
> 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
> 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
> CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
> STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
> INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
> BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, CARRIER_PROD_INST_NUM:12,
> COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
> WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12, GH_INSTALL_TP:12,
> GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
> DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
> DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12, DATA_INTERNET_FLG:12,
> PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
> PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
> PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2, SUB_AGR_ID:2,
> AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93, AGR_END_DT:93,
> INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2, DEV_GRID_ID:2,
> DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
> SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
> SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
> SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
> SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
> SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
> SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
> SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
> SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
> SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
> SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
> PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
> DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
> PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
> SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93, CREATE_BY:12,
> LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12, PI_SUB_STAT_TP:12,
> PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
> SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
> SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
> VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
> BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
> ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
> WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12, A_ACCESS_MODE:12,
> A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, A_ATTR_USE:12,
> A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
> RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
> SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
> GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
> DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
> MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
> SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
> ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
> ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
> ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
> 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is QueryResult.java
> 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
> /usr/lib/hadoop
> 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar at:
> /usr/lib/hadoop/hadoop-core.jar
> 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with args:
> 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
> 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
> 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
> 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> Note:
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> uses or overrides a deprecated API.
> Note: Recompile with -Xlint:deprecation for details.
> 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class files
> in directory: /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
> 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
> -> QueryResult.class
> 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar file
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query import.
> 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing
> class: QueryResult
> 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
> through URL:
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader is
> sun.misc.Launcher$AppClassLoader@28df6ccd
> 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
> QueryResult
> 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into current
> JVM:
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for jar
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
> java.net.FactoryURLClassLoader@1638fff7
> 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table class:
> QueryResult
> 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using InputFormat:
> class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
> 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db record
> reader for db product: ORACLE
> 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query: SELECT
> a.*,
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> c.cust_code,c.root_cust_code,
>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> FROM prc_idap_pi_root a
>  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next query:
> 1000
> 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT a.*,
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> c.cust_code,c.root_cust_code,
>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> FROM prc_idap_pi_root a
>  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
> auto-progress thread to quit.
> 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for progress
> thread shutdown...
> 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress thread
> is finished. keepGoing=false
> 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
> shutdown detected.
> 12/03/01 15:24:32 INFO mapred.Task: Task:attempt_local_0001_m_000000_0 is
> done. And is in the process of commiting
> 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> 12/03/01 15:24:32 INFO mapred.Task: Task attempt_local_0001_m_000000_0 is
> allowed to commit now
> 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of task
> 'attempt_local_0001_m_000000_0' to /home/wbian/test
> 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> 12/03/01 15:24:32 INFO mapred.Task: Task 'attempt_local_0001_m_000000_0'
> done.
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
> 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
> 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
> 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
> 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
> 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
> 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
> 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
> 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
> 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
> 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
> 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
> 2.9865 seconds (0 bytes/sec)
> 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
> 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
> sun.misc.Launcher$AppClassLoader@28df6ccd
>
> Thanks&Regards,
> Bruce
>
>
> On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <jarcec@apache.org>wrote:
>
>> Hi Bruce,
>> would you mind sending entire sqoop command that you've used as well as
>> entire output that it generates with "--verbose" flag?
>>
>> Jarcec
>>
>> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
>> > Hi there,
>> > When I'm using sqoop free-form query import to import the data from
>> Oracle
>> > to HDFS with some ETL process in the query, the results in HDFS contains
>> > nothing.
>> > The query is as follows:
>> >
>> > SELECT a.*,
>> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > c.cust_code,c.root_cust_code,
>> >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > FROM prc_idap_pi_root a
>> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > WHERE para_id=84) AND \$CONDITIONS
>> >
>> > The same query has been executed successfully in oracle(without the
>> > $CONDITIONS of course). Is it because the query contains sub-query in
>> it?
>> >
>> > Thanks&Regards,
>> > Bruce
>>
>
>

Mime
View raw message