sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jarek Jarcec Cecho <jar...@apache.org>
Subject Re: problems importing from oracle\
Date Thu, 01 Mar 2012 09:17:31 GMT
Ignored :-)

I do not believe that you're hitting exactly SQOOP-204. It seems that SQOOP-204 has failed
during creating Input Splits for your job. But you seem to be dying after your job is being
executed on hadoop cluster.

I'm afraid that I do not know how to help you at the moment. Would you mind upgrading on current
1.4.1 version?

Jarcec

On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
> Hi Jarek ,
> Please ignore my first problem for getting no hdfs results as it turns out
> to be my silly mistake during copying of the query. sorry for the annoyance.
> The second problem of adding --split-by turns out to be SQOOP-204, but it
> should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it?
> 
> On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <weidong.ban@gmail.com> wrote:
> 
> > also when I'm adding the --split-by a.prod_inst_id to the sqoop command as
> > in:
> > QUERY="SELECT a.*,
> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > c.cust_code,c.root_cust_code,
> >
> > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > FROM prc_idap_pi_root a
> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> > WHERE para_id=84) AND \$CONDITIONS"
> > sqoop import \
> > --verbose \
> > --driver oracle.jdbc.OracleDriver \
> > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
> > --username *** \
> > --password ****** \
> > --query "$QUERY" \
> > --split-by a.prod_inst_id \
> > --target-dir /home/wbian/test
> >
> > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not properly
> > ended"   Exception is threw.
> > And I'm testing this sqoop command on a stand-alone hadoop node.
> > The output when adding the split-by is as follows:
> >
> > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on the
> > command-line is insecure. Consider using -P instead.
> > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
> > com.cloudera.sqoop.manager.DefaultManagerFactory
> > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> > com.cloudera.sqoop.manager.DefaultManagerFactory
> > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of 1000
> > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
> > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
> > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
> > specified. Using regular API for making connection.
> > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> > query: 1000
> > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: SELECT
> > a.*,
> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > c.cust_code,c.root_cust_code,
> >
> > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > FROM prc_idap_pi_root a
> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> > WHERE para_id=84) AND  (1 = 0)
> > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> > query: 1000
> > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: SELECT
> > a.*,
> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > c.cust_code,c.root_cust_code,
> >
> > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > FROM prc_idap_pi_root a
> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> > WHERE para_id=84) AND  (1 = 0)
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
> > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
> > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
> > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
> > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, CARRIER_PROD_INST_NUM:12,
> > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
> > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12, GH_INSTALL_TP:12,
> > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
> > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
> > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12, DATA_INTERNET_FLG:12,
> > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
> > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
> > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2, SUB_AGR_ID:2,
> > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93, AGR_END_DT:93,
> > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2, DEV_GRID_ID:2,
> > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
> > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
> > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
> > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
> > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
> > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
> > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
> > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
> > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
> > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
> > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
> > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
> > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
> > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
> > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93, CREATE_BY:12,
> > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12, PI_SUB_STAT_TP:12,
> > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
> > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
> > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
> > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
> > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
> > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
> > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12, A_ACCESS_MODE:12,
> > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, A_ATTR_USE:12,
> > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
> > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
> > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
> > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
> > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
> > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
> > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
> > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
> > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
> > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is QueryResult.java
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
> > /usr/lib/hadoop
> > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar at:
> > /usr/lib/hadoop/hadoop-core.jar
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with args:
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > Note:
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > uses or overrides a deprecated API.
> > Note: Recompile with -Xlint:deprecation for details.
> > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class files
> > in directory: /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
> > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
> > -> QueryResult.class
> > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar file
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query import.
> > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing
> > class: QueryResult
> > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
> > through URL:
> > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader is
> > sun.misc.Launcher$AppClassLoader@28df6ccd
> > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
> > QueryResult
> > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into current
> > JVM:
> > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for jar
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
> > java.net.FactoryURLClassLoader@1638fff7
> > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table class:
> > QueryResult
> > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using InputFormat:
> > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> > processName=JobTracker, sessionId=
> > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load native-hadoop
> > library for your platform... using builtin-java classes where applicable
> > 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
> > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db record
> > reader for db product: ORACLE
> > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query: SELECT
> > a.*,
> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > c.cust_code,c.root_cust_code,
> >
> > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > FROM prc_idap_pi_root a
> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next query:
> > 1000
> > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT a.*,
> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > c.cust_code,c.root_cust_code,
> >
> > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > FROM prc_idap_pi_root a
> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
> > auto-progress thread to quit.
> > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for progress
> > thread shutdown...
> > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress thread
> > is finished. keepGoing=false
> > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
> > shutdown detected.
> > 12/03/01 15:24:32 INFO mapred.Task: Task:attempt_local_0001_m_000000_0 is
> > done. And is in the process of commiting
> > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> > 12/03/01 15:24:32 INFO mapred.Task: Task attempt_local_0001_m_000000_0 is
> > allowed to commit now
> > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of task
> > 'attempt_local_0001_m_000000_0' to /home/wbian/test
> > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> > 12/03/01 15:24:32 INFO mapred.Task: Task 'attempt_local_0001_m_000000_0'
> > done.
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
> > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
> > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
> > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
> > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
> > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
> > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
> > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
> > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
> > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
> > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
> > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
> > 2.9865 seconds (0 bytes/sec)
> > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
> > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
> > sun.misc.Launcher$AppClassLoader@28df6ccd
> >
> > Thanks&Regards,
> > Bruce
> >
> >
> > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <jarcec@apache.org>wrote:
> >
> >> Hi Bruce,
> >> would you mind sending entire sqoop command that you've used as well as
> >> entire output that it generates with "--verbose" flag?
> >>
> >> Jarcec
> >>
> >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
> >> > Hi there,
> >> > When I'm using sqoop free-form query import to import the data from
> >> Oracle
> >> > to HDFS with some ETL process in the query, the results in HDFS contains
> >> > nothing.
> >> > The query is as follows:
> >> >
> >> > SELECT a.*,
> >> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >> > c.cust_code,c.root_cust_code,
> >> >
> >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >> > FROM prc_idap_pi_root a
> >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >> etl.etl_para_cfg_detail
> >> > WHERE para_id=84) AND \$CONDITIONS
> >> >
> >> > The same query has been executed successfully in oracle(without the
> >> > $CONDITIONS of course). Is it because the query contains sub-query in
> >> it?
> >> >
> >> > Thanks&Regards,
> >> > Bruce
> >>
> >
> >

Mime
View raw message