sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bruce Bian <weidong....@gmail.com>
Subject Re: problems importing from oracle
Date Tue, 06 Mar 2012 07:57:25 GMT
Created SQOOP-455

On Tue, Mar 6, 2012 at 2:43 PM, Jarek Jarcec Cecho <jarcec@apache.org>wrote:

> Hi Bruce,
> I'm sorry but I did not yet looked on your issue as I'm short of time at
> the moment. Please feel free to report it as an JIRA issue.
>
> Jarcec
>
> On Tue, Mar 06, 2012 at 10:50:57AM +0800, Bruce Bian wrote:
> > any feedback on this?Shall I create a jira issue on this?
> >
> > On Thu, Mar 1, 2012 at 11:12 PM, Bruce Bian <weidong.ban@gmail.com>
> wrote:
> >
> > > Hi Jarcec,
> > > After looking at the code of sqoop, my previous split-by problem is
> caused
> > > by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop
> command, and
> > > the following code in org.apache.sqoop.manager.DefaultManagerFactory
> > > initialized a GenericJdbcManager instead of OracleManager even after
> > > --connection-manager OracleManager is specified
> > >
> > >     SqoopOptions options = data.getSqoopOptions();
> > >     String manualDriver = options.getDriverClassName();
> > >     if (manualDriver != null) {
> > >       // User has manually specified JDBC implementation with --driver.
> > >       // Just use GenericJdbcManager.
> > >       return new GenericJdbcManager(manualDriver, options);
> > >     }
> > > Any reason why the code above appears before initializing the
> connection
> > > manager specified by the user?Shouldn't it be put even after the
> connection
> > > scheme is judged?
> > >
> > >
> > > On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho <jarcec@apache.org
> >wrote:
> > >
> > >> Ignored :-)
> > >>
> > >> I do not believe that you're hitting exactly SQOOP-204. It seems that
> > >> SQOOP-204 has failed during creating Input Splits for your job. But
> you
> > >> seem to be dying after your job is being executed on hadoop cluster.
> > >>
> > >> I'm afraid that I do not know how to help you at the moment. Would you
> > >> mind upgrading on current 1.4.1 version?
> > >>
> > >> Jarcec
> > >>
> > >> On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
> > >> > Hi Jarek ,
> > >> > Please ignore my first problem for getting no hdfs results as it
> turns
> > >> out
> > >> > to be my silly mistake during copying of the query. sorry for the
> > >> annoyance.
> > >> > The second problem of adding --split-by turns out to be SQOOP-204,
> but
> > >> it
> > >> > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is
> it?
> > >> >
> > >> > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <weidong.ban@gmail.com>
> > >> wrote:
> > >> >
> > >> > > also when I'm adding the --split-by a.prod_inst_id to the sqoop
> > >> command as
> > >> > > in:
> > >> > > QUERY="SELECT a.*,
> > >> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > >> > > c.cust_code,c.root_cust_code,
> > >> > >
> > >> > >
> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > >> > > FROM prc_idap_pi_root a
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> > >> etl.etl_para_cfg_detail
> > >> > > WHERE para_id=84) AND \$CONDITIONS"
> > >> > > sqoop import \
> > >> > > --verbose \
> > >> > > --driver oracle.jdbc.OracleDriver \
> > >> > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
> > >> > > --username *** \
> > >> > > --password ****** \
> > >> > > --query "$QUERY" \
> > >> > > --split-by a.prod_inst_id \
> > >> > > --target-dir /home/wbian/test
> > >> > >
> > >> > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
> > >> properly
> > >> > > ended"   Exception is threw.
> > >> > > And I'm testing this sqoop command on a stand-alone hadoop node.
> > >> > > The output when adding the split-by is as follows:
> > >> > >
> > >> > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> > >> > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password
> on
> > >> the
> > >> > > command-line is insecure. Consider using -P instead.
> > >> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
> > >> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> > >> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> > >> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> > >> > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default
> fetchSize of
> > >> 1000
> > >> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated
> ConnManager
> > >> > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
> > >> > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
> > >> > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection
> paramenters
> > >> > > specified. Using regular API for making connection.
> > >> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for
> next
> > >> > > query: 1000
> > >> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL
> statement:
> > >> SELECT
> > >> > > a.*,
> > >> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > >> > > c.cust_code,c.root_cust_code,
> > >> > >
> > >> > >
> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > >> > > FROM prc_idap_pi_root a
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> > >> etl.etl_para_cfg_detail
> > >> > > WHERE para_id=84) AND  (1 = 0)
> > >> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for
> next
> > >> > > query: 1000
> > >> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL
> statement:
> > >> SELECT
> > >> > > a.*,
> > >> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > >> > > c.cust_code,c.root_cust_code,
> > >> > >
> > >> > >
> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > >> > > FROM prc_idap_pi_root a
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> > >> etl.etl_para_cfg_detail
> > >> > > WHERE para_id=84) AND  (1 = 0)
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:
> SALE_POLICY_CONST_START_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
> > >> > >
> > >>
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
> > >> > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12,
> STD_PRD_CD:12,
> > >> > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
> > >> > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
> > >> > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12,
> CARRIER_PROD_INST_NUM:12,
> > >> > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
> > >> > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12,
> > >> GH_INSTALL_TP:12,
> > >> > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12,
> DATA_PORTA_NUM:12,
> > >> > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
> > >> > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12,
> > >> DATA_INTERNET_FLG:12,
> > >> > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
> > >> > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
> > >> > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2,
> > >> SUB_AGR_ID:2,
> > >> > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93,
> > >> AGR_END_DT:93,
> > >> > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2,
> > >> DEV_GRID_ID:2,
> > >> > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
> > >> > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
> > >> > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
> > >> > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
> > >> > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
> > >> > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
> > >> > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
> > >> > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
> > >> > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
> > >> > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
> > >> > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
> > >> > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
> > >> > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
> > >> > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
> > >> > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93,
> > >> CREATE_BY:12,
> > >> > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12,
> > >> PI_SUB_STAT_TP:12,
> > >> > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12,
> IMSI:12,
> > >> > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
> > >> > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
> > >> > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
> > >> > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
> > >> > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
> > >> > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12,
> > >> A_ACCESS_MODE:12,
> > >> > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12,
> A_ATTR_USE:12,
> > >> > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
> > >> > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93,
> CHURN_DT:93,
> > >> > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
> > >> > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
> > >> > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
> > >> > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
> > >> > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12,
> POSTCODE:12,
> > >> > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
> > >> > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
> > >> > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is
> > >> QueryResult.java
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
> > >> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > >> > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
> > >> > > /usr/lib/hadoop
> > >> > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core
> jar
> > >> at:
> > >> > > /usr/lib/hadoop/hadoop-core.jar
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source
> file:
> > >> > >
> > >>
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac
> with
> > >> args:
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > >> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > >> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > >> > >
> > >>
> /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > >> > > Note:
> > >> > >
> > >>
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > >> > > uses or overrides a deprecated API.
> > >> > > Note: Recompile with -Xlint:deprecation for details.
> > >> > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
> > >> > >
> > >>
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> > >> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for
> .class
> > >> files
> > >> > > in directory:
> > >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
> > >> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
> > >> > >
> > >>
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
> > >> > > -> QueryResult.class
> > >> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing
> jar
> > >> file
> > >> > >
> > >>
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> > >> > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query
> > >> import.
> > >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for
> existing
> > >> > > class: QueryResult
> > >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load
> jar
> > >> > > through URL:
> > >> > >
> > >>
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> > >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous
> classloader is
> > >> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> > >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in
> jar:
> > >> > > QueryResult
> > >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into
> current
> > >> > > JVM:
> > >> > >
> > >>
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> > >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader
> for
> > >> jar
> > >> > >
> > >>
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
> > >> > > java.net.FactoryURLClassLoader@1638fff7
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table
> > >> class:
> > >> > > QueryResult
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using
> > >> InputFormat:
> > >> > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > >
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > >
> > >>
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> > >> > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics
> with
> > >> > > processName=JobTracker, sessionId=
> > >> > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load
> > >> native-hadoop
> > >> > > library for your platform... using builtin-java classes where
> > >> applicable
> > >> > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job:
> job_local_0001
> > >> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db
> record
> > >> > > reader for db product: ORACLE
> > >> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query:
> > >> SELECT
> > >> > > a.*,
> > >> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > >> > > c.cust_code,c.root_cust_code,
> > >> > >
> > >> > >
> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > >> > > FROM prc_idap_pi_root a
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> > >> etl.etl_para_cfg_detail
> > >> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> > >> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for
> next
> > >> query:
> > >> > > 1000
> > >> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT
> > >> a.*,
> > >> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > >> > > c.cust_code,c.root_cust_code,
> > >> > >
> > >> > >
> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > >> > > FROM prc_idap_pi_root a
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> > >> etl.etl_para_cfg_detail
> > >> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> > >> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
> > >> > > auto-progress thread to quit.
> > >> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for
> > >> progress
> > >> > > thread shutdown...
> > >> > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress
> > >> thread
> > >> > > is finished. keepGoing=false
> > >> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress
> thread
> > >> > > shutdown detected.
> > >> > > 12/03/01 15:24:32 INFO mapred.Task:
> > >> Task:attempt_local_0001_m_000000_0 is
> > >> > > done. And is in the process of commiting
> > >> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> > >> > > 12/03/01 15:24:32 INFO mapred.Task: Task
> > >> attempt_local_0001_m_000000_0 is
> > >> > > allowed to commit now
> > >> > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of
> > >> task
> > >> > > 'attempt_local_0001_m_000000_0' to /home/wbian/test
> > >> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> > >> > > 12/03/01 15:24:32 INFO mapred.Task: Task
> > >> 'attempt_local_0001_m_000000_0'
> > >> > > done.
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete:
> job_local_0001
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:
> FILE_BYTES_WRITTEN=96083
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
> > >> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0
> bytes in
> > >> > > 2.9865 seconds (0 bytes/sec)
> > >> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0
> records.
> > >> > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring
> classloader:
> > >> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> > >> > >
> > >> > > Thanks&Regards,
> > >> > > Bruce
> > >> > >
> > >> > >
> > >> > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <
> jarcec@apache.org
> > >> >wrote:
> > >> > >
> > >> > >> Hi Bruce,
> > >> > >> would you mind sending entire sqoop command that you've used as
> well
> > >> as
> > >> > >> entire output that it generates with "--verbose" flag?
> > >> > >>
> > >> > >> Jarcec
> > >> > >>
> > >> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
> > >> > >> > Hi there,
> > >> > >> > When I'm using sqoop free-form query import to import the data
> from
> > >> > >> Oracle
> > >> > >> > to HDFS with some ETL process in the query, the results in HDFS
> > >> contains
> > >> > >> > nothing.
> > >> > >> > The query is as follows:
> > >> > >> >
> > >> > >> > SELECT a.*,
> > >> > >> >
> > >> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > >> > >> > c.cust_code,c.root_cust_code,
> > >> > >> >
> > >> > >>
> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > >> > >> > FROM prc_idap_pi_root a
> > >> > >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >> > >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >> > >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > >> > >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> > >> > >> etl.etl_para_cfg_detail
> > >> > >> > WHERE para_id=84) AND \$CONDITIONS
> > >> > >> >
> > >> > >> > The same query has been executed successfully in
> oracle(without the
> > >> > >> > $CONDITIONS of course). Is it because the query contains
> sub-query
> > >> in
> > >> > >> it?
> > >> > >> >
> > >> > >> > Thanks&Regards,
> > >> > >> > Bruce
> > >> > >>
> > >> > >
> > >> > >
> > >>
> > >
> > >
>

Mime
View raw message