From user-return-1839-apmail-sqoop-user-archive=sqoop.apache.org@sqoop.apache.org Thu Oct 31 16:43:02 2013 Return-Path: X-Original-To: apmail-sqoop-user-archive@www.apache.org Delivered-To: apmail-sqoop-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7D4FD10345 for ; Thu, 31 Oct 2013 16:43:02 +0000 (UTC) Received: (qmail 61029 invoked by uid 500); 31 Oct 2013 16:42:57 -0000 Delivered-To: apmail-sqoop-user-archive@sqoop.apache.org Received: (qmail 61005 invoked by uid 500); 31 Oct 2013 16:42:56 -0000 Mailing-List: contact user-help@sqoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@sqoop.apache.org Delivered-To: mailing list user@sqoop.apache.org Received: (qmail 60984 invoked by uid 99); 31 Oct 2013 16:42:55 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Oct 2013 16:42:55 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy includes SPF record at spf.trusted-forwarder.org) Received: from [76.96.30.64] (HELO qmta07.emeryville.ca.mail.comcast.net) (76.96.30.64) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Oct 2013 16:42:47 +0000 Received: from omta22.emeryville.ca.mail.comcast.net ([76.96.30.89]) by qmta07.emeryville.ca.mail.comcast.net with comcast id jrrF1m0051vN32cA7siS79; Thu, 31 Oct 2013 16:42:26 +0000 Received: from localhost ([IPv6:2601:9:3f00:251:56f:242e:e5cb:a5f3]) by omta22.emeryville.ca.mail.comcast.net with comcast id jsiQ1m00K01h3Wn8isiRwu; Thu, 31 Oct 2013 16:42:26 +0000 Date: Thu, 31 Oct 2013 09:42:24 -0700 From: Jarek Jarcec Cecho To: user@sqoop.apache.org Subject: Re: import-all-tables fails with exception 'Invalid object name' on non dbo schemas Message-ID: <20131031164223.GE5190@localhost> References: <83BC821DACF6D049B6041A4FFE1D117F03A9B1@SVR-EXC10.initions.local> <20131031153126.GB5190@localhost> <83BC821DACF6D049B6041A4FFE1D117F03AB22@SVR-EXC10.initions.local> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="IU5/I01NYhRvwH70" Content-Disposition: inline In-Reply-To: <83BC821DACF6D049B6041A4FFE1D117F03AB22@SVR-EXC10.initions.local> User-Agent: Mutt/1.5.21 (2010-09-15) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=comcast.net; s=q20121106; t=1383237746; bh=7Lq3q6BCWZ3aXo7EXQIHq+gH3vohB7EXPlm3gZWw8Jw=; h=Received:Received:Date:From:To:Subject:Message-ID:MIME-Version: Content-Type; b=APBhj+r/3vY4cKkku0NHRuby4B+1evzq0jGnuQT+sy9P4PzbOzC+LVeBXV9fbXzce BAXzM9ilWnK6JOH6BE3tqrxECTA5j0OEnKEXIutd6J7nBdj1OvR7P4+0YFR8xzRd5T jscUC4tD3bsw6AF48PpuuL0XHDNj1eOlmsFf2yLe6VE8lln11+BTs7BiTkJx7njAhr 3NXqVIUU+TElUIqpzWypRouLK6nGGh1SotLQ9zntQCuHh4gm2iuzZgoXD5COslLk/h mfka/fOpiJcQ1RbpgUBERvrYWnyUnm1l9vBl3fsKtWaWpH+f0ErmT47BBm3zLJF14O 1Px+eCeF5Li0A== X-Virus-Checked: Checked by ClamAV on apache.org --IU5/I01NYhRvwH70 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi Christos, this is the log I was looking for :-)=20 > 13/10/31 16:47:48 WARN sqoop.ConnFactory: Parameter --driver is set to an= explicit driver however appropriate connection manager is not being set (v= ia --connection-manager). Sqoop is going to fall back to org.apache.sqoop.m= anager.GenericJdbcManager. Please specify explicitly which connection manag= er should be used next time. Would you mind trying the command without --driver option as the WARNING is= suggesting? You might find more background why using --driver option is no= t desirable in most cases in our blog post [1]. Jarcec Links: 1: https://blogs.apache.org/sqoop/entry/connectors_and_drivers_in_the On Thu, Oct 31, 2013 at 03:54:21PM +0000, Kallinteris, Christos wrote: > Hello Jarcec, >=20 > Here is the command and the response I get on the console. Where would I = find the log for sqoop? There is no corresponding directory under /var/log. >=20 > Thank you very much! >=20 > Christos >=20 > -- > ck@SVR-HDP01:~$ sqoop import-all-tables --connect "jdbc:sqlserver://192.1= 68.207.194\\SQL2008R2;user=3Dsqoop;password=3Dpassword;databasename=3DDWH_B= SP;" --driver com.microsoft.sqlserver.jdbc.SQLServerDriver --username sqoop= --password password --hive-import --verbose > Warning: /usr/lib/hcatalog does not exist! HCatalog jobs will fail. > Please set $HCAT_HOME to the root of your HCatalog installation. > 13/10/31 16:47:48 DEBUG tool.BaseSqoopTool: Enabled debug logging. > 13/10/31 16:47:48 WARN tool.BaseSqoopTool: Setting your password on the c= ommand-line is insecure. Consider using -P instead. > 13/10/31 16:47:48 INFO tool.BaseSqoopTool: Using Hive-specific delimiters= for output. You can override > 13/10/31 16:47:48 INFO tool.BaseSqoopTool: delimiters with --fields-termi= nated-by, etc. > 13/10/31 16:47:48 DEBUG sqoop.ConnFactory: Loaded manager factory: com.cl= oudera.sqoop.manager.DefaultManagerFactory > 13/10/31 16:47:48 WARN sqoop.ConnFactory: Parameter --driver is set to an= explicit driver however appropriate connection manager is not being set (v= ia --connection-manager). Sqoop is going to fall back to org.apache.sqoop.m= anager.GenericJdbcManager. Please specify explicitly which connection manag= er should be used next time. > 13/10/31 16:47:48 INFO manager.SqlManager: Using default fetchSize of 1000 > 13/10/31 16:47:49 DEBUG manager.SqlManager: No connection paramenters spe= cified. Using regular API for making connection. > 13/10/31 16:47:50 INFO tool.CodeGenTool: Beginning code generation > 13/10/31 16:47:50 DEBUG manager.SqlManager: Execute getColumnTypesRawQuer= y : SELECT t.* FROM tblAdresse AS t WHERE 1=3D0 > 13/10/31 16:47:50 DEBUG manager.SqlManager: Using fetchSize for next quer= y: 1000 > 13/10/31 16:47:50 INFO manager.SqlManager: Executing SQL statement: SELEC= T t.* FROM tblAdresse AS t WHERE 1=3D0 > 13/10/31 16:47:50 ERROR manager.SqlManager: Error executing statement: co= m.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name 'tblAdre= sse'. > com.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name 'tbl= Adresse'. > at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDataba= seError(SQLServerException.java:216) > at com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(= SQLServerStatement.java:1515) > at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExec= utePreparedStatement(SQLServerPreparedStatement.java:404) > at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement$PrepSt= mtExecCmd.doExecute(SQLServerPreparedStatement.java:350) > at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:= 5696) > at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeComman= d(SQLServerConnection.java:1715) > at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand= (SQLServerStatement.java:180) > at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStateme= nt(SQLServerStatement.java:155) > at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.execut= eQuery(SQLServerPreparedStatement.java:285) > at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:67= 4) > at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:68= 3) > at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(= SqlManager.java:240) > at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.= java:223) > at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManage= r.java:347) > at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.ja= va:1277) > at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:108= 9) > at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java= :96) > at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:3= 96) > at org.apache.sqoop.tool.ImportAllTablesTool.run(ImportAllTablesT= ool.java:105) > at org.apache.sqoop.Sqoop.run(Sqoop.java:145) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181) > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220) > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229) > at org.apache.sqoop.Sqoop.main(Sqoop.java:238) > 13/10/31 16:47:50 ERROR tool.ImportAllTablesTool: Encountered IOException= running import job: java.io.IOException: No columns to generate for ClassW= riter >=20 > -- >=20 > initions AG > Christos Kallinteris > Weidestra=DFe 120a > D-22083 Hamburg >=20 > t:=A0=A0 +49 (0) 40 / 41 49 60-79 > f:=A0=A0 +49 (0) 40 / 41 49 60-11 > e:=A0 kallinteris@initions.com > w: www.initions.com > =A0 >=20 > Vollst=E4ndiger Name der Gesellschaft: initions innovative IT solutions AG > Sitz der Gesellschaft: Hamburg > Handelsregister Hamburg B 83929 > Aufsichtsratsvorsitzender: Dr. Michael Leue > Vorstand: Dr. Stefan Ansch=FCtz, Andr=E9 Paul Henkel, Dr. Helge Plehn >=20 >=20 > -----Urspr=FCngliche Nachricht----- > Von: Jarek Jarcec Cecho [mailto:jarcec@apache.org]=20 > Gesendet: Donnerstag, 31. Oktober 2013 16:31 > An: user@sqoop.apache.org > Betreff: Re: import-all-tables fails with exception 'Invalid object name'= on non dbo schemas >=20 > Hi Christos, > would you mind sharing with us entire Sqoop command and associated log ge= nerated with parameter --verbose? >=20 > Jarcec >=20 > On Wed, Oct 30, 2013 at 09:40:40AM +0000, Kallinteris, Christos wrote: > > Hello! > >=20 > > I would like to import a complete database from SQL Server into HDFS an= d from there to HIVE to have some data to play with. > >=20 > > I figured out the necessary connection string and I get the first few t= ables imported but then the job throws the invalid object name exception. A= s far as I can tell this happens when the job encounters a table that has a= schema other than dbo. > >=20 > > Is this a known issue and if yes, is there a way around it? > >=20 > > I'm using Sqoop 1.4.3-cdh4.4.0 on the latest stable Cloudera distributi= on. > >=20 > > Thanks! > >=20 > > Christos > >=20 > > -- > >=20 > > initions AG > > Christos Kallinteris > > Weidestra=DFe 120a > > D-22083 Hamburg > >=20 > > t: +49 (0) 40 / 41 49 60-79 > > f: +49 (0) 40 / 41 49 60-11 > > e: kallinteris@initions.com > > w: www.initions.com > >=20 > >=20 > > Vollst=E4ndiger Name der Gesellschaft: initions innovative IT solutions= =20 > > AG Sitz der Gesellschaft: Hamburg Handelsregister Hamburg B 83929 > > Aufsichtsratsvorsitzender: Dr. Michael Leue > > Vorstand: Dr. Stefan Ansch=FCtz, Andr=E9 Paul Henkel, Dr. Helge Plehn > >=20 --IU5/I01NYhRvwH70 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQIcBAEBAgAGBQJScohvAAoJEEk45sAabwqG6FUP/0R4h12G0UxPmDLFgVjVknRM fCnEF4893Oa0WjliOBw+K6hEIjMLtkeM3Cnq1z0UXiWc2vgmhFcjoNIUm12ovZJ/ 1HkQdnAae9eeWjujZSRr74WhMmOObx57byQTZ9rSpnCsVSQi8KZRzZNkOkbaAh0L spW6bNjPHMAvxi9Z66zXLNVtioszUSeBVuFN1aYylIewx8aX7Jn+lBkxkyVSGZa0 TN0VrN3oLq2Phide8yH62Ya9xAxFglz0slfGWtnV4xZG/BFWM0wkp/wJfAwt8VZl bYBO4s7TjxjctPeVyO6djeYdO7Hp2MjMNijxv2+zlZSYrr17e+Zpls00eMYd2BBD bgGIUH7sr7Q+4BJdrzyD+uRhFGGV5bb4K5pNNWRAa5l19+EnCdRnsoIUbyVkkZum MO5Xvaeo6Bl8xc1+outejl52QtpZ10HAl64SmG9jI3u12o30mKYcdKg+1Ch6ZPc6 mZFJMCiWt0ZJXDQHXxVn/ZGk4UhC/VLBUgCYY0Z75vFQfOln+GJOty6YjAYWDfw4 PUDpmGKna5TCUBCjweNZWcOuf3UNgD+2Dy4bxUqSaTP1sZNzkbDsBEQpHjaDqZ+5 LDnENnR05g08wP5lamOhjxbI/0uzKPmuF0mOFpBCr9KxuJiQLfz/R7XnS9IFWQGV JS+A1hUwlGesBH4h0GSv =aR1n -----END PGP SIGNATURE----- --IU5/I01NYhRvwH70--