sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abraham Elmahrek <...@cloudera.com>
Subject Re: [VOTE] Release Sqoop version 1.99.6
Date Mon, 13 Apr 2015 22:23:02 GMT
Hey Guys,

+1

* Verified signatures
* Verified checksums
* Verified tag
* Build and unit tests work fine
* Ran the script below successfuly

*mysql.sqoop*

set option --name verbose --value true

// Create generic MySQL link
create link --cid 4 --name mysql --link-linkConfig-connectionString
jdbc:mysql://.../test --link-linkConfig-username sqoop
--link-linkConfig-password sqoop --link-linkConfig-jdbcDriver
com.mysql.jdbc.Driver

// Create HDFS link
create link --cid 3 --name hdfs --link-linkConfig-uri hdfs://...:8020/

// Create Kite hdfs link
create link --cid 1 --name kitehdfs --link-linkConfig-authority ...:8020

// Create Kite hive link
create link --cid 1 --name kitehive --link-linkConfig-authority ...:9083

// Create MySQL to HDFS Job
create job --from 1 --to 2 --name mysql2hdfs --from-fromJobConfig-tableName
fl --to-toJobConfig-outputFormat TEXT_FILE --to-toJobConfig-compression
NONE --to-toJobConfig-outputDirectory /tmp/sqoop2/hdfs/text

// Create HDFS to MySQL Job
create job --from 2 --to 1 --name hdfs2mysql
--from-fromJobConfig-inputDirectory /tmp/sqoop2/hdfs/text
--to-toJobConfig-tableName fl

// Create MySQL to Kite - HDFS Job
create job --from 1 --to 3 --name mysql2kitehdfsavro
--from-fromJobConfig-tableName test --to-toJobConfig-uri
dataset:hdfs:/tmp/sqoop2/kite/avro --to-toJobConfig-fileFormat AVRO

// Create MySQL to Kite - HDFS Job
create job --from 1 --to 3 --name mysql2kitehdfsparquet
--from-fromJobConfig-tableName test --to-toJobConfig-uri
dataset:hdfs:/tmp/sqoop2/kite/parquet --to-toJobConfig-fileFormat PARQUET

// Create MySQL to Kite - Hive Job
create job --from 1 --to 4 --name mysql2kitehiveavro
--from-fromJobConfig-tableName test --to-toJobConfig-uri
dataset:hive:tmp/avro --to-toJobConfig-fileFormat AVRO

// Create MySQL to Kite - Hive Job
create job --from 1 --to 4 --name mysql2kitehiveparquet
--from-fromJobConfig-tableName test --to-toJobConfig-uri
dataset:hive:tmp/parquet --to-toJobConfig-fileFormat PARQUET

// Create Kive - Hive to MySQL
create job --from 4 --to 1 --name kitehiveavro2mysql
--from-fromJobConfig-uri dataset:hive:tmp/avro --to-toJobConfig-tableName
test

// Create Kive - Hive to MySQL
create job --from 4 --to 1 --name kitehiveparquet2mysql
--from-fromJobConfig-uri dataset:hive:tmp/parquet
--to-toJobConfig-tableName test

// Create Kive - HDFS to MySQL
create job --from 3 --to 1 --name kitehdfsavro2mysql
--from-fromJobConfig-uri dataset:hdfs:/tmp/sqoop2/kite/avro
--to-toJobConfig-tableName test

// Create Kive - HDFS to MySQL
create job --from 3 --to 1 --name kitehdfsparquet2mysql
--from-fromJobConfig-uri dataset:hdfs:/tmp/sqoop2/kite/parquet
--to-toJobConfig-tableName test

On Tue, Apr 7, 2015 at 11:51 PM, Zhou, Richard <richard.zhou@intel.com>
wrote:

> Sorry for the typo in the email subject.
>
>
> Regards
> Richard
>
> -----Original Message-----
> From: Zhou, Richard [mailto:richard.zhou@intel.com]
> Sent: Wednesday, April 08, 2015 2:48 PM
> To: dev@sqoop.apache.org
> Subject: [VOTE] Release Sqoop version 1.99.1
>
> Hi all Sqoop developers,
>
> This is the first cut of Sqoop 2 branch, version 1.99.6. There are 3
> purposes of this release:
>
>    - Role Based Access Control (
> https://issues.apache.org/jira/browse/SQOOP-1763 )
>    - Making the Rest API backwards compatible (
> https://issues.apache.org/jira/browse/SQOOP-2162 )
>    - Fixing Sqoop2 upgrade path (
> https://issues.apache.org/jira/browse/SQOOP-1841 )
>
> *** Please cast your vote by Friday 2015-4-12 ***
>
> The list of fixed issues:
>
> https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=commitdiff;h=2ee73c2810ec99be7c37f2823bd6c2a2ba347f3c
>
> The tarball (*.tar.gz), signature (*.asc), checksum (*.md5, *.sha):
> http://people.apache.org/~abe/sqoop/releases/1.99.6/
>
> The tag to be voted upon:
>
> https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=tag;h=refs/tags/release-1.99.6-rc0
>
> The KEYS file:
> http://www.apache.org/dist/sqoop/KEYS
>
> Thanks Abe for the great support to make it happen.
>
>
> Regards
> Richard
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message