hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sergio Peña (JIRA) <j...@apache.org>
Subject [jira] [Commented] (HIVE-14735) Build Infra: Spark artifacts download takes a long time
Date Tue, 06 Dec 2016 21:53:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726831#comment-15726831
] 

Sergio Peña commented on HIVE-14735:
------------------------------------

[~kgyrtkirk] This prototype works pretty good when downloading the file. I like it.
Let's continue working on this to use it as replacement of the shell script.

A few comments:

* Could you use a variable for the plugin version? You can find them on the root pom.xml
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-dependency-plugin</artifactId>
<version>2.10</version>

* is the 'target/download.sh' needed now? We can keep only the log4j2.properties. The log
cannot be packed into the artifact because it might be edited by other Hive developers.

* How do you generate the new artifacts? We should write a README for this.

* Where is the file downloaded? I see this {{${project.build.directory}/spark}}, but I don't
find it. Can you use the original thirdparty directory instead?

> Build Infra: Spark artifacts download takes a long time
> -------------------------------------------------------
>
>                 Key: HIVE-14735
>                 URL: https://issues.apache.org/jira/browse/HIVE-14735
>             Project: Hive
>          Issue Type: Bug
>          Components: Build Infrastructure
>            Reporter: Vaibhav Gumashta
>            Assignee: Zoltan Haindrich
>         Attachments: HIVE-14735.1.patch, HIVE-14735.1.patch, HIVE-14735.1.patch, HIVE-14735.1.patch,
HIVE-14735.2.patch
>
>
> In particular this command:
> {{curl -Sso ./../thirdparty/spark-1.6.0-bin-hadoop2-without-hive.tgz http://d3jw87u4immizc.cloudfront.net/spark-tarball/spark-1.6.0-bin-hadoop2-without-hive.tgz}}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message