kudu-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aw...@apache.org
Subject kudu git commit: KUDU-2470: retry failed thirdparty downloads
Date Mon, 11 Jun 2018 20:37:36 GMT
Repository: kudu
Updated Branches:
  refs/heads/master 382ee1206 -> 37f3a95d8

KUDU-2470: retry failed thirdparty downloads

Currently we re-download when we fail to open thirdparty archives that
fail to read. We don't currently re-attempt to download if the download
itself fails. This patch adds the behavior to download failures, using
curl's built-in --retry option that exponentially backs off on failure.

Change-Id: Ia57dd9640d732a75659ca11763d89aefdaf16be1
Reviewed-on: http://gerrit.cloudera.org:8080/10684
Reviewed-by: Adar Dembo <adar@cloudera.com>
Tested-by: Kudu Jenkins

Project: http://git-wip-us.apache.org/repos/asf/kudu/repo
Commit: http://git-wip-us.apache.org/repos/asf/kudu/commit/37f3a95d
Tree: http://git-wip-us.apache.org/repos/asf/kudu/tree/37f3a95d
Diff: http://git-wip-us.apache.org/repos/asf/kudu/diff/37f3a95d

Branch: refs/heads/master
Commit: 37f3a95d8e20ca73f34b21c9d3fe1c25e2e4f66d
Parents: 382ee12
Author: Andrew Wong <awong@cloudera.com>
Authored: Mon Jun 11 10:27:44 2018 -0700
Committer: Andrew Wong <awong@cloudera.com>
Committed: Mon Jun 11 20:27:48 2018 +0000

 thirdparty/download-thirdparty.sh | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/thirdparty/download-thirdparty.sh b/thirdparty/download-thirdparty.sh
index ef6e2f5..0ad768e 100755
--- a/thirdparty/download-thirdparty.sh
+++ b/thirdparty/download-thirdparty.sh
@@ -73,7 +73,7 @@ fetch_and_expand() {
       echo "Archive $FILENAME already exists. Not re-downloading archive."
       echo "Fetching $FILENAME from $FULL_URL"
-      curl -L -O "$FULL_URL"
+      curl --retry 3 -L -O "$FULL_URL"
     echo "Unpacking $FILENAME to $SOURCE"

View raw message