hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gabor Bota <gabor.b...@cloudera.com.INVALID>
Subject Re: [VOTE] Release Apache Hadoop 3.1.4 (RC0)
Date Tue, 19 May 2020 09:36:30 GMT
Hi All,

Voting has ended with:
0 binding +1s
0 non-binding +1s (including mine)
0 binding -1s
0 non-binding -1s

I'm going to proceed and ask for you to vote another time on the RC1 soon.

Regards,
Gabor

On Wed, May 13, 2020 at 8:17 AM Mukund Madhav Thakur <mthakur@cloudera.com>
wrote:

> Yes , I have azure-auth-keys only. And abfs tests work fine in the current
> trunk branch with my same azure-auth-keys.xml file.
> Fyi:  I  am running mvn -T 1C -Dparallel-tests=abfs clean verify
> *One thing I noticed here is , in this branch there are no ABFS related
> classes.*
>
> @Gabor Bota <gabor.bota@cloudera.com>  I did the packaging of the release
> as well using
>
> mvn package -Pdist -DskipTests -Dmaven.javadoc.skip=true  -DskipShade
> and ran some hadoop fs commands as well. All good there.
>
> On Wed, May 13, 2020 at 9:10 AM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp> wrote:
>
>> > Also I am trying to run the abfs tests but all tests are getting skipped
>> > even if I think I have right auth-keys.xml. I will debug this and
>> update.
>>
>> hadoop-azure expects azure-auth-keys.xml instead of auth-keys.xml?
>> I think it should be consistent with other FS modules..
>>
>> Masatake Iwasaki
>>
>> On 2020/05/13 0:33, Mukund Madhav Thakur wrote:
>> > I compiled and ran s3 tests using
>> >
>> > mvn clean verify -Ds3guard -Ddynamo -Dauth. I see some failures. I ran
>> > these separately as well but it still fails for me.
>> >
>> >
>> > Also I am trying to run the abfs tests but all tests are getting skipped
>> > even if I think I have right auth-keys.xml. I will debug this and
>> update.
>> >
>> >
>> >
>> > [*ERROR*] *Failures: *
>> >
>> > [*ERROR*] *
>> >
>> ITestS3AMiscOperations.testEmptyFileChecksums:147->Assert.assertEquals:118->Assert.failNotEquals:743->Assert.fail:88
>> > checksums expected:<etag: "4eb50cc3151f8d174a2ff79a7c16277e"> but
>> > was:<etag: "cb190410cc285024b2066360c44c006a">*
>> >
>> > [*ERROR*] *
>> >
>> ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted:199->Assert.assertEquals:118->Assert.failNotEquals:743->Assert.fail:88
>> > checksums expected:<etag: "90d890f880e286b6d62534dfde5ce720"> but
>> > was:<etag: "e9181a730651153656d3570226667ef0">*
>> >
>> > [*INFO*]
>> >
>> > [*ERROR*] *Tests run: 12, Failures: 2, Errors: 0, Skipped: 0*
>> >
>> >
>> > [*ERROR*] *Errors: *
>> >
>> > [*ERROR*] *
>> >
>> ITestS3GuardToolDynamoDB.testDynamoDBInitDestroyCycle:224->AbstractS3GuardToolTestBase.exec:286->AbstractS3GuardToolTestBase.exec:308
>> > ยป AWSServiceIO*
>> >
>> >
>> >
>> >
>> > On Tue, May 5, 2020 at 11:48 PM Steve Loughran
>> <stevel@cloudera.com.invalid>
>> > wrote:
>> >
>> >> mvn -T 1  -Phadoop-3.2 -Dhadoop.version=3.1.4 -Psnapshots-and-staging
>> >> -Phadoop-cloud,yarn,kinesis-asl,yarn clean install -DskipTests
>> >>
>> >> Then a test run of the cloud bits
>> >>
>> >> mvn -T 1  -Phadoop-3.2 -Dhadoop.version=3.1.4 -Psnapshots-and-staging
>> >> -Phadoop-cloud,yarn,kinesis-asl test --pl hadoop-cloud
>> >>
>> >> And I got a guava binding stack trace (joy!)
>> >>
>> >>
>> >> CommitterBindingSuite:
>> >> *** RUN ABORTED ***
>> >>    java.lang.NoSuchMethodError:
>> >>
>> >>
>> com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
>> >>    at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357)
>> >>    at org.apache.hadoop.conf.Configuration.set(Configuration.java:1338)
>> >>    at
>> >> org.apache.spark.internal.io
>> >> .cloud.CommitterBindingSuite.newJob(CommitterBindingSuite.scala:89)
>> >>    at
>> >> org.apache.spark.internal.io
>> >>
>> .cloud.CommitterBindingSuite.$anonfun$new$1(CommitterBindingSuite.scala:55)
>> >>    at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85)
>> >>    at org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83)
>> >>    at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
>> >>    at org.scalatest.Transformer.apply(Transformer.scala:22)
>> >>    at org.scalatest.Transformer.apply(Transformer.scala:20)
>> >>    at org.scalatest.FunSuiteLike$$anon$1.apply(FunSuiteLike.scala:186)
>> >>    ...
>> >>
>> >> Fix: spark's guava version needs to be bumped up. There's a bigger
>> patch
>> >> for that, but I've got a minor PR which lets someone change it on the
>> maven
>> >> CLI to match the hadoop version, e.g. -Dguava.version=27.0-jre
>> >>
>> >> https://issues.apache.org/jira/browse/SPARK-31644
>> >>
>> >> There's nothing which can be done except highlight to all that this has
>> >> happened and what that stack trace means.
>> >>
>> >> On Tue, 5 May 2020 at 02:08, Wei-Chiu Chuang
>> <weichiu@cloudera.com.invalid
>> >> wrote:
>> >>
>> >>> Gabor, I'm sorry there's a test failure in branch-3.1 HDFS-14599
>> >>> <https://issues.apache.org/jira/browse/HDFS-14599>
>> >>>
>> >>>     1.
>> >>>        1. I just cherrypicked the fix to branch-3.2 branch-3.1. It's
a
>> >> test
>> >>>        only fix so technically I could live with it. But it would be
>> best
>> >>> to add
>> >>>        the fix to 3.1.4 as well.
>> >>>
>> >>>
>> >>> On Mon, May 4, 2020 at 3:20 PM Gabor Bota <gabota@apache.org>
wrote:
>> >>>
>> >>>> Hi folks,
>> >>>>
>> >>>> I have put together a release candidate (RC0) for Hadoop 3.1.4.
>> >>>>
>> >>>> The RC is available at:
>> >>> http://people.apache.org/~gabota/hadoop-3.1.4-RC0/
>> >>>> The RC tag in git is here:
>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC0
>> >>>> The maven artifacts are staged at
>> >>>>
>> >>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1266/
>> >>>> You can find my public key at:
>> >>>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>> >>>> and
>> http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
>> >>>>
>> >>>> Please try the release and vote. The vote will run for 5 weekdays,
>> >>>> until May 11. 2020. 23:00 CET.
>> >>>>
>> >>>> Thanks,
>> >>>> Gabor
>> >>>>
>> >>>> ---------------------------------------------------------------------
>> >>>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> >>>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >>>>
>> >>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>
>>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message