samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeremiah Adams <JAd...@helixeducation.com>
Subject Re: Open JDK 11 Early Results
Date Tue, 02 Oct 2018 18:55:01 GMT
I am trying both building from the (Samza) source and attempting to run the pre-built binaries.
YARN is a blocker  as nodemanager/resourcemanager will not run at all. It is an issue with
Java11 removing J2EE artifacts. I will be sending the yarn-dev group a message regarding the
problem. I also didn't see anything about Java11 in YARN's JIRA.

I've had no traction with YARN as of yet. Zookeeper devs fixed the tests that were broken
in Java 11 and will go out in some future release. Kafka has JIRA tasks for supporting Java11.
https://issues.apache.org/jira/browse/KAFKA-7264?jql=project%20%3D%20KAFKA%20AND%20text%20~%20%22java%2011%22



Jeremiah Adams
Software Engineer
www.helixeducation.com
Blog | Twitter | Facebook | LinkedIn

________________________________________
From: Yi Pan <nickpan47@gmail.com>
Sent: Tuesday, October 2, 2018 11:16 AM
To: dev@samza.apache.org
Subject: Re: Open JDK 11 Early Results

Hi, Jeremiah,

Thanks for the detailed report! Really appreciate it!

So, from the report, it seems that we need to track the issues separately:
1) OpenJDK 11 with YARN (xxx version is to be determined pending feature
and backward compatibility tests)
2) OpenJDK 11 with Kafka (xxx version  is to be determined pending feature
and backward compatibility tests)
3) Samza gradle build failed with OpenJDK 11

Questions:
1) When you are doing the YARN/Kafka + OpenJDK11 tests, are you just using
OpenJDK 11 JVM to run the binaries? Have you tried to build from the source
code?
2) I am curious what other open source projects' strategy on OpenJDK11? Or
are all the other communities decide to pay Oracle for JE 11? In YARN JIRA
board, I can only find a few tickets with OpenJDK 7 or 8. Are AYRN and
Kafka community only supporting OpenJDK 7 and 8 now?

-Yi

On Mon, Oct 1, 2018 at 3:43 PM Jeremiah Adams <JAdams@helixeducation.com>
wrote:

> Samza master branch does not build on Open JDK 11. It fails with a Gradle
> issue. Opened an issue with Gradle here:
> https://url.emailprotection.link/?aZyQRg2CGut2qgyHrdHxA3qV_YdEkDcofcS3Ip-n59fO1mYzzqT_kSmrqYWJKqnJe-eAyIfh5joJFOTohULoTkQ~~
>
> ”Could not determine java version from '11'.”
>
> I Tried running all the dependencies in Hello-Samza via Grid. Yarn behaved
> as I expected and did not start. It is likely that Yarn is the biggest
> risk.
>
> Hadoop-2.6.1 - does not start on Open JDK 11
> Kafka-2.11-0.10.2.1 - does not start on Open JDK 11
> Zookeeper-3.4.3 - starts on Open JDK 11
>
>
> I updated Grid to recent versions and Yarn continued to misbehave:
>
> Hadoop: 3.1.1 - Does not start on Open JDK 11
> Kafka: - 2.11-2.0.0 - Starts on Open JDK 11
> Zookeeper: 3.4.13 - Starts on Open JDK 11
>
> I can’t really test anything interesting until Yarn can play nice on JDK
> 11.
>
>
>
> Jeremiah Adams
> Software Engineer
> https://url.emailprotection.link/?ahfhEufaAWbezBrUFPG98ZJcterGfIerU3ZwsA3Gv_C0~
> Blog | Twitter | Facebook | LinkedIn
>
> ________________________________________
> From: Yi Pan <nickpan47@gmail.com>
> Sent: Tuesday, September 25, 2018 9:09 AM
> To: dev@samza.apache.org
> Subject: Re: Java 11, Oracle Java and OpenJDK Release Cadence
>
> Hey, Jeremiah,
>
> Sorry to reply late. The team is pretty busy for Samza 1.0 preparation
> these days.
>
> Regarding to Java 11 and the steps forward:
> 1. I don't have objection to adopt OpenJDK, as long as Samza code and
> compile and run on it. It might be an interesting issue since Samza also
> depends on other open source projects (like ZooKeeper and Kafka) which may
> not be test w/ OpenJDK yet.
> 2. It would be great if you can have some test build/run of Samza with Java
> 11 (I assume with OpenJDK?) and report the results back to the community
> 3. We can start a formal poll and vote when we know what it takes to adopt
> OpenJDK
>
> Does that sound good to you? Thanks!
>
> -Yi
>
>

Mime
View raw message