spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bo zhaobo <bzhaojyathousa...@gmail.com>
Subject Re: Ask for ARM CI for spark
Date Fri, 15 Nov 2019 03:00:29 GMT
Hi @Sean Owen <srowen@gmail.com> ,

Thanks for reply. We know that Spark community has own release date and
plan. We are happy to follow Spark community. But we think it's great if
community could add a sentence into the next releasenotes and claim "Spark
can support Arm from this release." after we finish the test work on ARM.
That's all. We just want a community official caliber that spark support
ARM for attracting more users to use spark.

Thank you very much for your patient.

BR

ZhaoBo


[image: Mailtrack]
<https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
Sender
notified by
Mailtrack
<https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
19/11/15
上午10:59:29

Tianhua huang <huangtianhua223@gmail.com> 于2019年11月15日周五 上午10:25写道:

> @Sean,
> Yes, you are right, we don't have to create a separate release of Spark
> for ARM, it's enough to add a releasenote to say that Spark supports
> arm architecture.
> About the test failure, one or two tests will timeout on our poor
> performance arm instance sometimes, now we donate a high performance arm
> instance to amplab, and wait shane to build the jobs on it.
>
> On Fri, Nov 15, 2019 at 10:13 AM Sean Owen <srowen@gmail.com> wrote:
>
>> I don't quite understand. You are saying tests don't pass yet, so why
>> would anyone yet run these tests regularly?
>> If it's because the instances aren't fast enough, use bigger instances?
>> I don't think anyone would create a separate release of Spark for ARM,
>> no. But why would that be necessary?
>>
>> On Thu, Nov 14, 2019 at 7:28 PM bo zhaobo <bzhaojyathousandy@gmail.com>
>> wrote:
>>
>>> Hi Spark team,
>>>
>>> Any ideas about the above email? Thank you.
>>>
>>> BR
>>>
>>> ZhaoBo
>>>
>>>
>>> [image: Mailtrack]
>>> <https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
Sender
>>> notified by
>>> Mailtrack
>>> <https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
19/11/15
>>> 上午09:26:17
>>>
>>> Tianhua huang <huangtianhua223@gmail.com> 于2019年11月12日周二 下午2:47写道:
>>>
>>>> Hi all,
>>>>
>>>> Spark arm jobs have built for some time, and now there are two jobs[1]
>>>> spark-master-test-maven-arm
>>>> <https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-arm/>
>>>> and spark-master-test-python-arm
>>>> <https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-python-arm/>,
>>>> we can see there are some build failures, but it because of the poor
>>>> performance of the arm instance, and now we begin to build spark arm jobs
>>>> on other high performance instances, and the build/test are all success,
we
>>>> plan to donate the instance to amplab later.  According to the build
>>>> history, we are very happy to say spark is supported on aarch64 platform,
>>>> and I suggest to add this good news into spark-3.0.0 releasenotes. Maybe
>>>> community could provide an arm-supported release of spark at the meanwhile?
>>>>
>>>> [1]
>>>> https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-arm/
>>>>
>>>> https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-python-arm/
>>>>
>>>>
>>>> ps: the jira https://issues.apache.org/jira/browse/SPARK-29106 trace
>>>> the whole work, thank you very much Shane:)
>>>>
>>>

Mime
View raw message