spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bo zhaobo <bzhaojyathousa...@gmail.com>
Subject Re: Ask for ARM CI for spark
Date Fri, 15 Nov 2019 03:25:14 GMT
Hi,

And I found Spark-3.0.0-preview had released, but there is no releasenotes
in [1]. So how about to add support ARM notes in the next
releasenotes(maybe the releasenotes of Spark-3.0.0-preview). So sorry to
raise this, I'm not familiar with this, if any bad from me please feel free
to correct.
Moreover, since the daily job has been stablely running for few weeks,
probably we can say that the release have some basic ARM support in the
next release note.
>From OpenSource project and Open Source eco system, this is a good chance
to tell peoples that Spark support ARM and support cross platforms. As
Spark can support more ARCH platforms, this is good to attract more users
to use Spark, eventhough they cannot use X86 in other uncontrollable
reasons.

[1]  https://github.com/apache/spark-website/tree/asf-site/releases/_posts



[image: Mailtrack]
<https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
Sender
notified by
Mailtrack
<https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
19/11/15
上午11:16:28

bo zhaobo <bzhaojyathousandy@gmail.com> 于2019年11月15日周五 上午11:00写道:

> Hi @Sean Owen <srowen@gmail.com> ,
>
> Thanks for reply. We know that Spark community has own release date and
> plan. We are happy to follow Spark community. But we think it's great if
> community could add a sentence into the next releasenotes and claim "Spark
> can support Arm from this release." after we finish the test work on ARM.
> That's all. We just want a community official caliber that spark support
> ARM for attracting more users to use spark.
>
> Thank you very much for your patient.
>
> BR
>
> ZhaoBo
>
>
> [image: Mailtrack]
> <https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
Sender
> notified by
> Mailtrack
> <https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
19/11/15
> 上午10:59:29
>
> Tianhua huang <huangtianhua223@gmail.com> 于2019年11月15日周五 上午10:25写道:
>
>> @Sean,
>> Yes, you are right, we don't have to create a separate release of Spark
>> for ARM, it's enough to add a releasenote to say that Spark supports
>> arm architecture.
>> About the test failure, one or two tests will timeout on our poor
>> performance arm instance sometimes, now we donate a high performance arm
>> instance to amplab, and wait shane to build the jobs on it.
>>
>> On Fri, Nov 15, 2019 at 10:13 AM Sean Owen <srowen@gmail.com> wrote:
>>
>>> I don't quite understand. You are saying tests don't pass yet, so why
>>> would anyone yet run these tests regularly?
>>> If it's because the instances aren't fast enough, use bigger instances?
>>> I don't think anyone would create a separate release of Spark for ARM,
>>> no. But why would that be necessary?
>>>
>>> On Thu, Nov 14, 2019 at 7:28 PM bo zhaobo <bzhaojyathousandy@gmail.com>
>>> wrote:
>>>
>>>> Hi Spark team,
>>>>
>>>> Any ideas about the above email? Thank you.
>>>>
>>>> BR
>>>>
>>>> ZhaoBo
>>>>
>>>>
>>>> [image: Mailtrack]
>>>> <https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
Sender
>>>> notified by
>>>> Mailtrack
>>>> <https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
19/11/15
>>>> 上午09:26:17
>>>>
>>>> Tianhua huang <huangtianhua223@gmail.com> 于2019年11月12日周二
下午2:47写道:
>>>>
>>>>> Hi all,
>>>>>
>>>>> Spark arm jobs have built for some time, and now there are two jobs[1]
>>>>> spark-master-test-maven-arm
>>>>> <https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-arm/>
>>>>> and spark-master-test-python-arm
>>>>> <https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-python-arm/>,
>>>>> we can see there are some build failures, but it because of the poor
>>>>> performance of the arm instance, and now we begin to build spark arm
jobs
>>>>> on other high performance instances, and the build/test are all success,
we
>>>>> plan to donate the instance to amplab later.  According to the build
>>>>> history, we are very happy to say spark is supported on aarch64 platform,
>>>>> and I suggest to add this good news into spark-3.0.0 releasenotes. Maybe
>>>>> community could provide an arm-supported release of spark at the meanwhile?
>>>>>
>>>>> [1]
>>>>> https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-arm/
>>>>>
>>>>>
>>>>> https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-python-arm/
>>>>>
>>>>>
>>>>> ps: the jira https://issues.apache.org/jira/browse/SPARK-29106 trace
>>>>> the whole work, thank you very much Shane:)
>>>>>
>>>>

Mime
View raw message