spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jörn Franke <jornfra...@gmail.com>
Subject Re: [VOTE] [SPARK-24615] SPIP: Accelerator-aware Scheduling
Date Tue, 19 Mar 2019 19:17:30 GMT
Also on AWS and probably some more cloud providers 

> Am 19.03.2019 um 19:45 schrieb Steve Loughran <stevel@cloudera.com.invalid>:
> 
> 
> you might want to look at the work on FPGA resources; again it should just be a resource
available by a scheduler. Key thing is probably just to keep the docs generic
> 
> https://hadoop.apache.org/docs/r3.1.0/hadoop-yarn/hadoop-yarn-site/UsingFPGA.html
> 
> I don't know where you get those FPGAs to play with; the Azure ML stuff looks like the
kind of thing to think about though: https://docs.microsoft.com/en-us/azure/machine-learning/service/concept-accelerate-with-fpgas

Mime
View raw message