spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chen YongHua <chenyong...@live.com>
Subject Re: SPIP: Spark on Kubernetes
Date Wed, 23 Aug 2017 08:51:34 GMT
Sorry, I read the Dockerfile, the example's path is in the image, I'll try it again

获取 Outlook for iOS<https://aka.ms/o0ukef>
________________________________
From: Chen YongHua <chenyonghua@live.com>
Sent: Wednesday, August 23, 2017 4:40:55 PM
To: yonzhang2012; dev@spark.apache.org
Subject: Re: SPIP: Spark on Kubernetes

I run the example in k8s environment based on vagrant. The driver pod report error:
Error: Could not find or load man class org.apache.spark.examples.SparkPi.

Use local mode.

获取 Outlook for iOS<https://aka.ms/o0ukef>
________________________________
From: yonzhang2012 <yonzhang2012@apache.org>
Sent: Wednesday, August 23, 2017 5:47:16 AM
To: dev@spark.apache.org
Subject: Re: SPIP: Spark on Kubernetes

+1 (non-binding)

I am specifically interested in setting up testing environment for my
company's Spark use and also expecting more comprehensive documents on
getting development env setup in case of bug fix or new feature development,
now it is only briefly documented in
https://github.com/apache-spark-on-k8s/spark/blob/branch-2.2-kubernetes/resource-managers/kubernetes/README.md.
I myself tried running this SPIP in local box with integration-test(one of
them) on minikube, and was able to debug remotely with the
KubernetesClusterManager related code in Spark driver pod, which means whole
development lifecycle can be done, but hope developer guide can have more
information.

Thanks
Edward Zhang



--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/SPIP-Spark-on-Kubernetes-tp22147p22210.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org

Mime
View raw message