Hi Chanh,

I found a workaround that works to me:
http://stackoverflow.com/questions/29552799/spark-unable-to-find-jdbc-driver/40114125#40114125

Regards,
Daniel

El jue., 6 oct. 2016 a las 6:26, Chanh Le (<giaosudau@gmail.com>) escribió:
Hi everyone,
I have the same config in both mode and I really want to change config whenever I run so I created a config file and run my application with it.
My problem is: 
It’s works with these config without using Mesos Cluster Dispatcher.

/build/analytics/spark-1.6.1-bin-hadoop2.6/bin/spark-submit \
--files /build/analytics/kafkajobs/prod.conf \
--conf 'spark.executor.extraJavaOptions=-Dconfig.fuction.conf' \
--conf 'spark.driver.extraJavaOptions=-Dconfig.file=/build/analytics/kafkajobs/prod.conf' \
--conf 'spark.driver.extraClassPath=/build/analytics/spark-1.6.1-bin-hadoop2.6/lib/postgresql-9.3-1102.jdbc41.jar' \
--conf 'spark.executor.extraClassPath=/build/analytics/spark-1.6.1-bin-hadoop2.6/lib/postgresql-9.3-1102.jdbc41.jar' \

--class com.ants.util.kafka.PersistenceData \
--master mesos://10.199.0.19:5050 \
--executor-memory 5G \
--driver-memory 2G \
--total-executor-cores 4 \
--jars /build/analytics/kafkajobs/spark-streaming-kafka_2.10-1.6.2.jar \
/build/analytics/kafkajobs/kafkajobs-prod.jar


And it’s didn't work with these:

/build/analytics/spark-1.6.1-bin-hadoop2.6/bin/spark-submit \
--files /build/analytics/kafkajobs/prod.conf \
--conf 'spark.executor.extraJavaOptions=-Dconfig.fuction.conf' \
--conf 'spark.driver.extraJavaOptions=-Dconfig.file=/build/analytics/kafkajobs/prod.conf' \
--conf 'spark.driver.extraClassPath=/build/analytics/spark-1.6.1-bin-hadoop2.6/lib/postgresql-9.3-1102.jdbc41.jar' \
--conf 'spark.executor.extraClassPath=/build/analytics/spark-1.6.1-bin-hadoop2.6/lib/postgresql-9.3-1102.jdbc41.jar' \

--class com.ants.util.kafka.PersistenceData \
--master mesos://10.199.0.19:7077 \
--deploy-mode cluster \
--supervise \

--executor-memory 5G \
--driver-memory 2G \
--total-executor-cores 4 \
--jars /build/analytics/kafkajobs/spark-streaming-kafka_2.10-1.6.2.jar \
/build/analytics/kafkajobs/kafkajobs-prod.jar

It threw me an error: Exception in thread "main" java.sql.SQLException: No suitable driver found for jdbc:postgresql://psqlhost:5432/kafkajobs
which means my —conf didn’t work and those config I put in /build/analytics/kafkajobs/prod.conf wasn’t loaded. It only loaded thing I put in application.conf (default config).

How to make MCD load my config?

Regards,
Chanh

--
Daniel Carroza Santana
Vía de las Dos Castillas, 33, Ática 4, 3ª Planta.
28224 Pozuelo de Alarcón. Madrid.
Tel: +34 91 828 64 73 // @stratiobd