spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mich Talebzadeh <>
Subject Creating docker images for Data Science
Date Sat, 14 Aug 2021 06:46:52 GMT
Hi all,

I am intending to create a docker image with Python 3.1.1 and Java 8 to
include Python libraries  for Data Science. Other versions with Java 11
will come later. The build process is automated with specific dockerfiles
for different purposes.

I am intending to install the following packages as first cut. The aim is
to eventually release these docker images as part of spark docker and
Kubernetes offerings. The medium to be released whether it be Spark
download site or other docker image maintainers to be decided and agreed.

Anyway these are the packages I am proposing to add for now:

   1. PyTorch
   2. Caffe
   3. TensorFlow
   4. Theano
   5. Pandas
   6. Keras
   7. NumPy
   8. SciPy
   9. Scrapy
   10. SciKit-Learn
   11. XGBoost
   12. Matplotlib
   13. Seaborn
   14. Bokeh
   15. Plotly
   16. pydot
   17. Statsmodels

Please suggest if you want another package to be added.



   view my Linkedin profile

*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.

View raw message