spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From pratik4891 <>
Subject Spark pipeRDD vs ML
Date Mon, 14 Oct 2019 08:07:49 GMT
What I was wondering after reading about spark pipe RDD is that we can
execute any python code (including machine learning ) . The code is going to
execute in distributed manner as well.

So if we can run machine learning code in distributed manner with pipeRDD
what's the usefulness of Spark ML. Is there anything fundamental difference
between running a python ML code via spark pipeRDD vs Spark ML.

Sent from:

To unsubscribe e-mail:

View raw message