spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ankur Jain <ankur.j...@yash.com>
Subject RE: Machine Learning in Spark 1.6 vs Spark 2.0
Date Mon, 09 Jan 2017 16:36:51 GMT

Thanks Rezaul…

Is Spark 2.1.0 still have any issues w.r.t. stability?

Regards,
Ankur

From: Md. Rezaul Karim [mailto:rezaul.karim@insight-centre.org]
Sent: Monday, January 09, 2017 5:02 PM
To: Ankur Jain <ankur.jain@yash.com>
Cc: user@spark.apache.org
Subject: Re: Machine Learning in Spark 1.6 vs Spark 2.0

Hello Jain,
I would recommend using Spark MLlib <http://spark.apache.org/docs/latest/ml-guide.html>
(and ML) of Spark 2.1.0 with the following features:

  *   ML Algorithms: common learning algorithms such as classification, regression, clustering,
and collaborative filtering
  *   Featurization: feature extraction, transformation, dimensionality reduction, and selection
  *   Pipelines: tools for constructing, evaluating, and tuning ML Pipelines
  *   Persistence: saving and load algorithms, models, and Pipelines
  *   Utilities: linear algebra, statistics, data handling, etc.
These features will help make your machine learning scalable and easy too.


Regards,
_________________________________
Md. Rezaul Karim, BSc, MSc
PhD Researcher, INSIGHT Centre for Data Analytics
National University of Ireland, Galway
IDA Business Park, Dangan, Galway, Ireland
Web: http://www.reza-analytics.eu/index.html<http://139.59.184.114/index.html>

On 9 January 2017 at 10:19, Ankur Jain <ankur.jain@yash.com<mailto:ankur.jain@yash.com>>
wrote:
Hi Team,

I want to start a new project with ML. But wanted to know which version of Spark is much stable
and have more features w.r.t ML
Please suggest your opinion…

Thanks in Advance…

[cid:image013.png@01D1AAE2.28F7BBF0]

Thanks & Regards
Ankur Jain
Technical Architect – Big Data | IoT | Innovation Group
Board: +91-731-663-6363<tel:+91%20731%20663%206363>
Direct: +91-731-663-6125<tel:+91%20731%20663%206125>
www.yash.com<http://www.yash.com/>
Follow YASH:

[cid:image002.png@01CF5E10.26C55CF0]<http://www.linkedin.com/company/yash-technologies>

[cid:image003.png@01CF5E10.26C55CF0]<http://twitter.com/YASH_Tech>

[cid:image004.png@01CF5E10.26C55CF0]<http://www.facebook.com/pages/YASH-Technologies/139932139377994>

[cid:image005.png@01CF5E10.26C55CF0]<https://plus.google.com/106560310768370862129/posts>

[cid:image006.png@01CF5E10.26C55CF0]<http://www.youtube.com/yashtechnologies>


 [Solutions-Architect-Associate]   [cid:image010.png@01D1AD0C.4AFA3760]       [GPTWF LOGO]

'Information transmitted by this e-mail is proprietary to YASH Technologies and/ or its Customers
and is intended for use only by the individual or entity to which it is addressed, and may
contain information that is privileged, confidential or exempt from disclosure under applicable
law. If you are not the intended recipient or it appears that this mail has been forwarded
to you without proper authority, you are notified that any use or dissemination of this information
in any manner is strictly prohibited. In such cases, please notify us immediately at info@yash.com<mailto:info@yash.com>
and delete this mail from your records.

'Information transmitted by this e-mail is proprietary to YASH Technologies and/ or its Customers
and is intended for use only by the individual or entity to which it is addressed, and may
contain information that is privileged, confidential or exempt from disclosure under applicable
law. If you are not the intended recipient or it appears that this mail has been forwarded
to you without proper authority, you are notified that any use or dissemination of this information
in any manner is strictly prohibited. In such cases, please notify us immediately at info@yash.com
and delete this mail from your records.
Mime
View raw message