spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tvas <>
Subject Spark and Stanford CoreNLP
Date Mon, 24 Nov 2014 15:46:04 GMT

I was wondering if anyone has gotten the Stanford CoreNLP Java library to
work with Spark.

My attempts to use the parser/annotator fail because of task serialization
errors since the class 
StanfordCoreNLP cannot be serialized.

I've tried the remedies of registering StanfordCoreNLP through kryo, as well
as using chill.MeatLocker,
but these still produce serialization errors.
Passing the StanfordCoreNLP object as transient leads to a
NullPointerException instead.

Has anybody managed to get this work?


View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message