spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adline Dsilva <>
Subject RE: Anyone got a good solid example of integrating Spark and Solr
Date Wed, 14 Sep 2016 15:00:18 GMT
    Take a look into . this support authentication
with kerberized solr. Unfortunately this implementation has support from solr 5.x+. and CDH
has Solr 4.x. One option is to use Apache Solr 6.X with CDH.

Sent from Mail<> for Windows 10

From: Nkechi Achara<>
Sent: Wednesday, September 14, 2016 7:52 PM
Subject: Anyone got a good solid example of integrating Spark and Solr

Hi All,

I am trying to find some good examples on how to implement Spark and Solr and coming up blank.
Basically the implementation of spark-solr does not seem to work correctly with CDH 552 (*1.5.x
branch) where i am receiving various issues relating to dependencies, which I have not been
fully able to unravel.

I have also attempted to implement a custom solution, where i copy the token and jaas to each
executor, and set the necessary auth Properties, but this still is prone to failure due to
serialization, and kerberos auth issues.

Has anyone got an example of an implementation of querying solr in a distributed way where
kerberos is involved?




This e-mail (including any attachments) is for the addressee(s) only and may be confidential,
especially as regards personal data. If you are not the intended recipient, please note that
any dealing, review, distribution, printing, copying or use of this e-mail is strictly prohibited.
If you have received this email in error, please notify the sender immediately and delete
the original message (including any attachments).

MIMOS Berhad is a research and development institution under the purview of the Malaysian
Ministry of Science, Technology and Innovation. Opinions, conclusions and other information
in this e-mail that do not relate to the official business of MIMOS Berhad and/or its subsidiaries
shall be understood as neither given nor endorsed by MIMOS Berhad and/or its subsidiaries
and neither MIMOS Berhad nor its subsidiaries accepts responsibility for the same. All liability
arising from or in connection with computer viruses and/or corrupted e-mails is excluded to
the fullest extent permitted by law.

View raw message