manifoldcf-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Karl Wright <daddy...@gmail.com>
Subject Re: Solr Output Connector: SolrCloud with Kerberos / Zookeeper with Kerberos
Date Wed, 18 Dec 2019 01:07:07 GMT
I just created a plugin directory at
https://svn.apache.org/repos/asf/manifoldcf/integration/solr-8.x/trunk .
Code committed there builds but it doesn't test properly because of the
following exception:

>>>>>>
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test (default-test)
on project apache-manifoldcf-solr-8.x-plugin: Execution default-test of
goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test failed:
There was an error in the forked process
[ERROR] org.apache.maven.surefire.util.SurefireReflectionException:
java.lang.ClassNotFoundException:
org.apache.maven.surefire.junit4.JUnit4Provider
[ERROR]         at
org.apache.maven.surefire.util.ReflectionUtils.loadClass(ReflectionUtils.java:252)
[ERROR]         at
org.apache.maven.surefire.util.ReflectionUtils.instantiateOneArg(ReflectionUtils.java:128)
[ERROR]         at
org.apache.maven.surefire.booter.ForkedBooter.createProviderInCurrentClassloader(ForkedBooter.java:230)
[ERROR]         at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:199)
[ERROR]         at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155)
[ERROR]         at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
[ERROR] Caused by: java.lang.ClassNotFoundException:
org.apache.maven.surefire.junit4.JUnit4Provider
[ERROR]         at
java.net.URLClassLoader.findClass(URLClassLoader.java:381)
[ERROR]         at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
[ERROR]         at
sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
[ERROR]         at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
[ERROR]         at
org.apache.maven.surefire.util.ReflectionUtils.loadClass(ReflectionUtils.java:244)
[ERROR]         ... 5 more
[ERROR]
<<<<<<

This is odd because the plugin depends on solr and solr has a transitive
maven dependency on junit.  I'll see if a direct dependency works...

Karl


On Tue, Dec 17, 2019 at 3:30 PM Jörn Franke <jornfranke@gmail.com> wrote:

> Here you find it: https://issues.apache.org/jira/browse/CONNECTORS-1629
> I will try it out this year I hope.
> I will try it though with Solr 8.3.1 and will take into account
> https://issues.apache.org/jira/browse/CONNECTORS-1586
>
> On Tue, Dec 17, 2019 at 1:09 PM Karl Wright <daddywri@gmail.com> wrote:
>
>> Please do!
>> Karl
>>
>>
>> On Tue, Dec 17, 2019 at 7:06 AM Jörn Franke <jornfranke@gmail.com> wrote:
>>
>>> Thanks a lot Karl for your feedback. Do you mind if I create a Jira
>>> where I report on the progress?
>>>
>>> Am 17.12.2019 um 12:22 schrieb Karl Wright <daddywri@gmail.com>:
>>>
>>> 
>>> Well, you can certainly attempt this simply enough then if you build
>>> from source.  I'd prefer that you validate the approach before we make
>>> permanent commits.
>>>
>>> Please let me know what works and what doesn't.
>>>
>>> Karl
>>>
>>>
>>> On Tue, Dec 17, 2019 at 1:22 AM Jörn Franke <jornfranke@gmail.com>
>>> wrote:
>>>
>>>> I agree.
>>>> The delegation part is not relevant for me. I also do not believe it
>>>> makes sense at the ETL level.
>>>>  I think still we need add the one line of code that allows to use
>>>> Kerberos (second line in the example).
>>>>
>>>> Am 17.12.2019 um 01:35 schrieb Karl Wright <daddywri@gmail.com>:
>>>>
>>>> 
>>>> Hi Jorn,
>>>>
>>>> The code referenced cannot be set up differently from connection to
>>>> connection so there is no point in having this be anything other than
>>>> global.  In that case you can point at the config file with
>>>> -D<parameter>=value and it will do the same thing as setting a system
>>>> property.
>>>>
>>>> The token delegation with HttpClient I'll have to study to confirm that
>>>> we're doing this right in the connector.
>>>>
>>>> Karl
>>>>
>>>>
>>>>
>>>> On Mon, Dec 16, 2019 at 6:15 PM Jörn Franke <jornfranke@gmail.com>
>>>> wrote:
>>>>
>>>>> Thanks a lot for the quick reply. Actually it is here:
>>>>> https://lucene.apache.org/solr/guide/8_3/kerberos-authentication-plugin.html#using-solrj-with-a-kerberized-solr
>>>>> It is also available in the previous versions of Solr.
>>>>> I wonder how easy it would be to add a configuration to the Manifold
>>>>> UI to point to a jaas-client.conf. However, it is also not strictly
>>>>> necessary that this one is configurable in the UI. It could be also a
>>>>> checkbox yes/no Kerberos authentication and the jaas-client.conf could
be
>>>>> put in a certain folder.
>>>>>
>>>>> Interesting would be also if Solr 8.x can be made work in this setting.
>>>>>
>>>>> On Mon, Dec 16, 2019 at 11:47 PM Karl Wright <daddywri@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> The Solr Output Connector uses a patched HttpComponents/HttpClient
>>>>>> for communication with the various Solr Cloud replicas, along with
custom
>>>>>> versions of some of the SolrJ classes which allow multipart posts
to work.
>>>>>> Other than that it's standard SolrJ.  Whatever SolrJ needs to work
with
>>>>>> Kerberos, therefore, should work with the ManifoldCF Solr Output
>>>>>> Connector.  So if you can point me at the SolrJ documentation for
this
>>>>>> configuration I can perhaps review it and give you my opinion as
to the
>>>>>> difficulty involved.
>>>>>>
>>>>>> Karl
>>>>>>
>>>>>>
>>>>>> On Mon, Dec 16, 2019 at 5:31 PM Jörn Franke <jornfranke@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hallo,
>>>>>>>
>>>>>>> does the Solr Output Connector support SolrCloud with Kerberos
>>>>>>> authentication and Zookeeper with Kerberos authentication?
>>>>>>>
>>>>>>> If so, how can this be configured?
>>>>>>>
>>>>>>> If it is not supported, is there an "easy" way to integrate this?
>>>>>>> From a development perspective the Kerberos Authentication with
both is not
>>>>>>> difficult to achieve, but of course it stil needs to be integrated
in the
>>>>>>> whole solution.
>>>>>>>
>>>>>>> Thank you.
>>>>>>>
>>>>>>> Best regards
>>>>>>>
>>>>>>

Mime
View raw message