manifoldcf-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Karl Wright <daddy...@gmail.com>
Subject Re: Using Active Directory
Date Thu, 20 Oct 2011 07:52:54 GMT
Glad to hear it worked out.  Sounds like the problem was some
underlying issue in Solr.

Karl

On Thu, Oct 20, 2011 at 1:12 AM, Swapna Vuppala
<swapna.kollipara@gmail.com> wrote:
> Hi Karl,
>
> Finally it is working for me. I had been working for quite some time on the
> same index of Solr, modifying the schema.xml but indexing same docs again
> and again with modified schema.
>
> When I cleaned up previous index and indexed afresh using the schema with
> all the required changes, it is working for me.
>
> Am able to get the search results appropriate to the user I specify, with
> the ManifoldCFSecurity search component hooked up.
>
> Thanks a lot everyone for helping me out on this.
>
> Thanks and Regards,
> Swapna.
>
> On Wed, Oct 19, 2011 at 1:30 PM, daddywri@gmail.com <daddywri@gmail.com>
> wrote:
>>
>> Hi,
>>
>> What has possibly happened is that you have apparently not set the proper
>> default values for the solr fields involved in security.  The default value
>> for each field is required because that is how the component determines that
>> the field has 'no value' for the field.
>>
>> Can you paste the security field definitions from schema.xml so i can
>> confirm.
>>
>> Karl
>>
>> Sent from my Nokia phone
>> -----Original Message-----
>> From: Swapna Vuppala
>> Sent:  19/10/2011, 3:30  AM
>> To: connectors-user@incubator.apache.org
>> Subject: Re: Using Active Directory
>>
>>
>> Hi,
>>
>> I used the Authority Connection while defining Windows Share connection
>> (did
>> not configure it as None).
>>
>> Regarding the tokens, the document am interested/expected to appear in the
>> search results has got 4 values for the field allow_token_document, out of
>> which only two values are present in the tokens obtained from the request
>> curl "
>> http://localhost:8345/mcf-authority-service/UserACLs?username=user@domain"
>>
>> Is this an issue or what is expected behavior ?? How are the search
>> results
>> of solr filtered with this new search component ?
>>
>> Thanks and Regards,
>> Swapna.
>>
>>
>> On Wed, Oct 19, 2011 at 11:51 AM, Shinichiro Abe
>> <shinichiro.abe.1@gmail.com
>> > wrote:
>>
>> > Hi,
>> >
>> > Probably you configured Authority:None at Type tab in your windows
>> > shares
>> > connection.
>> > You should select your authority connection and restart the job.
>> >
>> > If you already set correctly, you need to compare tokens of document
>> > with
>> > tokens of userACL given by the request:
>> > curl "
>> >
>> > http://localhost:8345/mcf-authority-service/UserACLs?username=user@domain"
>> >
>> > Regards,
>> > Shinichiro Abe
>> >
>> > On 2011/10/18, at 17:26, Swapna Vuppala wrote:
>> >
>> > > Hi,
>> > >
>> > > Thanks for pointing this. With the steps you suggested, Solr starts
>> > > fine
>> > and there are no exceptions.
>> > >
>> > > However, I have some trouble while searching in Solr.
>> > >
>> > > When the solrconfig.xml is not using ManifoldCFSecurity search
>> > > component,
>> > the search results in Solr are coming as expected.
>> > >
>> > > When the solrconfig.xml is using this search component, am getting
>> > > zero
>> > responses for any query (with or without adding AuthenticatedUserName=
>> > Swapna.Vuppala@global.arup.com for the query string)
>> > >
>> > > Can you please suggest as to how to get over this issue ?
>> > >
>> > > Thanks and Regards,
>> > > Swapna.
>> > >
>> > > On Tue, Oct 18, 2011 at 12:44 PM, Shinichiro Abe <
>> > shinichiro.abe.1@gmail.com> wrote:
>> > > Hi.
>> > >
>> > > You need to place apache-solr-mcf-3.x.jar into lib directory of solr
>> > home.
>> > > And add a line to the solrconfig.xml file
>> > > that declares this directory as a place to look for jars: <lib
>> > dir="./lib"/>
>> > >
>> > > Regards,
>> > > Shinichiro Abe
>> > >
>> > > On 2011/10/18, at 15:02, Swapna Vuppala wrote:
>> > >
>> > > > Hi,
>> > > >
>> > > > I got the latest code from
>> > https://svn.apache.org/repos/asf/incubator/lcf/trunk , built it and
>> > modified solrconfig.xml to add a search component "manifoldCFSecurity"
>> > and
>> > use it in the search handler.
>> > > >
>> > > > But with this setup, I get errors when I start Solr as :
>> > > > org.apache.solr.common.SolrException: Error loading class
>> > 'org.apache.solr.mcf.ManifoldCFSearchComponent' at
>> >
>> > org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:389)
>> > at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:423) at
>> > org.apache.solr.core.SolrCore.createInitInstance(SolrCore.java:445) at
>> > org.apache.solr.core.SolrCore.initPlugins(SolrCore.java:1553) at
>> > org.apache.solr.core.SolrCore.initPlugins(SolrCore.java:1547) at
>> > org.apache.solr.core.SolrCore.initPlugins(SolrCore.java:1580) at
>> > org.apache.solr.core.SolrCore.loadSearchComponents(SolrCore.java:854) at
>> > org.apache.solr.core.SolrCore.<init>(SolrCore.java:558) at
>> > org.apache.solr.core.CoreContainer.create(CoreContainer.java:463) at
>> > org.apache.solr.core.CoreContainer.load(CoreContainer.java:316) at
>> > org.apache.solr.core.CoreContainer.load(CoreContainer.java:207) at
>> >
>> > org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:130)
>> > at
>> >
>> > org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:94)
>> > at
>> >
>> > org.apache.catalina.core.ApplicationFilterConfig.initFilter(ApplicationFilterConfig.java:273)
>> > at
>> >
>> > org.apache.catalina.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java:254)
>> > at
>> >
>> > org.apache.catalina.core.ApplicationFilterConfig.setFilterDef(ApplicationFilterConfig.java:372)
>> > at
>> >
>> > org.apache.catalina.core.ApplicationFilterConfig.<init>(ApplicationFilterConfig.java:98)
>> >   at
>> >
>> > org.apache.catalina.core.StandardContext.filterStart(StandardContext.java:4584)
>> > at
>> >
>> > org.apache.catalina.core.StandardContext$2.call(StandardContext.java:5262)
>> > at
>> >
>> > org.apache.catalina.core.StandardContext$2.call(StandardContext.java:5257)
>> > at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at
>> > java.util.concurrent.FutureTask.run(Unknown Source) at
>> > java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at
>> > java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at
>> > java.lang.Thread.run(Unknown Source) Caused by:
>> > java.lang.ClassNotFoundException:
>> > org.apache.solr.mcf.ManifoldCFSearchComponent at
>> > > >
>> > > > Have I missed any steps ?? What else should I be doing for Solr
>> > Integration ??
>> > > >
>> > > > Thanks and Regards,
>> > > > Swapna.
>> > > >
>> > > > On Fri, Oct 14, 2011 at 2:53 PM, Swapna Vuppala <
>> > swapna.kollipara@gmail.com> wrote:
>> > > > Thanks a lot for the info Shinichiro Abe, I'll look into it.
>> > > >
>> > > > Thanks and Regards,
>> > > > Swapna.
>> > > >
>> > > >
>> > > > On Fri, Oct 14, 2011 at 2:21 PM, Shinichiro Abe <
>> > shinichiro.abe.1@gmail.com> wrote:
>> > > > Hi.
>> > > >
>> > > > If you can use ManifoldCF 0.4 trunk,
>> > > > you can use solr integration components.
>> > > > Recently the plugin is added.
>> > > >
>> > > > Please see:
>> > > >
>> >
>> > http://svn.apache.org/repos/asf/incubator/lcf/trunk/connectors/solr/integration/README-3.x.txt
>> > > >
>> > > > You can get the results depending on user access tokens on Solr
>> > > > side.
>> > > > curl "
>> >
>> > http://localhost:8983/solr/select?q=*:*&AuthenticatedUserName=username@domain
>> > "
>> > > >
>> > > > Regards,
>> > > > Shinichiro Abe
>> > > >
>> > > > On 2011/10/14, at 16:39, Swapna Vuppala wrote:
>> > > >
>> > > > > Hi Karl,
>> > > > >
>> > > > > Thanks for the reply. I built jCIFS connector, registered it,
>> > > > > created
>> > a repository connection of type Windows Share, and created a job using
>> > Solr
>> > connection and Windows share connection.
>> > > > >
>> > > > > I modified the Solr schema to include fields
>> > > > >
>> > > > > <field name="allow_token_document" type="string" indexed="true"
>> > stored="true" multiValued="true"/>
>> > > > > <field name="deny_token_document" type="string" indexed="true"
>> > stored="true" multiValued="true"/>
>> > > > > <field name="allow_token_share" type="string" indexed="true"
>> > stored="true" multiValued="true"/>
>> > > > > <field name="deny_token_share" type="string" indexed="true"
>> > stored="true" multiValued="true"/>
>> > > > >
>> > > > > I set the stored attribute to true just for testing purposes.
>> > > > >
>> > > > > Now when I run the job, I see these tokens in the indexed data
as
>> > expected.
>> > > > >
>> > > > > My next job would be to make the search from Solr secure. Do
I
>> > > > > have
>> > to make any changes on Solr side to make use of these tokens and present
>> > only those docs to the user that he's entitled to see ?
>> > > > > Can you please direct me as to how to filter the search results
>> > depending upon the user's credentials ?
>> > > > >
>> > > > > Thanks and Regards,
>> > > > > Swapna.
>> > > > >
>> > > > >
>> > > > > On Thu, Oct 13, 2011 at 1:22 PM, Karl Wright <daddywri@gmail.com>
>> > wrote:
>> > > > > Hi,
>> > > > >
>> > > > > First, it is DOCUMENT access tokens that are sent to Solr, not
>> > > > > user
>> > > > > access tokens.  You must therefore be crawling a repository
that
>> > > > > has
>> > > > > some notion of security.  The File System connector does not
do
>> > > > > that;
>> > > > > you probably want to use the CIFS connector instead.
>> > > > >
>> > > > > Thanks,
>> > > > > Karl
>> > > > >
>> > > > > On Thu, Oct 13, 2011 at 3:19 AM, Swapna Vuppala
>> > > > > <swapna.kollipara@gmail.com> wrote:
>> > > > > > Hi,
>> > > > > >
>> > > > > > Am trying to use Active Directory authority connection to
>> > > > > > address
>> > Solr
>> > > > > > security.
>> > > > > >
>> > > > > > I created an Authority Connection of type Active Directory
(the
>> > connection
>> > > > > > status shows Connection Working) and used it in creating
a "File
>> > System"
>> > > > > > repository connection.
>> > > > > > Then, I created a job with Solr as output connection and
the
>> > > > > > above
>> > created
>> > > > > > repository connection.
>> > > > > >
>> > > > > > As per my understanding ( I might be totally wrong, please
>> > > > > > correct
>> > me if
>> > > > > > so), ManifoldCF now sends user's access tokens along with
the
>> > documents to
>> > > > > > be indexed to Solr. I should be able to see the access tokens
in
>> > Solr's
>> > > > > > indexed data either by extending the schema with fields
>> > > > > >
>> > > > > > <field name="allow_token_document" type="string" indexed="true"
>> > > > > > stored="true" multiValued="true"/>
>> > > > > > <field name="deny_token_document" type="string" indexed="true"
>> > stored="true"
>> > > > > > multiValued="true"/>
>> > > > > >
>> > > > > > or they come as some automatic fields that Solr creates
, with
>> > > > > > the
>> > attr_
>> > > > > > prefix as specified at
>> > > > > >
>> >
>> > http://www.mail-archive.com/connectors-user@incubator.apache.org/msg00462.html
>> > > > > >
>> > > > > > But am not able to see any access tokens with/without modifying
>> > Solr schema.
>> > > > > > Have I missed configuring anything else or how I do I check
if
>> > > > > > my
>> > Active
>> > > > > > Directory connection is working properly ??
>> > > > > > Am using ManifoldCF 0.3 version and Solr 3.4 version.
>> > > > > >
>> > > > > > Please help me in resolving this.
>> > > > > >
>> > > > > > Thanks and Regards,
>> > > > > > Swapna.
>> > > > > >
>> > > > >
>> > > >
>> > > >
>> > > >
>> > >
>> > >
>> >
>> >
>
>

Mime
View raw message