lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "HuangTongwen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-6138) Solr core load limit
Date Thu, 05 Jun 2014 12:48:04 GMT

    [ https://issues.apache.org/jira/browse/SOLR-6138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14018751#comment-14018751
] 

HuangTongwen commented on SOLR-6138:
------------------------------------

Thank you for your replys.I know that it is zookeeper's znode limit.But I tickout the 1MB
limit.Then it happened like that.Sometime I create core with the parameter onStartup that
I can enlarge cores more than 4000+ cores.Even if I use it than I increase cores.But I don't
the loggers in solr board why I reload would happened to some errors,I think that it isn't
znode limit.Any other error?

> Solr core load limit
> --------------------
>
>                 Key: SOLR-6138
>                 URL: https://issues.apache.org/jira/browse/SOLR-6138
>             Project: Solr
>          Issue Type: Bug
>          Components: clients - java
>    Affects Versions: 4.6, 4.7.1
>         Environment: ubuntu 12.04
> memery 20G
>            Reporter: HuangTongwen
>              Labels: test
>   Original Estimate: 840h
>  Remaining Estimate: 840h
>
> We want to enrich our search ability by solr.We do an exercise for test that how many
cores in one machine solr cores can support.
> We find we can create more than 2000 cores without datas in one machine.But when we create
cores with data ,we just can create about 1000 cores,after more t han 1000 cores,we meet many
errors like following I will apend it .If you have meets the same or similar problem,please
tell me.
> I would be grateful if you could help me.
> Hear are some errors:
> 09:43:29 	WARN 	SolrResourceLoader 	Can't find (or read) directory to add to classloader:
/non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
> 09:43:29 	WARN 	SolrResourceLoader 	Can't find (or read) directory to add to classloader:
/non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
> 09:43:29 	WARN 	SolrResourceLoader 	Can't find (or read) directory to add to classloader:
/non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
> 09:43:29 	WARN 	SolrResourceLoader 	Can't find (or read) directory to add to classloader:
/non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
> 09:43:29 	WARN 	SolrResourceLoader 	Can't find (or read) directory to add to classloader:
/non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
> 09:43:29 	WARN 	SolrResourceLoader 	Can't find (or read) directory to add to classloader:
/non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
> 09:43:29 	WARN 	SolrResourceLoader 	Can't find (or read) directory to add to classloader:
/non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
> 09:43:29 	WARN 	SolrResourceLoader 	Can't find (or read) directory to add to classloader:
/non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
> 09:43:29 	WARN 	SolrResourceLoader 	Can't find (or read) directory to add to classloader:
/non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
> 09:43:29 	WARN 	SolrResourceLoader 	Can't find (or read) directory to add to classloader:
/non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
> 09:43:29 	WARN 	SolrResourceLoader 	Can't find (or read) directory to add to classloader:
/non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
> 09:43:29 	WARN 	SolrResourceLoader 	Can't find (or read) directory to add to classloader:
/non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
> 09:43:29 	WARN 	SolrResourceLoader 	Can't find (or read) directory to add to classloader:
/non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
> 09:46:15 	ERROR 	ShardLeaderElectionContext 	There was a problem trying to register as
the leader:org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists
for /collections/ctest.test.3521/leaders/shard1
> 09:46:15 	WARN 	ElectionContext 	cancelElection did not find election node to remove
> 09:46:16 	WARN 	RecoveryStrategy 	Stopping recovery for zkNodeName=core_node1core=ctest.test.3521
> 09:46:17 	ERROR 	RecoveryStrategy 	Error while trying to recover. core=ctest.test.3521:org.apache.solr.common.SolrException:
No registered leader was found,‚Äč collection:ctest.test.3521 slice:shard1
> 09:46:17 	ERROR 	RecoveryStrategy 	Recovery failed - trying again... (0) core=ctest.test.3521
> 09:46:17 	ERROR 	RecoveryStrategy 	Recovery failed - interrupted. core=ctest.test.3521
> 09:46:17 	ERROR 	RecoveryStrategy 	Recovery failed - I give up. core=ctest.test.3521
> 09:46:18 	WARN 	RecoveryStrategy 	Stopping recovery for zkNodeName=core_node1core=ctest.test.3521
> 10:01:58 	ERROR 	SolrCore 	org.apache.solr.common.SolrException: Error handling 'status'
action
> 10:01:58 	ERROR 	SolrDispatchFilter 	null:org.apache.solr.common.SolrException: Error
handling 'status' action
> 10:15:59 	ERROR 	ZkController 	Error getting leader from zk
> 10:15:59 	ERROR 	ZkController 	Error registering SolrCore:org.apache.solr.common.SolrException:
Error getting leader from zk for shard shard1
> 10:16:18 	ERROR 	SolrCore 	org.apache.solr.common.SolrException: Error handling 'status'
action
> 10:16:18 	ERROR 	SolrDispatchFilter 	null:org.apache.solr.common.SolrException: Error
handling 'status' action



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message