lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-Tests-4.4-Java6 - Build # 39 - Still Failing
Date Sun, 21 Jul 2013 19:08:17 GMT
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.4-Java6/39/

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.BasicDistributedZkTest:     1) Thread[id=1013, name=recoveryCmdExecutor-423-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]         at java.net.PlainSocketImpl.socketConnect(Native Method)         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)         at java.net.Socket.connect(Socket.java:546)         at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)         at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)         at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)         at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)         at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)         at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:291)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:679)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.BasicDistributedZkTest: 
   1) Thread[id=1013, name=recoveryCmdExecutor-423-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
        at java.net.Socket.connect(Socket.java:546)
        at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
        at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
        at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
        at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
        at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
        at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:291)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:679)
	at __randomizedtesting.SeedInfo.seed([685BDDE579FF6287]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=1013, name=recoveryCmdExecutor-423-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]         at java.net.PlainSocketImpl.socketConnect(Native Method)         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)         at java.net.Socket.connect(Socket.java:546)         at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)         at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)         at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)         at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)         at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)         at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:291)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:679)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=1013, name=recoveryCmdExecutor-423-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
        at java.net.Socket.connect(Socket.java:546)
        at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
        at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
        at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
        at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
        at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
        at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:291)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:679)
	at __randomizedtesting.SeedInfo.seed([685BDDE579FF6287]:0)




Build Log:
[...truncated 8827 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
   [junit4]   2> 202666 T547 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /vm_dvn/o
   [junit4]   2> 202670 T547 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1374433040056
   [junit4]   2> 202671 T547 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 202672 T548 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 202773 T547 oasc.ZkTestServer.run start zk server on port:50451
   [junit4]   2> 202774 T547 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 202782 T554 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4091630f name:ZooKeeperConnection Watcher:127.0.0.1:50451 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 202783 T547 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 202783 T547 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 202788 T547 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 202790 T556 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d150be name:ZooKeeperConnection Watcher:127.0.0.1:50451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 202790 T547 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 202791 T547 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 202800 T547 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 202808 T547 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 202810 T547 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 202813 T547 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 202815 T547 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 202824 T547 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 202825 T547 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 202934 T547 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 202935 T547 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 202938 T547 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 202939 T547 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 202942 T547 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 202943 T547 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 202946 T547 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 202947 T547 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 202951 T547 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 202951 T547 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 202955 T547 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 202955 T547 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 202965 T547 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 202966 T547 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 203200 T547 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 203203 T547 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:50454
   [junit4]   2> 203204 T547 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 203204 T547 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 203205 T547 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1374433040367
   [junit4]   2> 203205 T547 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1374433040367/'
   [junit4]   2> 203234 T547 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1374433040367/solr.xml
   [junit4]   2> 203285 T547 oasc.CoreContainer.<init> New CoreContainer 1184713508
   [junit4]   2> 203286 T547 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1374433040367/]
   [junit4]   2> 203287 T547 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 203287 T547 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 203288 T547 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 203288 T547 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 203288 T547 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 203289 T547 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 203289 T547 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 203289 T547 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 203290 T547 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 203290 T547 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
   [junit4]   2> 203303 T547 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 203303 T547 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50451/solr
   [junit4]   2> 203304 T547 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 203305 T547 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 203307 T567 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@367bbdc6 name:ZooKeeperConnection Watcher:127.0.0.1:50451 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 203308 T547 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 203311 T547 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
   [junit4]   2> 203319 T547 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 203321 T569 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19e154b9 name:ZooKeeperConnection Watcher:127.0.0.1:50451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 203322 T547 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 203324 T547 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 203339 T547 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 203348 T547 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 203355 T547 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50454_vm_dvn%2Fo
   [junit4]   2> 203364 T547 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50454_vm_dvn%2Fo
   [junit4]   2> 203369 T547 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 203390 T547 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 203393 T547 oasc.Overseer.start Overseer (id=90074843713568771-127.0.0.1:50454_vm_dvn%2Fo-n_0000000000) starting
   [junit4]   2> 203404 T547 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 203415 T571 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 203416 T547 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 203419 T547 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 203421 T547 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 203425 T570 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 203429 T572 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 203429 T572 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 203435 T572 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 204929 T570 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 204930 T570 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50454_vm_dvn%2Fo",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50454/vm_dvn/o"}
   [junit4]   2> 204930 T570 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
   [junit4]   2> 204931 T570 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 204936 T569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 205438 T572 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 205438 T572 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1374433040367/collection1
   [junit4]   2> 205439 T572 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 205440 T572 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 205440 T572 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 205442 T572 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1374433040367/collection1/'
   [junit4]   2> 205444 T572 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1374433040367/collection1/lib/classes/' to classloader
   [junit4]   2> 205444 T572 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1374433040367/collection1/lib/README' to classloader
   [junit4]   2> 205498 T572 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
   [junit4]   2> 205557 T572 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 205659 T572 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 205670 T572 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 206347 T572 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 206347 T572 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 206348 T572 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 206358 T572 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 206361 T572 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 206374 T572 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 206378 T572 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 206382 T572 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 206383 T572 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 206384 T572 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 206384 T572 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 206385 T572 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 206385 T572 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 206385 T572 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 206386 T572 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1374433040367/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/control/data/
   [junit4]   2> 206386 T572 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@708b3bb3
   [junit4]   2> 206387 T572 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/control/data
   [junit4]   2> 206387 T572 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/control/data/index/
   [junit4]   2> 206387 T572 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 206388 T572 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/control/data/index
   [junit4]   2> 206391 T572 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3b3fee66 lockFactory=org.apache.lucene.store.NativeFSLockFactory@50c94ac),segFN=segments_1,generation=1}
   [junit4]   2> 206391 T572 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 206394 T572 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 206395 T572 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 206395 T572 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 206396 T572 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 206396 T572 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 206396 T572 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 206397 T572 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 206397 T572 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 206397 T572 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 206404 T572 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 206410 T572 oass.SolrIndexSearcher.<init> Opening Searcher@57a37ec1 main
   [junit4]   2> 206411 T572 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 206411 T572 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 206414 T573 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@57a37ec1 main{StandardDirectoryReader(segments_1:1)}
   [junit4]   2> 206415 T572 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 206415 T572 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50454/vm_dvn/o collection:control_collection shard:shard1
   [junit4]   2> 206415 T572 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
   [junit4]   2> 206427 T572 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 206451 T572 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 206468 T572 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 206468 T572 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 206469 T572 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50454/vm_dvn/o/collection1/
   [junit4]   2> 206469 T572 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 206469 T572 oasc.SyncStrategy.syncToMe http://127.0.0.1:50454/vm_dvn/o/collection1/ has no replicas
   [junit4]   2> 206470 T572 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50454/vm_dvn/o/collection1/ shard1
   [junit4]   2> 206470 T572 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 207954 T570 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 207985 T569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 208017 T572 oasc.ZkController.register We are http://127.0.0.1:50454/vm_dvn/o/collection1/ and leader is http://127.0.0.1:50454/vm_dvn/o/collection1/
   [junit4]   2> 208017 T572 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50454/vm_dvn/o
   [junit4]   2> 208017 T572 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 208018 T572 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 208018 T572 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 208020 T572 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 208022 T547 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0
   [junit4]   2> 208022 T547 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 208023 T547 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> 208035 T547 oascsi.HttpClientUtil.createClient Creating new http client, config:
   [junit4]   2> 208037 T547 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 208039 T576 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56caf56b name:ZooKeeperConnection Watcher:127.0.0.1:50451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 208040 T547 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 208042 T547 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 208045 T547 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
   [junit4]   2> 208359 T547 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 208362 T547 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:50458
   [junit4]   2> 208363 T547 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 208364 T547 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 208364 T547 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1374433045430
   [junit4]   2> 208365 T547 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1374433045430/'
   [junit4]   2> 208409 T547 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1374433045430/solr.xml
   [junit4]   2> 208487 T547 oasc.CoreContainer.<init> New CoreContainer 1724234173
   [junit4]   2> 208487 T547 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1374433045430/]
   [junit4]   2> 208489 T547 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 208490 T547 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 208490 T547 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 208491 T547 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 208491 T547 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 208492 T547 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 208492 T547 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 208493 T547 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 208494 T547 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 208494 T547 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
   [junit4]   2> 208511 T547 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 208512 T547 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50451/solr
   [junit4]   2> 208513 T547 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 208514 T547 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 208520 T587 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f255c01 name:ZooKeeperConnection Watcher:127.0.0.1:50451 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 208520 T547 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 208533 T547 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
   [junit4]   2> 208544 T547 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 208550 T589 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@658762b1 name:ZooKeeperConnection Watcher:127.0.0.1:50451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 208551 T547 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 208565 T547 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 209500 T570 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 209501 T570 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50454_vm_dvn%2Fo",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50454/vm_dvn/o"}
   [junit4]   2> 209518 T576 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 209518 T589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 209518 T569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 209569 T547 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50458_vm_dvn%2Fo
   [junit4]   2> 209571 T547 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50458_vm_dvn%2Fo
   [junit4]   2> 209574 T589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 209574 T576 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 209574 T569 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 209575 T576 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 209575 T569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 209579 T589 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 209585 T590 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 209585 T590 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 209587 T590 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 211033 T570 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 211034 T570 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50458_vm_dvn%2Fo",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50458/vm_dvn/o"}
   [junit4]   2> 211034 T570 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
   [junit4]   2> 211035 T570 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 211059 T576 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 211059 T589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 211059 T569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 211589 T590 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 211589 T590 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1374433045430/collection1
   [junit4]   2> 211589 T590 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 211591 T590 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 211591 T590 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 211593 T590 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1374433045430/collection1/'
   [junit4]   2> 211594 T590 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1374433045430/collection1/lib/README' to classloader
   [junit4]   2> 211595 T590 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1374433045430/collection1/lib/classes/' to classloader
   [junit4]   2> 211646 T590 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
   [junit4]   2> 211706 T590 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 211810 T590 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 211821 T590 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 212425 T590 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 212426 T590 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 212427 T590 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 212437 T590 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 212440 T590 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 212453 T590 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 212457 T590 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 212461 T590 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 212462 T590 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 212462 T590 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 212462 T590 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 212463 T590 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 212464 T590 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 212464 T590 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 212464 T590 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1374433045430/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/jetty1/
   [junit4]   2> 212464 T590 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@708b3bb3
   [junit4]   2> 212465 T590 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/jetty1
   [junit4]   2> 212465 T590 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/jetty1/index/
   [junit4]   2> 212466 T590 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 212466 T590 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/jetty1/index
   [junit4]   2> 212469 T590 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@72f2a1bd lockFactory=org.apache.lucene.store.NativeFSLockFactory@494c009f),segFN=segments_1,generation=1}
   [junit4]   2> 212469 T590 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 212473 T590 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 212473 T590 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 212474 T590 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 212474 T590 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 212475 T590 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 212475 T590 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 212476 T590 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 212476 T590 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 212476 T590 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 212484 T590 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 212489 T590 oass.SolrIndexSearcher.<init> Opening Searcher@741c42a9 main
   [junit4]   2> 212490 T590 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 212491 T590 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 212495 T591 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@741c42a9 main{StandardDirectoryReader(segments_1:1)}
   [junit4]   2> 212496 T590 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 212496 T590 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50458/vm_dvn/o collection:collection1 shard:shard1
   [junit4]   2> 212497 T590 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
   [junit4]   2> 212508 T590 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 212550 T590 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 212561 T590 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 212562 T590 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 212562 T590 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50458/vm_dvn/o/collection1/
   [junit4]   2> 212562 T590 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 212562 T590 oasc.SyncStrategy.syncToMe http://127.0.0.1:50458/vm_dvn/o/collection1/ has no replicas
   [junit4]   2> 212563 T590 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50458/vm_dvn/o/collection1/ shard1
   [junit4]   2> 212563 T590 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 212564 T570 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 212584 T576 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 212584 T569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 212584 T589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 214089 T570 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 214105 T576 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 214105 T589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 214105 T569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 214114 T590 oasc.ZkController.register We are http://127.0.0.1:50458/vm_dvn/o/collection1/ and leader is http://127.0.0.1:50458/vm_dvn/o/collection1/
   [junit4]   2> 214114 T590 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50458/vm_dvn/o
   [junit4]   2> 214114 T590 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 214115 T590 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 214115 T590 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 214117 T590 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 214118 T547 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0
   [junit4]   2> 214119 T547 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 214119 T547 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> 214474 T547 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 214478 T547 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48259
   [junit4]   2> 214478 T547 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 214479 T547 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 214479 T547 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1374433051516
   [junit4]   2> 214480 T547 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1374433051516/'
   [junit4]   2> 214528 T547 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1374433051516/solr.xml
   [junit4]   2> 214605 T547 oasc.CoreContainer.<init> New CoreContainer 395943986
   [junit4]   2> 214606 T547 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1374433051516/]
   [junit4]   2> 214608 T547 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 214608 T547 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 214609 T547 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 214609 T547 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 214610 T547 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 214610 T547 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 214611 T547 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 214611 T547 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 214612 T547 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 214612 T547 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
   [junit4]   2> 214630 T547 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 214630 T547 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50451/solr
   [junit4]   2> 214631 T547 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 214632 T547 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 214636 T603 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66e43eb8 name:ZooKeeperConnection Watcher:127.0.0.1:50451 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 214636 T547 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 214639 T547 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
   [junit4]   2> 214651 T547 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 214653 T605 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77906bf3 name:ZooKeeperConnection Watcher:127.0.0.1:50451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 214654 T547 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 214665 T547 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 215611 T570 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 215612 T570 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50458_vm_dvn%2Fo",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50458/vm_dvn/o"}
   [junit4]   2> 215640 T605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 215640 T589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 215640 T576 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 215640 T569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 215669 T547 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48259_vm_dvn%2Fo
   [junit4]   2> 215671 T547 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48259_vm_dvn%2Fo
   [junit4]   2> 215675 T589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 215675 T605 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 215676 T569 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 215675 T576 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 215676 T569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 215676 T605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 215676 T576 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 215677 T589 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 215684 T606 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 215684 T606 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 215686 T606 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 217147 T570 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 217148 T570 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "core_node_name":"core_node2",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:48259_vm_dvn%2Fo",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:48259/vm_dvn/o"}
   [junit4]   2> 217148 T570 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 217149 T570 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 217154 T605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 217154 T589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 217154 T576 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 217154 T569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 217688 T606 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 217688 T606 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1374433051516/collection1
   [junit4]   2> 217689 T606 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 217690 T606 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 217690 T606 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 217692 T606 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1374433051516/collection1/'
   [junit4]   2> 217694 T606 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1374433051516/collection1/lib/README' to classloader
   [junit4]   2> 217694 T606 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1374433051516/collection1/lib/classes/' to classloader
   [junit4]   2> 217754 T606 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
   [junit4]   2> 217821 T606 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 217923 T606 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 217934 T606 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 218569 T606 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 218570 T606 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 218571 T606 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 218585 T606 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 218590 T606 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 218607 T606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 218613 T606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 218618 T606 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 218619 T606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 218620 T606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 218620 T606 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 218621 T606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 218622 T606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 218622 T606 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 218622 T606 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1374433051516/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/jetty2/
   [junit4]   2> 218623 T606 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@708b3bb3
   [junit4]   2> 218624 T606 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/jetty2
   [junit4]   2> 218624 T606 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/jetty2/index/
   [junit4]   2> 218624 T606 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 218625 T606 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/jetty2/index
   [junit4]   2> 218629 T606 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7f0a0a9a lockFactory=org.apache.lucene.store.NativeFSLockFactory@22b64866),segFN=segments_1,generation=1}
   [junit4]   2> 218629 T606 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 218635 T606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 218636 T606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 218636 T606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 218637 T606 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 218638 T606 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 218638 T606 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 218639 T606 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 218640 T606 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 218640 T606 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 218650 T606 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 218658 T606 oass.SolrIndexSearcher.<init> Opening Searcher@6cee2a92 main
   [junit4]   2> 218660 T606 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 218660 T606 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 218666 T607 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6cee2a92 main{StandardDirectoryReader(segments_1:1)}
   [junit4]   2> 218669 T606 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 218669 T606 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48259/vm_dvn/o collection:collection1 shard:shard2
   [junit4]   2> 218670 T606 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
   [junit4]   2> 218689 T606 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 218707 T606 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 218711 T606 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 218711 T606 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 218712 T606 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:48259/vm_dvn/o/collection1/
   [junit4]   2> 218712 T606 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 218712 T606 oasc.SyncStrategy.syncToMe http://127.0.0.1:48259/vm_dvn/o/collection1/ has no replicas
   [junit4]   2> 218713 T606 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:48259/vm_dvn/o/collection1/ shard2
   [junit4]   2> 218713 T606 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 220170 T570 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 220197 T569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 220197 T576 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 220197 T605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 220197 T589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 220207 T606 oasc.ZkController.register We are http://127.0.0.1:48259/vm_dvn/o/collection1/ and leader is http://127.0.0.1:48259/vm_dvn/o/collection1/
   [junit4]   2> 220207 T606 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48259/vm_dvn/o
   [junit4]   2> 220207 T606 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 220207 T606 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 220208 T606 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 220210 T606 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 220211 T547 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0
   [junit4]   2> 220212 T547 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 220212 T547 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> 220509 T547 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 220512 T547 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:23448
   [junit4]   2> 220513 T547 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 220513 T547 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 220514 T547 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1374433057610
   [junit4]   2> 220514 T547 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1374433057610/'
   [junit4]   2> 220554 T547 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1374433057610/solr.xml
   [junit4]   2> 220629 T547 oasc.CoreContainer.<init> New CoreContainer 109066362
   [junit4]   2> 220630 T547 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1374433057610/]
   [junit4]   2> 220632 T547 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 220633 T547 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 220633 T547 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 220634 T547 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 220634 T547 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 220635 T547 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 220635 T547 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 220636 T547 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 220636 T547 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 220637 T547 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
   [junit4]   2> 220656 T547 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 220657 T547 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50451/solr
   [junit4]   2> 220658 T547 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 220659 T547 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 220662 T619 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bfbd4eb name:ZooKeeperConnection Watcher:127.0.0.1:50451 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 220662 T547 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 220699 T547 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
   [junit4]   2> 220712 T547 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 220734 T621 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d5698f name:ZooKeeperConnection Watcher:127.0.0.1:50451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 220735 T547 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 220772 T547 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 221705 T570 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 221706 T570 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "core_node_name":"core_node2",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:48259_vm_dvn%2Fo",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:48259/vm_dvn/o"}
   [junit4]   2> 221759 T589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 221759 T569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 221759 T605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 221759 T576 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 221759 T621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 221777 T547 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:23448_vm_dvn%2Fo
   [junit4]   2> 221779 T547 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:23448_vm_dvn%2Fo
   [junit4]   2> 221782 T589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 221783 T569 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 221783 T621 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 221783 T605 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 221783 T576 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 221784 T605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 221784 T621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 221783 T569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 221784 T589 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 221784 T576 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 221796 T622 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 221796 T622 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 221798 T622 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 223265 T570 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 223266 T570 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "core_node_name":"core_node3",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:23448_vm_dvn%2Fo",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:23448/vm_dvn/o"}
   [junit4]   2> 223266 T570 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 223267 T570 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 223286 T605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 223286 T589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 223286 T621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 223286 T569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 223286 T576 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 223801 T622 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 223801 T622 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1374433057610/collection1
   [junit4]   2> 223802 T622 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 223803 T622 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 223803 T622 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 223805 T622 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1374433057610/collection1/'
   [junit4]   2> 223807 T622 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1374433057610/collection1/lib/README' to classloader
   [junit4]   2> 223808 T622 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1374433057610/collection1/lib/classes/' to classloader
   [junit4]   2> 223875 T622 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
   [junit4]   2> 223948 T622 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 224049 T622 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 224060 T622 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 224791 T622 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 224792 T622 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 224793 T622 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 224810 T622 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 224814 T622 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 224831 T622 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 224837 T622 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 224842 T622 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 224844 T622 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 224844 T622 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 224844 T622 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 224846 T622 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 224846 T622 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 224846 T622 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 224847 T622 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1374433057610/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/jetty3/
   [junit4]   2> 224847 T622 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@708b3bb3
   [junit4]   2> 224848 T622 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/jetty3
   [junit4]   2> 224848 T622 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/jetty3/index/
   [junit4]   2> 224849 T622 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/jetty3/index' doesn't exist. Creating new index...
   [junit4]   2> 224849 T622 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZkTest-1374433040055/jetty3/index
   [junit4]   2> 224853 T622 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3f03033b lockFactory=org.apache.lucene.store.NativeFSLockFactory@e830ed5),segFN=segments_1,generation=1}
   [junit4]   2> 224853 T622 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 224859 T622 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 224859 T622 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 224860 T622 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 224861 T622 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 224861 T622 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 224862 T622 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 224862 T622 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 224863 T622 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 224863 T622 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 224878 T622 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 224888 T622 oass.SolrIndexSearcher.<init> Opening Searcher@21955fe1 main
   [junit4]   2> 224889 T622 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 224890 T622 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 224895 T623 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@21955fe1 main{StandardDirectoryReader(segments_1:1)}
   [junit4]   2> 224898 T622 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 224898 T622 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:23448/vm_dvn/o collection:collection1 shard:shard1
   [junit4]   2> 224899 T622 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
   [junit4]   2> 224924 T622 oasc.ZkController.register We are http://127.0.0.1:23448/vm_dvn/o/collection1/ and leader is http://127.0.0.1:50458/vm_dvn/o/collection1/
   [junit4]   2> 224924 T622 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:23448/vm_dvn/o
   [junit4]   2> 224924 T622 oasc.ZkController.checkRecovery Core needs to recover:collection1
   [junit4]   2> 224924 T622 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
   [junit4]   2> ASYNC  NEW_CORE C106 name=collection1 org.apache.solr.core.SolrCore@739ffd2f url=http://127.0.0.1:23448/vm_dvn/o/collection1 node=127.0.0.1:23448_vm_dvn%2Fo C106_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:23448_vm_dvn%2Fo, base_url=http://127.0.0.1:23448/vm_dvn/o}
   [junit4]   2> 224925 T624 C106 P23448 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
   [junit4]   2> 224926 T624 C106 P23448 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
   [junit4]   2> 224926 T622 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 224926 T624 C106 P23448 oasc.ZkController.publish publishing core=collection1 state=recovering
   [junit4]   2> 224926 T624 C106 P23448 oasc.ZkController.publish numShards not found on descriptor - read

[...truncated too long message...]

 threads:
   [junit4]   2> 	   1) Thread[id=1013, name=recoveryCmdExecutor-423-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
   [junit4]   2> 220164 T546 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
   [junit4]   2> 	   1) Thread[id=1013, name=recoveryCmdExecutor-423-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
   [junit4]   2> 	        at java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]   2> 	        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)
   [junit4]   2> 	        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)
   [junit4]   2> 	        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)
   [junit4]   2> 	        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
   [junit4]   2> 	        at java.net.Socket.connect(Socket.java:546)
   [junit4]   2> 	        at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
   [junit4]   2> 	        at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
   [junit4]   2> 	        at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
   [junit4]   2> 	        at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
   [junit4]   2> 	        at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
   [junit4]   2> 	        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
   [junit4]   2> 	        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
   [junit4]   2> 	        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
   [junit4]   2> 	        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
   [junit4]   2> 	        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
   [junit4]   2> 	        at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:291)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:679)
   [junit4]   2> NOTE: test params are: codec=Lucene3x, sim=DefaultSimilarity, locale=en_IE, timezone=Pacific/Pago_Pago
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=2,free=155671824,total=524025856
   [junit4]   2> NOTE: All tests run in this JVM: [IndexSchemaTest, UUIDFieldTest, StatelessScriptUpdateProcessorFactoryTest, MinimalSchemaTest, DirectUpdateHandlerOptimizeTest, FieldMutatingUpdateProcessorTest, TestQuerySenderListener, SystemInfoHandlerTest, TestQueryUtils, TestSolrDeletionPolicy2, SuggesterFSTTest, UnloadDistributedZkTest, TestFieldCollectionResource, ShowFileRequestHandlerTest, DistributedTermsComponentTest, TestConfig, SliceStateUpdateTest, TestMaxScoreQueryParser, HdfsRecoveryZkTest, TestFaceting, JsonLoaderTest, MBeansHandlerTest, BasicDistributedZkTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.seed=685BDDE579FF6287 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_IE -Dtests.timezone=Pacific/Pago_Pago -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | BasicDistributedZkTest (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.BasicDistributedZkTest: 
   [junit4]    >    1) Thread[id=1013, name=recoveryCmdExecutor-423-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
   [junit4]    >         at java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)
   [junit4]    >         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
   [junit4]    >         at java.net.Socket.connect(Socket.java:546)
   [junit4]    >         at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
   [junit4]    >         at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
   [junit4]    >         at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
   [junit4]    >         at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
   [junit4]    >         at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
   [junit4]    >         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
   [junit4]    >         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
   [junit4]    >         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
   [junit4]    >         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
   [junit4]    >         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
   [junit4]    >         at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:291)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:679)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([685BDDE579FF6287]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=1013, name=recoveryCmdExecutor-423-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
   [junit4]    >         at java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)
   [junit4]    >         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
   [junit4]    >         at java.net.Socket.connect(Socket.java:546)
   [junit4]    >         at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
   [junit4]    >         at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
   [junit4]    >         at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
   [junit4]    >         at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
   [junit4]    >         at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
   [junit4]    >         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
   [junit4]    >         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
   [junit4]    >         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
   [junit4]    >         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
   [junit4]    >         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
   [junit4]    >         at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:291)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:679)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([685BDDE579FF6287]:0)
   [junit4] Completed on J0 in 220.20s, 1 test, 2 errors <<< FAILURES!

[...truncated 782 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/build.xml:395: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/build.xml:375: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/lucene/common-build.xml:1250: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.4-Java6/lucene/common-build.xml:893: There were test failures: 317 suites, 1337 tests, 2 suite-level errors, 865 ignored (4 assumptions)

Total time: 33 minutes 48 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message