I have a node that has been starting up for over an hour. I tried a drain followed by a stop/start of dse.
Seems there's some sort of deadlock between the Solr indexer and Cassandra? com.datatax.bdp for the index pool shows no changes. Full log and thread dump is attached below.
INFO [SolrSecondaryIndex plugin initializer.] 2013-08-30 13:39:15,338 ShardRouter.java (line 570) Discovered routing endpoint: /192.168.131.224
INFO [SolrSecondaryIndex plugin initializer.] 2013-08-30 13:39:15,338 ShardRouter.java (line 570) Discovered routing endpoint: /192.168.131.233
INFO [SolrSecondaryIndex plugin initializer.] 2013-08-30 13:39:15,340 SolrSecondaryIndex.java (line 403) Reindexing 46259 keys for core ism.ie
INFO [SolrSecondaryIndex plugin initializer.] 2013-08-30 13:39:15,961 SolrSecondaryIndex.java (line 413) Waiting for hard commit on core ism.ie
INFO [SolrSecondaryIndex plugin initializer.] 2013-08-30 13:39:15,962 SolrSecondaryIndex.java (line 734) Executing hard commit on index ism.ie
INFO [SolrSecondaryIndex plugin initializer.] 2013-08-30 13:39:15,963 IndexPool.java (line 372) Back pressure enabled with average index queue size: 3833
INFO [HANDSHAKE-/192.168.131.224] 2013-08-30 13:39:18,411 OutboundTcpConnection.java (line 399) Handshaking version with /192.168.131.224
Log: http://pastebin.com/raw.php?i=kLnmUb1H
Thread dump: http://pastebin.com/raw.php?i=pjBf3nCC
This is with DSE 3.1.1
