Warning: file_get_contents(/data/phpspider/zhask/data//catemap/9/solr/3.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Architecture 交换核心(reindex->;live)后,我的从机已损坏_Architecture_Solr_Lucene_High Availability_Dataimporthandler - Fatal编程技术网

Architecture 交换核心(reindex->;live)后,我的从机已损坏

Architecture 交换核心(reindex->;live)后,我的从机已损坏,architecture,solr,lucene,high-availability,dataimporthandler,Architecture,Solr,Lucene,High Availability,Dataimporthandler,我在这里遇到了一个非常奇怪的问题,我已经按照我的设想设置了我的solr架构,除了我的solr从机被损坏之外,一切都正常。(测试)设置如下所示: Solr设置 一个Solr主机,具有两个内核(reindex和live) 一个具有两个内核的Solr从机(reindex和live) 轮询间隔设置为00:00:02 在优化或提交后复制 在Ubuntu(11.10)1.4.0版下运行Solr 过程 整个过程如下: 我们擦除主reindex核心上的索引 我们正在寻找reindex核心的主机 我们启动Da

我在这里遇到了一个非常奇怪的问题,我已经按照我的设想设置了我的solr架构,除了我的solr从机被损坏之外,一切都正常。(测试)设置如下所示:

Solr设置

  • 一个Solr主机,具有两个内核(reindex和live)
  • 一个具有两个内核的Solr从机(reindex和live)
  • 轮询间隔设置为00:00:02
  • 在优化或提交后复制
  • 在Ubuntu(11.10)1.4.0版下运行Solr
过程

整个过程如下:

  • 我们擦除主reindex核心上的索引
  • 我们正在寻找reindex核心的主机
  • 我们启动DataImportHandler导入10000个文档中的MySQL数据(以防止长时间的MySQL锁)
  • 完成DataImportHandler(400万条记录)后,我们将在主机上启用复制
  • 从机将从主机获取新的重新索引核心
  • 通过查看“Isreplication”属性,我们发布了
  • 让我们假设live core在完成重建后有5000个文档,reindex core有20000个

    结果(错误)

    交换后,结果如下:

    船长:现场(20000人),Reindex(5000人) 奴隶:活的(20000),重新索引(20000)

    看起来从机将其重新索引核心复制到活动核心,但不像主机那样将活动核心与重新索引核心交换。问题是,我猜从机认为它比主机更新,结果是reindex内核上的复制失败

    以下是发出交换后的一些日志消息:

    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    INFO: Master's version: 1328526603592, generation: 332
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    INFO: Slave's version: 1328526603596, generation: 336
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    INFO: Starting replication process
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    INFO: Master's version: 1328526603596, generation: 336
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    INFO: Slave's version: 1328526603592, generation: 332
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    INFO: Starting replication process
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    INFO: Number of files in latest index in master: 1
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    INFO: Number of files in latest index in master: 11
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller downloadIndexFiles
    INFO: Skipping download for /usr/share/solr/data/index/_ct.tvx
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller downloadIndexFiles
    INFO: Skipping download for /usr/share/solr/data/index/_ct.fdt
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller downloadIndexFiles
    INFO: Skipping download for /usr/share/solr/data/index/_ct.frq
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller downloadIndexFiles
    INFO: Skipping download for /usr/share/solr/data/index/segments_9c
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller downloadIndexFiles
    INFO: Skipping download for /usr/share/solr/data/index/_ct.fdx
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller downloadIndexFiles
    INFO: Skipping download for /usr/share/solr/data/index/_ct.prx
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller downloadIndexFiles
    INFO: Skipping download for /usr/share/solr/data/index/_ct.tii
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller downloadIndexFiles
    INFO: Skipping download for /usr/share/solr/data/index/_ct.tvd
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller downloadIndexFiles
    INFO: Skipping download for /usr/share/solr/data/index/_ct.tis
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller$FileFetcher fetchPackets
    WARNING: No content recieved for file: {name=segments_98, lastmodified=0, size=0}
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller downloadIndexFiles
    INFO: Skipping download for /usr/share/solr/data/index/_ct.tvf
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller downloadIndexFiles
    INFO: Skipping download for /usr/share/solr/data/index/_ct.fnm
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    INFO: Total time taken for download : 0 secs
    13-mrt-2012 14:29:46 org.apache.solr.update.DirectUpdateHandler2 commit
    INFO: start commit(optimize=false,waitFlush=true,waitSearcher=true,expungeDeletes=false)
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    INFO: Total time taken for download : 0 secs
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller modifyIndexProps
    INFO: New index installed. Updating index properties...
    13-mrt-2012 14:29:46 org.apache.solr.update.DirectUpdateHandler2 commit
    INFO: start commit(optimize=false,waitFlush=true,waitSearcher=true,expungeDeletes=false)
    13-mrt-2012 14:29:46 org.apache.solr.search.SolrIndexSearcher <init>
    INFO: Opening Searcher@598d00 main
    13-mrt-2012 14:29:46 org.apache.solr.search.SolrIndexSearcher warm
    INFO: autowarming Searcher@598d00 main from Searcher@189c12a main
        fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
    13-mrt-2012 14:29:46 org.apache.solr.search.SolrIndexSearcher warm
    INFO: autowarming result for Searcher@598d00 main
        fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
    13-mrt-2012 14:29:46 org.apache.solr.search.SolrIndexSearcher warm
    INFO: autowarming Searcher@598d00 main from Searcher@189c12a main
        filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=34,warmupTime=1,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
    13-mrt-2012 14:29:46 org.apache.solr.update.DirectUpdateHandler2 commit
    INFO: end_commit_flush
    13-mrt-2012 14:29:46 org.apache.solr.handler.ReplicationHandler doFetch
    SEVERE: SnapPull failed 
    org.apache.solr.common.SolrException: Index fetch failed : 
        at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:329)
        at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:264)
        at org.apache.solr.handler.SnapPuller$1.run(SnapPuller.java:159)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:679)
    Caused by: java.lang.RuntimeException: java.io.IOException: read past EOF
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1069)
        at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:418)
        at org.apache.solr.handler.SnapPuller.doCommit(SnapPuller.java:467)
        at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:319)
        ... 10 more
    Caused by: java.io.IOException: read past EOF
        at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:151)
        at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:38)
        at org.apache.lucene.store.ChecksumIndexInput.readByte(ChecksumIndexInput.java:36)
        at org.apache.lucene.store.IndexInput.readInt(IndexInput.java:68)
        at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:243)
        at org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java:76)
        at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:683)
        at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:73)
        at org.apache.lucene.index.IndexReader.open(IndexReader.java:476)
        at org.apache.lucene.index.IndexReader.open(IndexReader.java:403)
        at org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:38)
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1058)
        ... 13 more
    13-mrt-2012 14:29:46 org.apache.solr.search.SolrIndexSearcher warm
    INFO: autowarming result for Searcher@598d00 main
        filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=34,warmupTime=10,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
    13-mrt-2012 14:29:46 org.apache.solr.core.SolrCore registerSearcher
    INFO: [live] Registered new searcher Searcher@598d00 main
    13-mrt-2012 14:29:46 org.apache.solr.search.SolrIndexSearcher close
    INFO: Closing Searcher@189c12a main
        fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
        filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=34,warmupTime=1,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller doCommit
    INFO: Force open index writer to make sure older index files get deleted
    13-mrt-2012 14:29:46 org.apache.solr.handler.ReplicationHandler doFetch
    SEVERE: SnapPull failed 
    org.apache.solr.common.SolrException: Index fetch failed : 
        at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:329)
        at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:264)
        at org.apache.solr.handler.SnapPuller$1.run(SnapPuller.java:159)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:679)
    Caused by: java.io.IOException: read past EOF
        at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:151)
        at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:38)
        at org.apache.lucene.store.ChecksumIndexInput.readByte(ChecksumIndexInput.java:36)
        at org.apache.lucene.store.IndexInput.readInt(IndexInput.java:68)
        at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:243)
        at org.apache.lucene.index.SegmentInfos$1.doBody(SegmentInfos.java:309)
        at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:683)
        at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:517)
        at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:306)
        at org.apache.lucene.index.IndexWriter.init(IndexWriter.java:1596)
        at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:1418)
        at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:191)
        at org.apache.solr.update.UpdateHandler.createMainIndexWriter(UpdateHandler.java:98)
        at org.apache.solr.update.DirectUpdateHandler2.openWriter(DirectUpdateHandler2.java:173)
        at org.apache.solr.update.DirectUpdateHandler2.forceOpenWriter(DirectUpdateHandler2.java:376)
        at org.apache.solr.handler.SnapPuller.doCommit(SnapPuller.java:471)
        at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:319)
        ... 10 more
    
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    信息:硕士学位:1328526603592,第332代
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    信息:从属版本:1328526603596,世代:336
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    信息:正在启动复制过程
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    信息:硕士学位:1328526603596,第336代
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    信息:从属版本:1328526603592,世代:332
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    信息:正在启动复制过程
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    信息:主控中最新索引中的文件数:1
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    信息:主机中最新索引中的文件数:11
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller下载索引文件
    信息:跳过/usr/share/solr/data/index/\u ct.tvx的下载
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller下载索引文件
    信息:跳过/usr/share/solr/data/index/\u ct.fdt的下载
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller下载索引文件
    信息:跳过/usr/share/solr/data/index/\u ct.frq的下载
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller下载索引文件
    信息:跳过/usr/share/solr/data/index/segments_9c的下载
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller下载索引文件
    信息:跳过/usr/share/solr/data/index/\u ct.fdx的下载
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller下载索引文件
    信息:跳过/usr/share/solr/data/index/\u ct.prx的下载
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller下载索引文件
    信息:跳过/usr/share/solr/data/index/\u ct.tii的下载
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller下载索引文件
    信息:跳过/usr/share/solr/data/index/\u ct.tvd的下载
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller下载索引文件
    信息:跳过/usr/share/solr/data/index/\u ct.tis的下载
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller$FileFetcher fetchPackets
    警告:未收到以下文件的内容:{name=segments_98,lastmodified=0,size=0}
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller下载索引文件
    信息:跳过/usr/share/solr/data/index/\u ct.tvf的下载
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller下载索引文件
    信息:跳过/usr/share/solr/data/index/\u ct.fnm的下载
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    信息:下载总时间:0秒
    13-mrt-2012 14:29:46 org.apache.solr.update.DirectUpdateHandler2提交
    信息:开始提交(optimize=false,waitFlush=true,waitSearcher=true,expungeDeletes=false)
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller fetchLatestIndex
    信息:下载总时间:0秒
    13-mrt-2012 14:29:46 org.apache.solr.handler.SnapPuller modifyIndexProps
    信息:已安装新索引。正在更新索引属性。。。
    13-mrt-2012 14:29:46 org.apache.solr.update.DirectUpdateHandler2提交
    信息:开始提交(optimize=false,waitFlush=true,waitSearcher=true,expungeDeletes=false)
    13-mrt-2012 14:29:46 org.apache.solr.search.solrindexearcher
    信息:开幕式Searcher@598d00主要的
    13-mrt-2012 14:29:46 org.apache.solr.search.solrindexearcher
    信息:自动加温Searcher@598d00主要来自Searcher@189c12a主要的
    fieldValueCache{lookups=0,hits=0,hittratio=0.00,inserts=0,executions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hittratio=0.00,cumulative_inserts=0,cumulative_executions=0}
    13-mrt-2012 14:29:46 org.apache.solr.search.solrindexearcher
    信息:自动暖机的结果Searcher@598d00主要的
    fieldValueCache{lookups=0,hits=0,hittratio=0.00,inserts=0,executions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hittratio=0.00,cumulative_inserts=0,cumulative_executions=0}
    13-mrt-2012 14:29:46 org.apache.solr.search.solrindexearcher
    信息:自动加温Searcher@598d00主要来自Searcher@189c12a主要的
    过滤器缓存{loo