Cassandra:由于初始化期间处理提交日志时出错而退出

我正在使用Cassandra loader将一个大型CSV加载到Cassandra中

虚拟机在此过程中耗尽了磁盘空间并崩溃。我为VM分配了更多的磁盘空间，并尝试启动cassandra，但由于SSTables和commit log出现问题，它拒绝启动

我无法运行

nodetool repair

，因为它仅在节点联机时工作。 我运行了

sstablescrub

，花了大约1个小时才完成。所以我想它可能已经修好了

但是我仍然在

system.log中遇到这个错误

ERROR [SSTableBatchOpen:4] 2015-10-23 18:57:45,035 SSTableReader.java:506 - Corrupt sstable /var/lib/cassandra/data/keyspace1/location-777a33d0772911e597a98b820c5778a4/la-1709-big=[TOC.txt, CompressionInfo.db, Statistics.db, Digest.adler32, Data.db, Index.db, Filter.db]; skipping table
org.apache.cassandra.io.sstable.CorruptSSTableException: java.io.EOFException
        at org.apache.cassandra.io.compress.CompressionMetadata.<init>(CompressionMetadata.java:125) ~[apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.io.compress.CompressionMetadata.create(CompressionMetadata.java:86) ~[apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.io.util.CompressedSegmentedFile$Builder.metadata(CompressedSegmentedFile.java:142) ~[apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.io.util.CompressedPoolingSegmentedFile$Builder.complete(CompressedPoolingSegmentedFile.java:101) ~[apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.io.util.SegmentedFile$Builder.complete(SegmentedFile.java:187) ~[apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.io.util.SegmentedFile$Builder.complete(SegmentedFile.java:179) ~[apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.io.sstable.format.SSTableReader.load(SSTableReader.java:703) ~[apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.io.sstable.format.SSTableReader.load(SSTableReader.java:664) ~[apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.io.sstable.format.SSTableReader.open(SSTableReader.java:458) ~[apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.io.sstable.format.SSTableReader.open(SSTableReader.java:363) ~[apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.io.sstable.format.SSTableReader$4.run(SSTableReader.java:501) ~[apache-cassandra-2.2.3.jar:2.2.3]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_60]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_60]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_60]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_60]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
Caused by: java.io.EOFException: null
        at java.io.DataInputStream.readUnsignedShort(DataInputStream.java:340) ~[na:1.8.0_60]
        at java.io.DataInputStream.readUTF(DataInputStream.java:589) ~[na:1.8.0_60]
        at java.io.DataInputStream.readUTF(DataInputStream.java:564) ~[na:1.8.0_60]
        at org.apache.cassandra.io.compress.CompressionMetadata.<init>(CompressionMetadata.java:96) ~[apache-cassandra-2.2.3.jar:2.2.3]
        ... 15 common frames omitted
INFO  [main] 2015-10-23 18:57:45,193 ColumnFamilyStore.java:382 - Initializing system_auth.role_permissions
INFO  [main] 2015-10-23 18:57:45,201 ColumnFamilyStore.java:382 - Initializing system_auth.resource_role_permissons_index
INFO  [main] 2015-10-23 18:57:45,213 ColumnFamilyStore.java:382 - Initializing system_auth.roles
INFO  [main] 2015-10-23 18:57:45,233 ColumnFamilyStore.java:382 - Initializing system_auth.role_members
INFO  [main] 2015-10-23 18:57:45,240 ColumnFamilyStore.java:382 - Initializing system_traces.sessions
INFO  [main] 2015-10-23 18:57:45,252 ColumnFamilyStore.java:382 - Initializing system_traces.events
INFO  [main] 2015-10-23 18:57:45,265 ColumnFamilyStore.java:382 - Initializing simplex.songs
INFO  [main] 2015-10-23 18:57:45,276 ColumnFamilyStore.java:382 - Initializing simplex.playlists
INFO  [pool-2-thread-1] 2015-10-23 18:57:45,289 AutoSavingCache.java:187 - reading saved cache /var/lib/cassandra/saved_caches/KeyCache-ca.db
INFO  [pool-2-thread-1] 2015-10-23 18:57:45,313 AutoSavingCache.java:163 - Completed loading (25 ms; 36 keys) KeyCache cache
INFO  [main] 2015-10-23 18:57:45,351 CommitLog.java:168 - Replaying /var/lib/cassandra/commitlog/CommitLog-5-1445578022702.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022703.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022704.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022705.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022706.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022707.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022708.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022709.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022710.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022712.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022713.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022714.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022715.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022716.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022717.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022719.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022720.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022721.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022722.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022723.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022724.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022725.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022727.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022728.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022730.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022731.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022732.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022733.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022734.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022736.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022738.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022740.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022741.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022743.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022744.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022745.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022746.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022748.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022749.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022750.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022751.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022752.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022753.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022755.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022756.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022758.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022759.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022760.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022761.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022763.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022764.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022765.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022766.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022767.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022768.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022769.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022770.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022771.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022772.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022773.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022774.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022775.log, /var/lib/cassandra/commitlog/CommitLog-5-1445578022776.log, /var/lib/cassandra/commitlog/CommitLog-5-1445588991268.log, /var/lib/cassandra/commitlog/CommitLog-5-1445589094722.log, /var/lib/cassandra/commitlog/CommitLog-5-1445589149527.log, /var/lib/cassandra/commitlog/CommitLog-5-1445595828633.log, /var/lib/cassandra/commitlog/CommitLog-5-1445595898055.log, /var/lib/cassandra/commitlog/CommitLog-5-1445596033717.log, /var/lib/cassandra/commitlog/CommitLog-5-1445596400441.log, /var/lib/cassandra/commitlog/CommitLog-5-1445596601854.log, /var/lib/cassandra/commitlog/CommitLog-5-1445598032544.log, /var/lib/cassandra/commitlog/CommitLog-5-1445598758663.log, /var/lib/cassandra/commitlog/CommitLog-5-1445601112953.log, /var/lib/cassandra/commitlog/CommitLog-5-1445601937334.log, /var/lib/cassandra/commitlog/CommitLog-5-1445601985416.log, /var/lib/cassandra/commitlog/CommitLog-5-1445604504389.log, /var/lib/cassandra/commitlog/CommitLog-5-1445606516196.log
ERROR [main] 2015-10-23 18:59:05,091 JVMStabilityInspector.java:78 - Exiting due to error while processing commit log during initialization.
org.apache.cassandra.db.commitlog.CommitLogReplayer$CommitLogReplayException: Mutation checksum failure at 4110758 in CommitLog-5-1445578022776.log
        at org.apache.cassandra.db.commitlog.CommitLogReplayer.handleReplayError(CommitLogReplayer.java:622) [apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.db.commitlog.CommitLogReplayer.replaySyncSection(CommitLogReplayer.java:492) [apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.db.commitlog.CommitLogReplayer.recover(CommitLogReplayer.java:388) [apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.db.commitlog.CommitLogReplayer.recover(CommitLogReplayer.java:147) [apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:189) [apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:169) [apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:273) [apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:513) [apache-cassandra-2.2.3.jar:2.2.3]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:622) [apache-cassandra-2.2.3.jar:2.2.3]
Exiting due to error while processing commit log during initialization.

错误[SSTableBatchOpen:4]2015-10-23 18:57:45035 SSTableReader.java:506-损坏的sstable/var/lib/cassandra/data/keyspace1/location-777a33d0772911e597a98b820c5778a4/la-1709-big=[TOC.txt，CompressionInfo.db，Statistics.db，Digest.adler32，data.db，Index.db，Filter.db]；跳过表
org.apache.cassandra.io.sstable.CorruptSSTableException:java.io.eofeexception
在org.apache.cassandra.io.compress.CompressionMetadata.（CompressionMetadata.java:125）~[apache-cassandra-2.2.3.jar:2.2.3]
在org.apache.cassandra.io.compress.CompressionMetadata.create（CompressionMetadata.java:86）~[apache-cassandra-2.2.3.jar:2.2.3]
在org.apache.cassandra.io.util.CompressedSegmentedFile$Builder.metadata（CompressedSegmentedFile.java:142）~[apache-cassandra-2.2.3.jar:2.2.3]
在org.apache.cassandra.io.util.compressedoolingsegmentedfile$Builder.complete（compressedoolingsegmentedfile.java:101）~[apache-cassandra-2.2.3.jar:2.2.3]
在org.apache.cassandra.io.util.SegmentedFile$Builder.complete（SegmentedFile.java:187）~[apache-cassandra-2.2.3.jar:2.2.3]
在org.apache.cassandra.io.util.SegmentedFile$Builder.complete（SegmentedFile.java:179）~[apache-cassandra-2.2.3.jar:2.2.3]
在org.apache.cassandra.io.sstable.format.SSTableReader.load（SSTableReader.java:703）~[apache-cassandra-2.2.3.jar:2.2.3]
在org.apache.cassandra.io.sstable.format.SSTableReader.load（SSTableReader.java:664）~[apache-cassandra-2.2.3.jar:2.2.3]
在org.apache.cassandra.io.sstable.format.SSTableReader.open（SSTableReader.java:458）~[apache-cassandra-2.2.3.jar:2.2.3]
在org.apache.cassandra.io.sstable.format.SSTableReader.open（SSTableReader.java:363）~[apache-cassandra-2.2.3.jar:2.2.3]
在org.apache.cassandra.io.sstable.format.SSTableReader$4.run（SSTableReader.java:501）~[apache-cassandra-2.2.3.jar:2.2.3]
在java.util.concurrent.Executors$RunnableAdapter.call（Executors.java:511）[na:1.8.060]
在java.util.concurrent.FutureTask.run（FutureTask.java:266）[na:1.8.060]
位于java.util.concurrent.ThreadPoolExecutor.runWorker（ThreadPoolExecutor.java:1142）[na:1.8.060]
在java.util.concurrent.ThreadPoolExecutor$Worker.run（ThreadPoolExecutor.java:617）[na:1.8.060]
在java.lang.Thread.run（Thread.java:745）[na:1.8.0_60]
原因：java.io.EOFException:null
在java.io.DataInputStream.readUnsignedShort（DataInputStream.java:340）~[na:1.8.0\U 60]
在java.io.DataInputStream.readUTF（DataInputStream.java:589）~[na:1.8.0\u 60]
在java.io.DataInputStream.readUTF（DataInputStream.java:564）~[na:1.8.0\u 60]
在org.apache.cassandra.io.compress.CompressionMetadata.（CompressionMetadata.java:96）~[apache-cassandra-2.2.3.jar:2.2.3]
... 省略了15个公共框架
INFO[main]2015-10-23 18:57:45193 ColumnFamilyStore.java:382-初始化系统\u auth.role\u权限
INFO[main]2015-10-23 18:57:45201 ColumnFamilyStore.java:382-初始化系统\u auth.resource\u角色\u权限\u索引
INFO[main]2015-10-23 18:57:45213 ColumnFamilyStore.java:382-初始化系统身份验证角色
INFO[main]2015-10-23 18:57:45233 ColumnFamilyStore.java:382-初始化系统身份验证角色成员
INFO[main]2015-10-23 18:57:45240 ColumnFamilyStore.java:382-初始化系统会话
INFO[main]2015-10-23 18:57:45252 ColumnFamilyStore.java:382-初始化系统跟踪事件
INFO[main]2015-10-23 18:57:45265 ColumnFamilyStore.java:382-初始化simplex.songs
INFO[main]2015-10-23 18:57:45276 ColumnFamilyStore.java:382-初始化simplex.playlists
信息[pool-2-thread-1]2015-10-23 18:57:45289 AutoSavingCache.java:187-读取已保存的缓存/var/lib/cassandra/saved_caches/KeyCache-ca.db
信息[pool-2-thread-1]2015-10-23 18:57:45313 AutoSavingCache.java:163-已完成加载（25毫秒；36键）KeyCache
INFO[main]2015-10-23 18:57:45351 CommitLog.java:168-Replaying/var/lib/cassandra/CommitLog/CommitLog-5-144557802702.log、/var/lib/cassandra/CommitLog-5-144557802703.log、/var/lib/cassandra/CommitLog/CommitLog-5-144557802704.log、/var/lib/cassandra/CommitLog/CommitLog-5-144557802705.log、，/var/lib/cassandra/commitlog/commitlog-5-1445578022706.log，/var/lib/cassandra/commitlog/commitlog-5-1445578022707.log，/var/lib/cassandra/commitlog-5-1445578022708.log，/var/lib/cassandra/commitlog/commitlog/commitlog-5-144557802709.log，/var/lib/cassandra/commitlog/commitlog/commitlog-5-14455780227010.log，/var/lib/cassandra/commitlog/commitlog-5-144557802712.log，/var/lib/cassandra/commitlog/commitlog-5-144557802713.log，/var/lib/cassandra/commitlog-5-144557802714.log，/var/lib/cassandra/commitlog/commitlog/commitlog-5-144557802715.log，/var/lib/cassandra/commitlog/commitlog/commitlog-5-144557802716.log，/var/lib/cassandra/commitlog/commitlog-5-1445578022727.log、/var/lib/cassandra/commitlog/commitlog-5-144557802719.log、/var/lib/cassandra/commitlog/5-144557802272.log、/var/lib/cassandra/commitlog/commitlog/commitlog-5-1445578022721.log、/var/lib/cassandra/commitlog/commitlog/5-1445578022722.log、，/var/lib/cassandra/commitlog/commitlog-5-144557802723.log、/var/lib/cassandra/commitlog/commitlog-5-144557802724.log、/var/lib/cassandra/commitlog/5-144557802725.log、/var/lib/cassandra/commitlog/commitlog/commitlog-5-144557802727.log、/var/lib/cassandra/commitlog/commitlog/5-1445578027228.log