Java Ignite gridgain生成的项目openfile限制问题
我试图缓存一些表的大型数据集，我的服务器基于centos，具有8Go ram和500Go磁盘空间 我将本地存储策略配置为持久化，在收到文件打开限制问题后，我尝试按照以下步骤将其设置为2 000 000Java Ignite gridgain生成的项目openfile限制问题,java,ignite,gridgain,Java,Ignite,Gridgain,我试图缓存一些表的大型数据集，我的服务器基于centos，具有8Go ram和500Go磁盘空间 我将本地存储策略配置为持久化，在收到文件打开限制问题后，我尝试按照以下步骤将其设置为2 000 000 vi /etc/sysctl.conf fs.file-max = 2000000 (2 million) :wq sysctl -p 但是即使使用这个补丁 在chmod-x上设置工作目录仍然有以下错误提示 SEVERE: Critical system error detect
vi /etc/sysctl.conf
fs.file-max = 2000000 (2 million)
:wq
sysctl -p
SEVERE: Critical system error detected. Will be handled accordingly to configured handler [hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0, super=AbstractFailureHandler [ignoredFailureTypes=[SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.i.processors.cache.persistence.StorageException: Failed to initialize partition file: /home/grid-gain-server/gridgain-community-8.7.7/work/db/node00-3273af50-1e97-47fa-a237-29e7dfc2d987/cache-COrderCache/part-56.bin]]
class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to initialize partition file: /home/grid-gain-server/gridgain-community-8.7.7/work/db/node00-3273af50-1e97-47fa-a237-29e7dfc2d987/cache-COrderCache/part-56.bin
at org.apache.ignite.internal.processors.cache.persistence.file.FilePageStore.init(FilePageStore.java:448)
at org.apache.ignite.internal.processors.cache.persistence.file.FilePageStore.read(FilePageStore.java:337)
at org.apache.ignite.internal.processors.cache.persistence.file.FilePageStoreManager.read(FilePageStoreManager.java:478)
at org.apache.ignite.internal.processors.cache.persistence.file.FilePageStoreManager.read(FilePageStoreManager.java:462)
at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.acquirePage(PageMemoryImpl.java:853)
at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.acquirePage(PageMemoryImpl.java:694)
at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.getOrAllocatePartitionMetas(GridCacheOffheapManager.java:1679)
at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.init0(GridCacheOffheapManager.java:1507)
at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.invoke(GridCacheOffheapManager.java:2137)
at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl.invoke(IgniteCacheOffheapManagerImpl.java:429)
at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.storeValue(GridCacheMapEntry.java:4261)
at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.initialValue(GridCacheMapEntry.java:3407)
at org.apache.ignite.internal.processors.cache.GridCacheEntryEx.initialValue(GridCacheEntryEx.java:771)
at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtCacheAdapter.loadEntry(GridDhtCacheAdapter.java:683)
at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtCacheAdapter.access$600(GridDhtCacheAdapter.java:103)
at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtCacheAdapter$5.apply(GridDhtCacheAdapter.java:633)
at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtCacheAdapter$5.apply(GridDhtCacheAdapter.java:629)
at org.apache.ignite.internal.processors.cache.store.GridCacheStoreManagerAdapter$3.apply(GridCacheStoreManagerAdapter.java:535)
at org.apache.ignite.cache.store.jdbc.CacheAbstractJdbcStore$1.call(CacheAbstractJdbcStore.java:469)
at org.apache.ignite.cache.store.jdbc.CacheAbstractJdbcStore$1.call(CacheAbstractJdbcStore.java:433)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.nio.file.FileSystemException: /home/grid-gain-server/gridgain-community-8.7.7/work/db/node00-3273af50-1e97-47fa-a237-29e7dfc2d987/cache-COrderCache/part-56.bin: Too many open files
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.newAsynchronousFileChannel(UnixFileSystemProvider.java:196)
at java.nio.channels.AsynchronousFileChannel.open(AsynchronousFileChannel.java:248)
at java.nio.channels.AsynchronousFileChannel.open(AsynchronousFileChannel.java:301)
at org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIO.<init>(AsyncFileIO.java:56)
at org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory.create(AsyncFileIOFactory.java:43)
at org.apache.ignite.internal.processors.cache.persistence.file.FilePageStore.init(FilePageStore.java:420)
... 23 more
Nov 24, 2019 4:54:51 PM java.util.logging.LogManager$RootLogger log
SEVERE: JVM will be halted immediately due to the failure: [failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.i.processors.cache.persistence.StorageException: Failed to initialize partition file: /home/grid-gain-server/gridgain-community-8.7.7/work/db/node00-3273af50-1e97-47fa-a237-29e7dfc2d987/cache-COrderCache/part-56.bin]]
严重：检测到严重系统错误。将根据配置的处理程序[hnd=StopNodeOrHaltFailureHandler[tryStop=false，timeout=0，super=AbstractFailureHandler[ignoredFailureTypes=[SYSTEM\u WORKER\u BLOCKED，SYSTEM\u CRITICAL\u OPERATION\u timeout]]，failureCtx=FailureContext进行相应处理[type=CRITICAL_ERROR，err=class o.a.i.i.processors.cache.persistence.StorageException:未能初始化分区文件：/home/grid gain server/gridgain-community-8.7.7/work/db/node00-3273af50-1e97-47fa-a237-29e7dfc2d987/cache COrderCache/part-56.bin]]
类org.apache.ignite.internal.processors.cache.persistence.StorageException:未能初始化分区文件：/home/grid-gain-server/gridgain-community-8.7.7/work/db/node00-3273af50-1e97-47fa-a237-29e7dfc2d987/cache-COrderCache/part-56.bin
位于org.apache.ignite.internal.processors.cache.persistence.file.FilePageStore.init（FilePageStore.java:448）
位于org.apache.ignite.internal.processors.cache.persistence.file.FilePageStore.read（FilePageStore.java:337）
位于org.apache.ignite.internal.processors.cache.persistence.file.FilePageStoreManager.read（FilePageStoreManager.java:478）
位于org.apache.ignite.internal.processors.cache.persistence.file.FilePageStoreManager.read（FilePageStoreManager.java:462）
位于org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.acquirePage（PageMemoryImpl.java:853）
位于org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.acquirePage（PageMemoryImpl.java:694）
位于org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.getOrAllocatePartitionMetas（GridCacheOffheapManager.java:1679）
位于org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.init0（GridCacheOffheapManager.java:1507）
位于org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.invoke（GridCacheOffheapManager.java:2137）
位于org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl.invoke（IgniteCacheOffheapManagerImpl.java:429）
位于org.apache.ignite.internal.processors.cache.GridCacheMapEntry.storeValue（GridCacheMapEntry.java:4261）
位于org.apache.ignite.internal.processors.cache.GridCacheMapEntry.initialValue（GridCacheMapEntry.java:3407）
位于org.apache.ignite.internal.processors.cache.GridCacheEntryEx.initialValue（GridCacheEntryEx.java:771）
位于org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtCacheAdapter.loadEntry（GridDhtCacheAdapter.java:683）
位于org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtCacheAdapter.access$600（GridDhtCacheAdapter.java:103）
位于org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtCacheAdapter$5.apply（GridDhtCacheAdapter.java:633）
位于org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtCacheAdapter$5.apply（GridDhtCacheAdapter.java:629）
位于org.apache.ignite.internal.processors.cache.store.GridCacheStoreManagerAdapter$3.apply（GridCacheStoreManagerAdapter.java:535）
位于org.apache.ignite.cache.store.jdbc.CacheAbstractJdbcStore$1.call（CacheAbstractJdbcStore.java:469）
位于org.apache.ignite.cache.store.jdbc.CacheAbstractJdbcStore$1.call（CacheAbstractJdbcStore.java:433）
在java.util.concurrent.FutureTask.run（FutureTask.java:266）处
位于java.util.concurrent.ThreadPoolExecutor.runWorker（ThreadPoolExecutor.java:1149）
位于java.util.concurrent.ThreadPoolExecutor$Worker.run（ThreadPoolExecutor.java:624）
运行（Thread.java:748）
原因：java.nio.file.FileSystemException:/home/grid-gain-server/gridgain-community-8.7.7/work/db/node00-3273af50-1e97-47fa-a237-29e7dfc2d987/cache-COrderCache/part-56.bin:打开的文件太多
位于sun.nio.fs.UnixException.translateToIOException（UnixException.java:91）
位于sun.nio.fs.UnixException.rethrowAsIOException（UnixException.java:102）
位于sun.nio.fs.UnixException.rethrowAsIOException（UnixException.java:107）
位于sun.nio.fs.UnixFileSystemProvider.newAsynchronousFileChannel（UnixFileSystemProvider.java:196）
在java.nio.channels.AsynchronousFileChannel.open（AsynchronousFileChannel.java:248）
在java.nio.channels.AsynchronousFileChannel.open（AsynchronousFileChannel.java:301）
位于org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIO。（AsyncFileIO.java:56）
位于org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory.create（AsyncFileIOFactory.java:43）
位于org.apache.ignite.internal.processors.cache.persistence.file.FilePageStore.init（FilePageStore.java:420）
…还有23个
2019年11月24日下午4:54:51 java.util.logging.LogManager$RootLogger log
严重：JVM将因故障立即停止：[failureCtx=FailureContext[type=CRITICAL_ERROR，err=class o.a.i.i.processors.cache.persistence.StorageException:未能初始化分区文件：/home/grid gain server/gridgain-community-8.7.7/work/db/node00-3273af50-1e97-47fa-a237-29e7dfc2d987/cache COrderCache/part-56.bin]]
我能做些什么来修复它呢添加以下配置就足以避免这个异常了
vi /etc/security/limits.conf
root soft nofile 10240
root hard nofile 20480
/etc/sysctl.conffs.inotify.max_user_watches=524288