Apache flink Apache Flink:网络缓冲区数量不足
我创建了一个flink quickstart java(DarchetypeArtifactId)项目。 下面是一个示例代码WordCount.java 这是原始WordCount.java代码的一部分Apache flink Apache Flink:网络缓冲区数量不足,apache-flink,Apache Flink,我创建了一个flink quickstart java(DarchetypeArtifactId)项目。 下面是一个示例代码WordCount.java 这是原始WordCount.java代码的一部分 public static void main(String[] args) throws Exception { // set up the execution environment final ExecutionEnvironment env = ExecutionEnv
public static void main(String[] args) throws Exception {
// set up the execution environment
final ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();
// get input data
DataSet<String> text = env.fromElements(
"To be, or not to be,--that is the question:--",
"Whether 'tis nobler in the mind to suffer",
"The slings and arrows of outrageous fortune",
"Or to take arms against a sea of troubles,"
);
//DataSet<String> text = env.readTextFile("file:///home/jypark2/data3.txt");
DataSet<Tuple2<String, Integer>> counts =
// split up the lines in pairs (2-tuples) containing: (word,1)
text.flatMap(new LineSplitter())
// group by the tuple field "0" and sum up tuple field "1"
.groupBy(0)
.sum(1);
// execute and print result
counts.print();
}
及
重新启动taskmanager、JobManager、,
本地,但错误消息相同。
页面localhost:8081上的配置已更改,但
错误消息的数量不会更改
此外,我还运行了示例代码SocketTextStreamWordCount.java
没有任何变化。但类似的错误也发生了,错误信息说
网络缓冲区数量不足:需要64个,但只需要36个
可用。网络缓冲区的总数当前设置为2048
我怎样才能解决这个问题?帮帮我
public static void main(String[] args) throws Exception {
// set up the execution environment
final ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();
// get input data
DataSet<String> text = env.readTextFile("file:///home/jypark2/data3.txt");
DataSet<Tuple2<String, Integer>> counts =
// split up the lines in pairs (2-tuples) containing: (word,1)
text.flatMap(new LineSplitter())
// group by the tuple field "0" and sum up tuple field "1"
.groupBy(0)
.sum(1);
// execute and print result
counts.print();
}
taskmanager.network.numberOfBuffers
taskmanager.numberOfTaskSlots