Apache spark 在spark或spark streaming中，如何配置log4j属性，以便在控制台中不会打印太多日志？

当我尝试运行spark流媒体程序时，控制台中打印的日志太多。你能推荐一个好的配置，这样我就只能得到有用的信息吗？

编辑

conf/log4j.properties

以满足你的需要

你很可能只是想改变

log4j.rootCategory=INFO, console

到

---

我也有同样的问题，并更改了log4j.properties，如图所示。然后输出变成：D

-------------------------------------------
Time: 2015-11-06 00:13:05
-------------------------------------------
()
15/11/06 00:13:06 WARN BlockManager: Block input-0-1446768785800 replicated to only 0 peer(s) instead of 1 peers
-------------------------------------------
Time: 2015-11-06 00:13:10
-------------------------------------------
(u'hello', 1)
()
15/11/06 00:13:14 WARN BlockManager: Block input-0-1446768794000 replicated to only 0 peer(s) instead of 1 peers
-------------------------------------------
Time: 2015-11-06 00:13:15
-------------------------------------------
(u'', 1)
(u'you', 2)
(u'how', 1)
(u'are', 1)
()

---

看起来很棒：D谢谢

我尝试更改conf/log4j.properties，但没有任何改变。我是否应该使用任何执行命令来应用properites文件？您如何执行作业？

-------------------------------------------
Time: 2015-11-06 00:13:05
-------------------------------------------
()
15/11/06 00:13:06 WARN BlockManager: Block input-0-1446768785800 replicated to only 0 peer(s) instead of 1 peers
-------------------------------------------
Time: 2015-11-06 00:13:10
-------------------------------------------
(u'hello', 1)
()
15/11/06 00:13:14 WARN BlockManager: Block input-0-1446768794000 replicated to only 0 peer(s) instead of 1 peers
-------------------------------------------
Time: 2015-11-06 00:13:15
-------------------------------------------
(u'', 1)
(u'you', 2)
(u'how', 1)
(u'are', 1)
()