Ruby 连续上载时获取elasticsearch连接错误

我有一个脚本，它从csv文件中一行一行地读取数据，并以相同的顺序将数据索引到elasticsearch。我的elasticsearch主机是运行脚本的同一台机器。除几行外，其他所有操作都正常，当我突然出现以下错误时：

W, [2012-10-09T14:46:00.899876 #11567]  WARN -- : Cannot assign requested address connect(2)
D, [2012-10-09T14:46:00.900037 #11567] DEBUG -- : ["/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/net/http.rb:644:in `initialize'", "/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/net/http.rb:644:in `open'", "/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/net/http.rb:644:in `block in connect'", "/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/timeout.rb:44:in `timeout'", "/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/timeout.rb:89:in `timeout'", "/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/net/http.rb:644:in `connect'", "/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/net/http.rb:637:in `do_start'", "/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/net/http.rb:626:in `start'", "/home/azitabh/.rvm/gems/ruby-1.9.2-p320/gems/rest-client-1.6.7/lib/restclient/request.rb:172:in `transmit'", "/home/azitabh/.rvm/gems/ruby-1.9.2-p320/gems/rest-client-1.6.7/lib/restclient/request.rb:64:in `execute'", "/home/azitabh/.rvm/gems/ruby-1.9.2-p320/gems/tire-0.4.2/lib/tire/http/client.rb:11:in `get'", "/home/azitabh/.rvm/gems/ruby-1.9.2-p320/gems/tire-0.4.2/lib/tire/search.rb:94:in `perform'", "/home/azitabh/.rvm/gems/ruby-1.9.2-p320/gems/tire-0.4.2/lib/tire/search.rb:20:in `results'", "models/test.rb:31:in `get_details'", "models/test.rb:56:in `block in index_test'", "/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/csv.rb:1768:in `each'", "/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/csv.rb:1202:in `block in foreach'", "/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/csv.rb:1340:in `open'", "/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/csv.rb:1201:in `foreach'", "models/test.rb:40:in `index_test'", "models/test.rb:85:in `<main>'"]

W[2012-10-09T14:46:00.899876#11567]警告--：无法分配请求的地址连接（2）
D、 [2012-10-09T14:46:00.900037#11567]调试--:“/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/net/http.rb:644:in‘initialize’”，/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/net/http.rb:644:in‘open’，/home/azitabh/.rvm/rubies/rubies/1.9-1.2-net/lib/p20/kb:in‘http.1.1/block中的ruby:644:，“/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/timeout.rb:44:in‘timeout’”/home/azitabh/.rvm/rubies/rubies/ruby-1.9.2-p320/lib/lib/ruby/1.9.1/net/http.rb:644:in‘connect’”/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/net/http.rb:637:in‘do_start’，/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/net/http.rb:626:in‘start’，/home/azitabh/.rvm/gems/ruby-1.9.2-p320/gems/rest-client-1.6.7/lib/restclient/request.rb:172:in‘传输’，”/home/azitabh/.rvm/gems/ruby-1.9.2-p320/gems/rest-client-1.6.7/lib/restclient/request.rb:64:in‘execute’，/home/azitabh/.rvm/gems/ruby-1.9.2-p320/gems/tire-0.4.2/lib/tire/http/client.rb:11:in‘get’，/home/azitabh/gems/ruby-1.9.2-p320/gems/tire-0.4.2/lib/tire/search.rb:94，’”/home/azitabh/.rvm/gems/ruby-1.9.2-p320/gems/tire-0.4.2/lib/tire/search.rb:20:in‘results’，“models/test.rb:31:in‘get_details’，“models/test.rb:56:in‘block in index_test’，/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1.1/csv.rb:1768:in‘each’”/home/azitabh/.rvm/rubies/ruby-1.9.2-p320/lib/ruby/1.9.1/csv.rb:1202:in‘foreach中的块’，/home/azitabh/.rvm/rubies/rubies/1.9.2-p320/lib/lib/lib/ruby/1.9.1/csv.rb:1201:in‘foreach’，‘models/test/test.rb.rb:40’，‘models:index:u/test’，‘test:

错误与csv中这些行的值无关。我在不同的时间在不同的位置得到这些错误

还有一个错误“WAIT\u TIMEOUT”，我得到了一些时间。无法将跟踪放在这里，因为我这次没有得到该错误

我用ruby编写代码，并使用“轮胎”gem与elasticsearch对话。但我觉得这些都不负任何责任

当我得到这个错误时，JAVA使用了我系统8%的内存。这远远低于赋值ES_MIN_MEM=2g

提前谢谢

---

-Azitabh

发生这种情况是因为tire本身没有关闭tcp连接。一旦所有可用端口都接通，在系统以等待状态关闭所有连接之前，无法进行进一步的连接。这需要一些时间，任何建立新连接的尝试都会导致等待超时。

发生这种情况是因为tire不会自行关闭tcp连接。一旦所有可用端口都接通，在系统以等待状态关闭所有连接之前，无法进行进一步连接。这需要一些时间，任何建立新连接的尝试都会导致等待超时