Javascript 我如何找出哪些网站使用我的jQuery插件?

Javascript 我如何找出哪些网站使用我的jQuery插件?,javascript,jquery,web-crawler,Javascript,Jquery,Web Crawler,我正在编译一个使用jQuery插件()的大型网站列表 有谁能推荐一种最佳/最简单的方法来爬网以使用特定的js库吗?如果你能找到一个合适的网站列表,你可以尝试以下方法: $ curl http://namebench.googlecode.com/svn-history/r495/trunk/data/alexa-top-10000-global.txt > sitelist.txt $ cat sitelist.txt | xargs -P 32 -I {} wget -x -k -t1

我正在编译一个使用jQuery插件()的大型网站列表


有谁能推荐一种最佳/最简单的方法来爬网以使用特定的js库吗?

如果你能找到一个合适的网站列表,你可以尝试以下方法:

$ curl http://namebench.googlecode.com/svn-history/r495/trunk/data/alexa-top-10000-global.txt >  sitelist.txt
$ cat sitelist.txt | xargs -P 32 -I {} wget -x -k -t1 -T1 {}
$ grep -r tokeninput .
./magicbricks.com/index.html:       <script src="http://www.magicbricks.com/scripts/mainJsGroup.js,Mjm.7iF81SLtpJ.js+dwrGroup.js,Mjm.sV7AgY13MG.js+jquery.js,Mjm.bKnjrjdqsX.js+jquery.tokeninput.js,Mjm.44Xrew-eFT.js.pagespeed.jc.XlwW_QiXCc.js"></script><script type='text/javascript'>eval(mod_pagespeed_vEIzknsBWt);</script>
./spoke.com/index.html:<script src="http://www.spoke.com/javascripts/3p/jquery.tokeninput.min.js?1327114061" type="text/javascript"></script>
$ cat `find -name '*.html'` | \grep -o "['\"]http[^'\"]*\?jquery[^'\"]*\?['\"]" | sed -e 's%/[^/]*$%/jquery.tokeninput.js%' | sed -e "s/['\"]//g"|uniq > potential.txt
$ cat potential.txt | xargs -P 32 -I {} wget -x -t 1 -T 5 {}
$ grep -r loopj .
./www.g4tv.com/assets/js/jquery/plugins/jquery.tokeninput.js: * Copyright (c) 2009 James Smith (http://loopj.com)
./static.networkedblogs.com/static/js/jquery.tokeninput.js: * Copyright (c) 2009 James Smith (http://loopj.com)
./www.podomatic.com/javascripts/jquery.tokeninput.js: * Copyright (c) 2009 James Smith (http://loopj.com)
./cdn4.f-cdn.com/js/jquery.tokeninput.js: * Copyright (c) 2009 James Smith (http://loopj.com)
./cdn1.static.youporn.phncdn.com/cb/youpornwebfront/js/jquery.tokeninput.js: * http://loopj.com/jquery-tokeninput/
./scd.hwstatic.com/static/js/1.17.15.1/jquery.tokeninput.js: * Copyright (c) 2009 James Smith (http://loopj.com)
./cdn6.f-cdn.com/js/jquery.tokeninput.js: * Copyright (c) 2009 James Smith (http://loopj.com)
./cdn5.f-cdn.com/js/jquery.tokeninput.js: * Copyright (c) 2009 James Smith (http://loopj.com)
./static.expressz.hu/_expressz_/js/jquery.tokeninput.js: * Copyright (c) 2009 James Smith (http://loopj.com)