Java 尝试使用HtmlUnit在网站中导航_Java_Html_Parsing_Web Scraping_Htmlunit

Java 尝试使用HtmlUnit在网站中导航

java html parsing web-scraping

Java 尝试使用HtmlUnit在网站中导航,java,html,parsing,web-scraping,htmlunit,Java,Html,Parsing,Web Scraping,Htmlunit,我正在尝试使用HtmlUnit登录约会网站，并浏览其页面。我无法成功完成第一步（登录）。我是初学者，请查看下面的代码。可能是网站限制了机器人本身吗 import com.gargoylesoftware.htmlunit.WebClient; import com.gargoylesoftware.htmlunit.html.HtmlPage; import com.gargoylesoftware.htmlunit.html.HtmlForm; import com.gargoylesoftw

我正在尝试使用HtmlUnit登录约会网站，并浏览其页面。我无法成功完成第一步（登录）。我是初学者，请查看下面的代码。可能是网站限制了机器人本身吗

import com.gargoylesoftware.htmlunit.WebClient;
import com.gargoylesoftware.htmlunit.html.HtmlPage;
import com.gargoylesoftware.htmlunit.html.HtmlForm;
import com.gargoylesoftware.htmlunit.html.HtmlTextInput;
import com.gargoylesoftware.htmlunit.html.HtmlSubmitInput;

public class DataWebBot {


public static void main(String[] args) throws IOException {

   // navigate & fetch HTML        
   final WebClient webClient = new WebClient();

   //Get first page
   final HtmlPage pofLoginPage = webClient.getPage("http://www.pof.com");

   //Get the login form and find the user/password fields and submit button. 
   final HtmlForm loginForm = pofLoginPage.getFormByName("frmLogin");
   final HtmlTextInput usernameField = loginForm.getInputByName("username");
   final HtmlTextInput passwordField = loginForm.getInputByName("password");
   final HtmlSubmitInput loginButton = loginForm.getInputByName("submitbutton");

   //Set value of text field, login and get the second page
   usernameField.setValueAttribute("myUsername");
   passwordField.setValueAttribute("myPassword");

   webClient.getCookieManager().getCookies();

   System.out.println("Complete");
  }
}

我得到了这些错误：

Feb 26, 2014 4:59:38 PM com.gargoylesoftware.htmlunit.javascript.host.ActiveXObject jsConstructor
WARNING: Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash.7'.
Feb 26, 2014 4:59:38 PM com.gargoylesoftware.htmlunit.javascript.StrictErrorReporter runtimeError
SEVERE: runtimeError: message=[Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash.7'.] sourceName=[http://www.pof.com/javascript/versioned/pofcommon.min.1386808612.js] line=[5] lineSource=[null] lineOffset=[0]
Feb 26, 2014 4:59:38 PM com.gargoylesoftware.htmlunit.javascript.host.ActiveXObject jsConstructor
WARNING: Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash.6'.
Feb 26, 2014 4:59:38 PM com.gargoylesoftware.htmlunit.javascript.StrictErrorReporter runtimeError
SEVERE: runtimeError: message=[Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash.6'.] sourceName=[http://www.pof.com/javascript/versioned/pofcommon.min.1386808612.js] line=[5] lineSource=[null] lineOffset=[0]
Feb 26, 2014 4:59:38 PM com.gargoylesoftware.htmlunit.javascript.host.ActiveXObject jsConstructor
WARNING: Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash'.
Feb 26, 2014 4:59:38 PM com.gargoylesoftware.htmlunit.javascript.StrictErrorReporter runtimeError
SEVERE: runtimeError: message=[Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash'.] sourceName=[http://www.pof.com/javascript/versioned/pofcommon.min.1386808612.js] line=[5] lineSource=[null] lineOffset=[0]
Feb 26, 2014 4:59:38 PM com.gargoylesoftware.htmlunit.javascript.host.ActiveXObject jsConstructor
WARNING: Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash'.
Feb 26, 2014 4:59:38 PM com.gargoylesoftware.htmlunit.javascript.StrictErrorReporter runtimeError
SEVERE: runtimeError: message=[Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash'.] sourceName=[http://www.pof.com/javascript/versioned/pofcommon.min.1386808612.js] line=[5] lineSource=[null] lineOffset=[0]
Feb 26, 2014 4:59:39 PM com.gargoylesoftware.htmlunit.IncorrectnessListenerImpl notify
WARNING: Obsolete content type encountered: 'text/javascript'.
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler error
WARNING: CSS error: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:769] Error in expression. (Invalid token "}". Was expecting one of: <S>, <NUMBER>, "inherit", <IDENT>, <STRING>, <PLUS>, <HASH>, <EMS>, <EXS>, <LENGTH_PX>, <LENGTH_CM>, <LENGTH_MM>, <LENGTH_IN>, <LENGTH_PT>, <LENGTH_PC>, <ANGLE_DEG>, <ANGLE_RAD>, <ANGLE_GRAD>, <TIME_MS>, <TIME_S>, <FREQ_HZ>, <FREQ_KHZ>, <PERCENTAGE>, <DIMENSION>, <URI>, <FUNCTION>, "-".)
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler error
WARNING: CSS error: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:8694] Error in style rule. (Invalid token "*". Was expecting one of: <EOF>, <S>, <IDENT>, "}", ";".)
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler warning
WARNING: CSS warning: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:8694] Ignoring the following declarations in this rule.
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler error
WARNING: CSS error: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:8899] Error in style rule. (Invalid token "*". Was expecting one of: <EOF>, <S>, <IDENT>, "}", ";".)
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler warning
WARNING: CSS warning: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:8899] Ignoring the following declarations in this rule.
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler error
WARNING: CSS error: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:9105] Error in style rule. (Invalid token "*". Was expecting one of: <EOF>, <S>, <IDENT>, "}", ";".)
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler warning
WARNING: CSS warning: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:9105] Ignoring the following declarations in this rule.
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler error
WARNING: CSS error: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:9310] Error in style rule. (Invalid token "*". Was expecting one of: <EOF>, <S>, <IDENT>, "}", ";".)
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler warning
WARNING: CSS warning: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:9310] Ignoring the following declarations in this rule.
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler error
WARNING: CSS error: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:9544] Error in style rule. (Invalid token "*". Was expecting one of: <EOF>, <S>, <IDENT>, "}", ";".)
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler warning
WARNING: CSS warning: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:9544] Ignoring the following declarations in this rule.
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler error
WARNING: CSS error: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:12238] Error in style rule. (Invalid token ":". Was expecting one of: <EOF>, <S>, <NUMBER>, "inherit", <IDENT>, <STRING>, <PLUS>, <COMMA>, <HASH>, <IMPORTANT_SYM>, <EMS>, <EXS>, <LENGTH_PX>, <LENGTH_CM>, <LENGTH_MM>, <LENGTH_IN>, <LENGTH_PT>, <LENGTH_PC>, <ANGLE_DEG>, <ANGLE_RAD>, <ANGLE_GRAD>, <TIME_MS>, <TIME_S>, <FREQ_HZ>, <FREQ_KHZ>, <PERCENTAGE>, <DIMENSION>, <URI>, <FUNCTION>, "}", ";", "/", "-".)
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler warning
WARNING: CSS warning: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:12238] Ignoring the following declarations in this rule.
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler error
WARNING: CSS error: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:16850] Error in style rule. (Invalid token "*". Was expecting one of: <EOF>, <S>, <IDENT>, "}", ";".)
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler warning
WARNING: CSS warning: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:16850] Ignoring the following declarations in this rule.
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler error
WARNING: CSS error: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:19023] Error in style rule. (Invalid token ":". Was expecting one of: <EOF>, <S>, <NUMBER>, "inherit", <IDENT>, <STRING>, <PLUS>, <COMMA>, <HASH>, <IMPORTANT_SYM>, <EMS>, <EXS>, <LENGTH_PX>, <LENGTH_CM>, <LENGTH_MM>, <LENGTH_IN>, <LENGTH_PT>, <LENGTH_PC>, <ANGLE_DEG>, <ANGLE_RAD>, <ANGLE_GRAD>, <TIME_MS>, <TIME_S>, <FREQ_HZ>, <FREQ_KHZ>, <PERCENTAGE>, <DIMENSION>, <URI>, <FUNCTION>, "}", ";", "/", "-".)
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.DefaultCssErrorHandler warning
WARNING: CSS warning: 'http://www.pof.com/css/versioned/main.min.1392865551.css' [1:19023] Ignoring the following declarations in this rule.
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.javascript.host.ActiveXObject jsConstructor
WARNING: Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash.7'.
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.javascript.StrictErrorReporter runtimeError
SEVERE: runtimeError: message=[Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash.7'.] sourceName=[http://www.google-analytics.com/ga.js] line=[24] lineSource=[null] lineOffset=[0]
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.javascript.host.ActiveXObject jsConstructor
WARNING: Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash.6'.
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.javascript.StrictErrorReporter runtimeError
SEVERE: runtimeError: message=[Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash.6'.] sourceName=[http://www.google-analytics.com/ga.js] line=[24] lineSource=[null] lineOffset=[0]
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.javascript.host.ActiveXObject jsConstructor
WARNING: Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash'.
Feb 26, 2014 4:59:40 PM com.gargoylesoftware.htmlunit.javascript.StrictErrorReporter runtimeError
SEVERE: runtimeError: message=[Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash'.] sourceName=[http://www.google-analytics.com/ga.js] line=[24] lineSource=[null] lineOffset=[0]
Feb 26, 2014 4:59:41 PM com.gargoylesoftware.htmlunit.IncorrectnessListenerImpl notify
WARNING: Obsolete content type encountered: 'text/javascript'.
Exception in thread "main" java.lang.ClassCastException: com.gargoylesoftware.htmlunit.html.HtmlPasswordInput cannot be cast to com.gargoylesoftware.htmlunit.html.HtmlTextInput
    at DataWebBot.main(DataWebBot.java:28)

2014年2月26日下午4:59:38 com.gargoylesoftware.htmlunit.javascript.host.ActiveXObject jsConstructor
警告：自动化服务器无法为“ShockwaveFlash.ShockwaveFlash.7”创建对象。
2014年2月26日下午4:59:38 com.gargoylesoftware.htmlunit.javascript.StreetErrorReporter运行时错误
严重：运行时错误：消息=[自动化服务器无法为'shockwavelash.shockwavelash.7'创建对象。]sourceName=[http://www.pof.com/javascript/versioned/pofcommon.min.1386808612.js]line=[5]lineSource=[null]lineOffset=[0]
2014年2月26日下午4:59:38 com.gargoylesoftware.htmlunit.javascript.host.ActiveXObject jsConstructor
警告：自动化服务器无法为“ShockwaveFlash.ShockwaveFlash.6”创建对象。
2014年2月26日下午4:59:38 com.gargoylesoftware.htmlunit.javascript.StreetErrorReporter运行时错误
严重：运行时错误：消息=[自动化服务器无法为'shockwavelash.shockwavelash.6'创建对象。]sourceName=[http://www.pof.com/javascript/versioned/pofcommon.min.1386808612.js]line=[5]lineSource=[null]lineOffset=[0]
2014年2月26日下午4:59:38 com.gargoylesoftware.htmlunit.javascript.host.ActiveXObject jsConstructor
警告：自动化服务器无法为“ShockwaveFlash.ShockwaveFlash”创建对象。
2014年2月26日下午4:59:38 com.gargoylesoftware.htmlunit.javascript.StreetErrorReporter运行时错误
严重：运行时错误：消息=[自动化服务器无法为'shockwavelash.shockwavelash'创建对象。]sourceName=[http://www.pof.com/javascript/versioned/pofcommon.min.1386808612.js]line=[5]lineSource=[null]lineOffset=[0]
2014年2月26日下午4:59:38 com.gargoylesoftware.htmlunit.javascript.host.ActiveXObject jsConstructor
警告：自动化服务器无法为“ShockwaveFlash.ShockwaveFlash”创建对象。
2014年2月26日下午4:59:38 com.gargoylesoftware.htmlunit.javascript.StreetErrorReporter运行时错误
严重：运行时错误：消息=[自动化服务器无法为'shockwavelash.shockwavelash'创建对象。]sourceName=[http://www.pof.com/javascript/versioned/pofcommon.min.1386808612.js]line=[5]lineSource=[null]lineOffset=[0]
2014年2月26日下午4:59:39 com.gargoylesoftware.htmlunit.IncorrectnessListenerImpl通知
警告：遇到过时的内容类型：“text/javascript”。
2014年2月26日下午4:59:40 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler错误
警告：CSS错误：'http://www.pof.com/css/versioned/main.min.1392865551.css“[1:769]表达式中存在错误。（无效的标记“}”。应为以下之一：，“继承”，，，，，，，，，，，，，，，，，，，，，，，，，，，，，，，，，，，，，-”
2014年2月26日下午4:59:40 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler错误
警告：CSS错误：'http://www.pof.com/css/versioned/main.min.1392865551.css“[1:8694]样式规则中存在错误。（无效标记“*”。应为以下之一：，“}”，“；”）
2014年2月26日下午4:59:40 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler警告
警告：CSS警告：'http://www.pof.com/css/versioned/main.min.1392865551.css“[1:8694]忽略此规则中的以下声明。
2014年2月26日下午4:59:40 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler错误
警告：CSS错误：'http://www.pof.com/css/versioned/main.min.1392865551.css“[1:8899]样式规则中存在错误。（无效标记“*”。应为以下之一：，“}”，“；”）
2014年2月26日下午4:59:40 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler警告
警告：CSS警告：'http://www.pof.com/css/versioned/main.min.1392865551.css“[1:8899]忽略此规则中的以下声明。
2014年2月26日下午4:59:40 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler错误
警告：CSS错误：'http://www.pof.com/css/versioned/main.min.1392865551.css“[1:9105]样式规则中存在错误。（无效标记“*”。应为以下之一：，“}”，“；”）
2014年2月26日下午4:59:40 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler警告
警告：CSS警告：'http://www.pof.com/css/versioned/main.min.1392865551.css“[1:9105]忽略此规则中的以下声明。
2014年2月26日下午4:59:40 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler错误
警告：CSS错误：'http://www.pof.com/css/versioned/main.min.1392865551.css“[1:9310]样式规则中存在错误。（无效标记“*”。应为以下之一：，“}”，“；”）
2014年2月26日下午4:59:40 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler警告
警告：CSS警告：'http://www.pof.com/css/versioned/main.min.1392865551.css“[1:9310]忽略此规则中的以下声明。
2014年2月26日下午4:59:40 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler错误
警告：CSS错误：'http://www.pof.com/css/versioned/main.min.1392865551.css“[1:9544]样式规则中存在错误。（无效标记“*”。应为以下之一：，“}”，“；”）
2014年2月26日下午4:59:40 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler警告
警告：CSS警告：'http://www.pof.com/css/versioned/main.min.1392865551.css“[1:9544]忽略此规则中的以下声明。
2014年2月26日下午4:59:40 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler错误
警告：CSS错误：'http://www.pof.com/css/versioned/main.min.1392865551.css“[1:12238]样式规则中存在错误。（无效令牌“：”。应为以下之一：，“继承”
2014年2月26日下午4:59:40 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler警告
警告：CSS警告：'http://www.pof.com/css/versioned/main.min.1392865551.css“[1:12238]忽略此规则中的以下声明。
2014年2月26日下午4:59:40 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler错误
警告：CSS错误：'http://www.pof.com/css/versioned/main.min.1392865551.css“[1:16850]样式规则中存在错误。（无效标记“*”。
Exception in thread "main" java.lang.ClassCastException: com.gargoylesoftware.htmlunit.html.HtmlPasswordInput cannot be cast to com.gargoylesoftware.htmlunit.html.HtmlTextInput

final HtmlTextInput passwordField = loginForm.getInputByName("password");

final HtmlPasswordInput passwordField = loginForm.getInputByName("password");