Java 无法使用Android意图从Internet上刮取数据

Java 无法使用Android意图从Internet上刮取数据,java,android,android-intent,android-intentservice,Java,Android,Android Intent,Android Intentservice,我无法使用Android中的意图从网页中刮取标题。目前,我只想从URL中提取标题文本h1标记文本。我写了一段代码,用于提取onHandleIntentIntent意图中的标题文本,但我认为我做错了什么。我的基本目标是在Android上编写一个webcrawler。有人能帮我吗?这是我的密码 MainActivity.java类 package com.example.awais.check2; import android.app.Activity; import android.conten

我无法使用Android中的意图从网页中刮取标题。目前,我只想从URL中提取标题文本h1标记文本。我写了一段代码,用于提取onHandleIntentIntent意图中的标题文本,但我认为我做错了什么。我的基本目标是在Android上编写一个webcrawler。有人能帮我吗?这是我的密码

MainActivity.java类

package com.example.awais.check2;

import android.app.Activity;
import android.content.BroadcastReceiver;
import android.content.Context;
import android.content.Intent;
import android.content.IntentFilter;
import android.os.Bundle;
import android.view.View;
import android.widget.Button;

public class MainActivity extends Activity {

    private MyWebRequestReceiver receiver;

    @Override
    public void onCreate(Bundle savedInstanceState) {
        super.onCreate(savedInstanceState);
        setContentView(R.layout.activity_main);

        IntentFilter filter = new IntentFilter(MyWebRequestReceiver.PROCESS_RESPONSE);
        filter.addCategory(Intent.CATEGORY_DEFAULT);

        receiver = new MyWebRequestReceiver();
        registerReceiver(receiver, filter);

        Button addButton = (Button) findViewById(R.id.sendRequest);
        addButton.setOnClickListener(new View.OnClickListener() {
            public void onClick(View view) {
                System.out.println("Clicked");

                Intent msgIntent = new Intent(MainActivity.this, MyWebRequest.class);

                msgIntent.putExtra(MyWebRequest.REQUEST_STRING, "http://tribune.com.pk");
                startService(msgIntent);
            }
        });

    }

    @Override
    public void onDestroy() {
        this.unregisterReceiver(receiver);
        super.onDestroy();
    }

    public class MyWebRequestReceiver extends BroadcastReceiver{

        public static final String PROCESS_RESPONSE = "com.example.check.intent.action.PROCESS_RESPONSE";

        @Override
        public void onReceive(Context context, Intent intent) {
            String responseString = intent.getStringExtra(MyWebRequest.RESPONSE_STRING);
            String reponseMessage = intent.getStringExtra(MyWebRequest.RESPONSE_MESSAGE);

            System.out.println(reponseMessage);
            System.out.println(responseString);
        }
    }
}
MyWebRequest.java类代码

package com.example.awais.check2;

import android.app.IntentService;
import android.content.Intent;
import android.os.SystemClock;
import android.text.format.DateFormat;
import android.util.Log;

import com.example.awais.check2.MainActivity.MyWebRequestReceiver;

import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.select.Elements;

import java.io.IOException;

public class MyWebRequest  extends IntentService {

    public static final String REQUEST_STRING = "myRequest";
    public static final String RESPONSE_STRING = "myResponse";
    public static final String RESPONSE_MESSAGE = "myResponseMessage";

    private String URL = null;

    public MyWebRequest() {
        super("MyWebRequest");
    }

    @Override
    protected void onHandleIntent(Intent intent) {

        String requestString = intent.getStringExtra(REQUEST_STRING);
        String responseString = requestString + " " + DateFormat.format("MM/dd/yy h:mmaa", System.currentTimeMillis());
        String responseMessage = "";

        try {
            Document doc;
            URL = requestString;
            doc = Jsoup.connect(URL).timeout(20 * 1000).get();
//            System.out.println(doc.text());
            Elements links = doc.select("h1");
            responseMessage = links.text();
//            System.out.println(links.text());
        } catch (IOException e) {
            responseMessage = e.getMessage();
        }


        Intent broadcastIntent = new Intent();
        broadcastIntent.setAction(MyWebRequestReceiver.PROCESS_RESPONSE);
        broadcastIntent.addCategory(Intent.CATEGORY_DEFAULT);
        broadcastIntent.putExtra(RESPONSE_STRING, responseString);
        broadcastIntent.putExtra(RESPONSE_MESSAGE, responseMessage);
        sendBroadcast(broadcastIntent);
    }
}
Content.xml代码

<?xml version="1.0" encoding="utf-8"?>
<LinearLayout xmlns:android="http://schemas.android.com/apk/res/android"
    android:orientation="vertical" android:layout_width="fill_parent"
    android:layout_height="fill_parent"
    android:paddingLeft="10dp">


    <Button android:text="Send Request " android:id="@+id/sendRequest"
        android:layout_width="wrap_content" android:layout_height="wrap_content" />


</LinearLayout>

您是否考虑过在Android上使用http框架?它的代码要少得多,还可以在后台运行请求。此示例使用

build.gradle:

compile 'com.loopj.android:android-async-http:1.4.9'
compile 'cz.msebera.android:httpclient:4.4.1.2'
测试代码:

@Test
public void parseHttp() throws Exception {

    AsyncHttpClient client = new AsyncHttpClient();
    final CountDownLatch latch = new CountDownLatch(1);

    String url = "http://stackoverflow.com/questions/38959381/unable-to-scrape-data-from-internet-using-android-intents";

    client.get(url, new AsyncHttpResponseHandler(Looper.getMainLooper()) {
        @Override
        public void onSuccess(int statusCode, Header[] headers, byte[] responseBody) {
            String body = new String(responseBody);
            Pattern p = Pattern.compile("<h1(.*)<\\/h1>");
            Matcher m = p.matcher(body);
            Log.d("tag", "success");
            if ( m.find() ) {
                String match = m.group(1);
                Log.d("tag", match);
            }
            latch.countDown();
        }

        @Override
        public void onFailure(int statusCode, Header[] headers, byte[] responseBody, Throwable error) {

            Log.d("tag", "failure");
            latch.countDown();
        }
    });

    latch.await();
}

你需要更好地解释这个问题,这样人们才能更好地知道如果他们想帮助你,应该去哪里寻找。与你期望的相比,发生了什么/没有发生什么?有什么错误吗?等等…@codeMagic不!没有错误。我只是编译它。什么也没发生。我想向互联网发送请求时有问题。非常感谢。我想编译这段代码,但onSuccess->Header的参数提供了导入选项。它将其作为PreferenceActivity.Header[]导入,然后是client.geturl,即新的AsyncHttpResponseHandlerLooper.getMainLooper{line要求再次添加未实现的方法,这些方法是成功的,还是失败的。我做错了吗?请检查上面的附加渐变依赖项。顺便说一句,如果你还没有弄清楚,倒计时锁存器仅用于单元测试。你的应用程序中不需要它们。
import cz.msebera.android.httpclient.Header;
import cz.msebera.android.httpclient.HttpRequest;
import cz.msebera.android.httpclient.HttpResponse;
import cz.msebera.android.httpclient.HttpStatus;