Python 如何保存爬网(刮取、流式处理)结果?
crwaling(刮削、流化)效果非常好 例973:{'text':'RT@1111:hihi'} 但是!无法保存 我怎么修理它Python 如何保存爬网(刮取、流式处理)结果?,python,twitter,web-scraping,stream,web-crawler,Python,Twitter,Web Scraping,Stream,Web Crawler,crwaling(刮削、流化)效果非常好 例973:{'text':'RT@1111:hihi'} 但是!无法保存 我怎么修理它 import tweepy import time import os import json import simplejson search_term = '5555' search_term2= '4444' search_term3='3333' search_term4='2222' search_term5='1111' lat = "11.11" l
import tweepy
import time
import os
import json
import simplejson
search_term = '5555'
search_term2= '4444'
search_term3='3333'
search_term4='2222'
search_term5='1111'
lat = "11.11"
lon = "11.11"
radius = "100km"
API_key = "0"
API_secret = "0"
Access_token = "0"
Access_token_secret = "0"
location = "%s,%s,%s" % (lat, lon, radius)
auth = tweepy.OAuthHandler(API_key, API_secret)
auth.set_access_token(Access_token, Access_token_secret)
api = tweepy.API(auth)
c=tweepy.Cursor(api.search,
q="{}+OR+{}".format(search_term, search_term2, search_term3, search_term4, search_term5),
rpp=1000,
geocode=location,
include_entities=True)
data = {}
i = 1
for tweet in c.items():
data['text'] = tweet.text
print(i, ":", data)
time.sleep(0.4)
i += 1
未创建txt文件。->没有错误消息
或者,生成txt文件。但是,txt中没有“tweet文本和tweet日期”。->没有错误消息
(不一定是txt文件。保存Excel文件。)
你可以试着用泡菜
import pickle
pickle.dump(obj, filename)
要将其加载回pickle.load(文件名)您可以尝试使用pickle
import pickle
pickle.dump(obj, filename)
要将其加载回,请执行以下操作:result=pickle.load(文件名)