Python 如何使用pandas读取json字典类型文件?
我有一个很长的json,如下所示: 我想将其放置到一个框架中,以便使用它,因此根据文档,我执行以下操作:Python 如何使用pandas读取json字典类型文件?,python,json,parsing,pandas,io,Python,Json,Parsing,Pandas,Io,我有一个很长的json,如下所示: 我想将其放置到一个框架中,以便使用它,因此根据文档,我执行以下操作: df = pd.read_json('/user/file.json') print df 我得到了这个回溯: File "/Users/user/PycharmProjects/PAN-pruebas/json_2_dataframe.py", line 6, in <module> df = pd.read_json('/Users/user/Downloads
df = pd.read_json('/user/file.json')
print df
我得到了这个回溯:
File "/Users/user/PycharmProjects/PAN-pruebas/json_2_dataframe.py", line 6, in <module>
df = pd.read_json('/Users/user/Downloads/54db3923f033e1dd6a82222aa2604ab9.json')
File "/usr/local/lib/python2.7/site-packages/pandas/io/json.py", line 198, in read_json
date_unit).parse()
File "/usr/local/lib/python2.7/site-packages/pandas/io/json.py", line 266, in parse
self._parse_no_numpy()
File "/usr/local/lib/python2.7/site-packages/pandas/io/json.py", line 483, in _parse_no_numpy
loads(json, precise_float=self.precise_float), dtype=None)
File "/usr/local/lib/python2.7/site-packages/pandas/core/frame.py", line 203, in __init__
mgr = self._init_dict(data, index, columns, dtype=dtype)
File "/usr/local/lib/python2.7/site-packages/pandas/core/frame.py", line 327, in _init_dict
dtype=dtype)
File "/usr/local/lib/python2.7/site-packages/pandas/core/frame.py", line 4620, in _arrays_to_mgr
index = extract_index(arrays)
File "/usr/local/lib/python2.7/site-packages/pandas/core/frame.py", line 4668, in extract_index
raise ValueError('arrays must all be same length')
ValueError: arrays must all be same length
但是我不知道我应该如何获得像numpy数组一样的内容。如何在这样的大文件中保留数组的长度?。提前谢谢 json方法不起作用,因为json文件的格式不是它期望的格式。因为我们可以轻松地将json作为dict加载,所以让我们尝试以下方法:
import pandas as pd
import json
import os
os.chdir('/Users/nicolas/Downloads')
# Reading the json as a dict
with open('json_example.json') as json_data:
data = json.load(json_data)
# using the from_dict load function. Note that the 'orient' parameter
#is not using the default value (or it will give the same error that you got before)
# We transpose the resulting df and set index column as its index to get this result
pd.DataFrame.from_dict(data, orient='index').T.set_index('index')
输出:
data columns
index
311210177061863424 [25-34\n, FEMALE, @bikewa absolutely the best.... age
310912785183813632 [25-34\n, FEMALE, Photo: I love the Burke-Gilm... gender
311290293871849472 [25-34\n, FEMALE, Photo: Inhaled! #fitfoodie h... text
309386414548717569 [25-34\n, FEMALE, Facebook Is Making The Most ... None
312327801187495936 [25-34\n, FEMALE, Still upset about this >&... None
312249421079400449 [25-34\n, FEMALE, @JoeM_PM_UK @JonAntoine I've... None
308692673194246145 [25-34\n, FEMALE, @Social_Freedom_ actually, t... None
308995226633129984 [25-34\n, FEMALE, @seattleweekly that's more t... None
308660851219501056 [25-34\n, FEMALE, @adamholdenbache I noticed 1... None
308658690528014337 [25-34\n, FEMALE, @CEM_Social I am waiting pat... None
309719798001070080 [25-34\n, FEMALE, Going to be watching Faceboo... None
312349448049152002 [25-34\n, FEMALE, @anikamarketer I applied for... None
312325152698404864 [25-34\n, FEMALE, @_chrisrojas_ wow, that's so... None
310546490844135425 [25-34\n, FEMALE, Photo: Feeling like a bit of... None
答案应该是熊猫模块而不是json模块: pandas本身具有读取json的功能,问题的根源必须是您没有以正确的方向读取json。 您必须首先传递创建json变量时使用的确切的orient参数 例: 然后:
read_to_json = pd.read_json(df_json, orient='split')
它看起来像一本字典。非常感谢@KnightOfNII的帮助,如果有人遇到这个错误:
JSON对象必须是str、bytes或bytearray,而不是TextIOWrapper
,注意它使用的是JSON.load()
而不是JSON.loads()
,它必须是JSON.loads(JSON\u data.read())
df_json = globals()['df'].to_json(orient='split')
read_to_json = pd.read_json(df_json, orient='split')