Python 如何使用pandas读取json字典类型文件?

Python 如何使用pandas读取json字典类型文件?,python,json,parsing,pandas,io,Python,Json,Parsing,Pandas,Io,我有一个很长的json,如下所示: 我想将其放置到一个框架中,以便使用它,因此根据文档,我执行以下操作: df = pd.read_json('/user/file.json') print df 我得到了这个回溯: File "/Users/user/PycharmProjects/PAN-pruebas/json_2_dataframe.py", line 6, in <module> df = pd.read_json('/Users/user/Downloads

我有一个很长的json,如下所示:

我想将其放置到一个框架中,以便使用它,因此根据文档,我执行以下操作:

df = pd.read_json('/user/file.json')
print df
我得到了这个回溯:

  File "/Users/user/PycharmProjects/PAN-pruebas/json_2_dataframe.py", line 6, in <module>
    df = pd.read_json('/Users/user/Downloads/54db3923f033e1dd6a82222aa2604ab9.json')
  File "/usr/local/lib/python2.7/site-packages/pandas/io/json.py", line 198, in read_json
    date_unit).parse()
  File "/usr/local/lib/python2.7/site-packages/pandas/io/json.py", line 266, in parse
    self._parse_no_numpy()
  File "/usr/local/lib/python2.7/site-packages/pandas/io/json.py", line 483, in _parse_no_numpy
    loads(json, precise_float=self.precise_float), dtype=None)
  File "/usr/local/lib/python2.7/site-packages/pandas/core/frame.py", line 203, in __init__
    mgr = self._init_dict(data, index, columns, dtype=dtype)
  File "/usr/local/lib/python2.7/site-packages/pandas/core/frame.py", line 327, in _init_dict
    dtype=dtype)
  File "/usr/local/lib/python2.7/site-packages/pandas/core/frame.py", line 4620, in _arrays_to_mgr
    index = extract_index(arrays)
  File "/usr/local/lib/python2.7/site-packages/pandas/core/frame.py", line 4668, in extract_index
    raise ValueError('arrays must all be same length')
ValueError: arrays must all be same length

但是我不知道我应该如何获得像numpy数组一样的内容。如何在这样的大文件中保留数组的长度?。提前谢谢

json方法不起作用,因为json文件的格式不是它期望的格式。因为我们可以轻松地将json作为dict加载,所以让我们尝试以下方法:

import pandas as pd
import json
import os

os.chdir('/Users/nicolas/Downloads')

# Reading the json as a dict
with open('json_example.json') as json_data:
    data = json.load(json_data)

# using the from_dict load function. Note that the 'orient' parameter 
#is not using the default value (or it will give the same error that you got before)
# We transpose the resulting df and set index column as its index to get this result
pd.DataFrame.from_dict(data, orient='index').T.set_index('index')   
输出:

                                                                 data columns
index                                                                        
311210177061863424  [25-34\n, FEMALE, @bikewa absolutely the best....     age
310912785183813632  [25-34\n, FEMALE, Photo: I love the Burke-Gilm...  gender
311290293871849472  [25-34\n, FEMALE, Photo: Inhaled! #fitfoodie h...    text
309386414548717569  [25-34\n, FEMALE, Facebook Is Making The Most ...    None
312327801187495936  [25-34\n, FEMALE, Still upset about this &gt;&...    None
312249421079400449  [25-34\n, FEMALE, @JoeM_PM_UK @JonAntoine I've...    None
308692673194246145  [25-34\n, FEMALE, @Social_Freedom_ actually, t...    None
308995226633129984  [25-34\n, FEMALE, @seattleweekly that's more t...    None
308660851219501056  [25-34\n, FEMALE, @adamholdenbache I noticed 1...    None
308658690528014337  [25-34\n, FEMALE, @CEM_Social I am waiting pat...    None
309719798001070080  [25-34\n, FEMALE, Going to be watching Faceboo...    None
312349448049152002  [25-34\n, FEMALE, @anikamarketer I applied for...    None
312325152698404864  [25-34\n, FEMALE, @_chrisrojas_ wow, that's so...    None
310546490844135425  [25-34\n, FEMALE, Photo: Feeling like a bit of...    None

答案应该是熊猫模块而不是json模块: pandas本身具有读取json的功能,问题的根源必须是您没有以正确的方向读取json。 您必须首先传递创建json变量时使用的确切的orient参数

例:

然后:

read_to_json = pd.read_json(df_json, orient='split')

它看起来像一本字典。非常感谢@KnightOfNII的帮助,如果有人遇到这个错误:
JSON对象必须是str、bytes或bytearray,而不是TextIOWrapper
,注意它使用的是
JSON.load()
而不是
JSON.loads()
,它必须是
JSON.loads(JSON\u data.read())
df_json = globals()['df'].to_json(orient='split')
read_to_json = pd.read_json(df_json, orient='split')