Python 使用pandas或numpy填充缺少的timeseries数据

Python 使用pandas或numpy填充缺少的timeseries数据,python,list,numpy,dictionary,pandas,Python,List,Numpy,Dictionary,Pandas,我有一个字典列表,如下所示: L=[ { "timeline": "2014-10", "total_prescriptions": 17 }, { "timeline": "2014-11", "total_prescriptions": 14 }, { "timeline": "2014-12", "total_prescriptions": 8 }, { "timeline": "2015-1", "total_prescriptions": 4 }, { "timeline

我有一个字典列表,如下所示:

L=[
{
"timeline": "2014-10", 
"total_prescriptions": 17
}, 
{
"timeline": "2014-11", 
"total_prescriptions": 14
}, 
{
"timeline": "2014-12", 
"total_prescriptions": 8
},
{
"timeline": "2015-1", 
"total_prescriptions": 4
}, 
{
"timeline": "2015-3", 
"total_prescriptions": 10
}, 
{
"timeline": "2015-4", 
"total_prescriptions": 3
} 
]
这基本上是SQL查询的结果,当给定开始日期和结束日期时,会给出从开始日期到结束月份的每个月的总处方数。但是,对于处方数为0的月份(2015年2月),它完全跳过了该月。是否可以使用pandas或numpy更改此列表,以便为缺少的月份添加一个条目,其中0作为总处方,如下所示:

[
{
"timeline": "2014-10", 
"total_prescriptions": 17
}, 
{
"timeline": "2014-11", 
"total_prescriptions": 14
}, 
{
"timeline": "2014-12", 
"total_prescriptions": 8
{
"timeline": "2015-1", 
"total_prescriptions": 4
}, 
{
"timeline": "2015-2",   # 2015-2 to be inserted for missing month
"total_prescriptions": 0 # 0 to be inserted for total prescription
}, 
{
"timeline": "2015-3", 
"total_prescriptions": 10
}, 
{
"timeline": "2015-4", 
"total_prescriptions": 3
} 
]

你所说的在熊猫中被称为“重采样”;首先将时间转换为numpy datetime并设置为索引:

df = pd.DataFrame(L)
df.index=pd.to_datetime(df.timeline,format='%Y-%m')
df
           timeline  total_prescriptions
timeline                                
2014-10-01  2014-10                   17
2014-11-01  2014-11                   14
2014-12-01  2014-12                    8
2015-01-01   2015-1                    4
2015-03-01   2015-3                   10
2015-04-01   2015-4                    3
然后,您可以使用
resample('MS')
(我猜MS代表“月开始”),添加缺少的月份,并使用
fillna(0)
将空值转换为零,如您所需

df = df.resample('MS').fillna(0)
df
            total_prescriptions
timeline                       
2014-10-01                   17
2014-11-01                   14
2014-12-01                    8
2015-01-01                    4
2015-02-01                  NaN
2015-03-01                   10
2015-04-01                    3
要将日期时间索引转换回原始格式,请使用
将日期时间索引转换回字符串,然后使用
将其导出到dict(“记录”)


这真的很好..正是我需要的..你知道在添加了缺少的日期后如何将df转换回字典列表吗..好的..我算出了..df.to_dict('records'))…非常感谢你在这方面的帮助OK..我有点太激动了..当我这么做的时候..它只是给了我全部的处方..我如何才能得到原始的列表附加说明以转换回原始格式
df['timeline']=df.index.to_native_types()
df.to_dict('records')
[{'timeline': '2014-10-01', 'total_prescriptions': 17.0},
 {'timeline': '2014-11-01', 'total_prescriptions': 14.0},
 {'timeline': '2014-12-01', 'total_prescriptions': 8.0},
 {'timeline': '2015-01-01', 'total_prescriptions': 4.0},
 {'timeline': '2015-02-01', 'total_prescriptions': 0.0},
 {'timeline': '2015-03-01', 'total_prescriptions': 10.0},
 {'timeline': '2015-04-01', 'total_prescriptions': 3.0}]