提取进出ipython/jupyter笔记本的泡菜的方法

提取进出ipython/jupyter笔记本的泡菜的方法,python,file-io,ipython-notebook,jupyter-notebook,picklesdoc,Python,File Io,Ipython Notebook,Jupyter Notebook,Picklesdoc,我试图总结一个数据分析项目,它运行在许多ipython/jupyter笔记本上,每个笔记本都相当长。有助于这个过程的一件事是,如果我至少知道整个“输入”pickle的输入和“输出”pickle的输出 做这件事最干净/最快/最有效的方法是什么?我不确定这是否是最好的方法,但至少是一种方法 def summerize_pickles(notebook_path): from IPython.nbformat import current as nbformat import re

我试图总结一个数据分析项目,它运行在许多ipython/jupyter笔记本上,每个笔记本都相当长。有助于这个过程的一件事是,如果我至少知道整个“输入”pickle的输入和“输出”pickle的输出


做这件事最干净/最快/最有效的方法是什么?

我不确定这是否是最好的方法,但至少是一种方法

def summerize_pickles(notebook_path):
    from IPython.nbformat import current as nbformat
    import re

    with open(notebook_path) as fh:
        nb = nbformat.reads_json(fh.read())

    list_of_input_pickles = []
    list_of_output_pickles = []

    for cell in nb["worksheets"][0]["cells"]:
        # This confirms there is at least one pickle in it.
        if cell["cell_type"] != "code" or cell["input"].find("pickle") == -1:   # Skipping over those cells which aren't code or those cells with code but which don't reference "pickle
            continue

        # In case there are multiple lines, it iterates line by line.
        for line in cell["input"].splitlines():
            if line.find("pickle") == -1:  # Skips over lines w/ no mention of "pickle" to potentially reduce the number of times it's searched.
                continue
            ############################    ############################    ############################    ############################
            code_type = str()
            if line.find("pickle.dump") != -1 or line.find(".to_pickle")!= -1:
                code_type = "output"       
            elif line.find("pickle.load") != -1 or line.find(".read_pickle")!= -1:
                code_type = "input"
            else:
                continue   # This tells the code to skip over lines like "import cpickle as pickle"
            ############################    ############################    ############################    ############################
            filename = re.findall(r'"(.*?)"', line)   # This gets all the content between the quotes. See: http://stackoverflow.com/questions/171480/regex-grabbing-values-between-quotation-marks    
            ############################    ############################    ############################    ############################        
            if code_type == "input":
                list_of_input_pickles.append(filename[0])
            elif code_type == "output":
                list_of_output_pickles.append(filename[0])

    pickles_dict = {"input_pickles":list_of_input_pickles,
                    "output_pickles":list_of_output_pickles }

    return pickles_dict

这对泡菜没有帮助,但它确实有助于了解笔记本的结构:请查看印花布工具和其他回复: