Exploding nested dictionary

[dinahrabe]

I constructed a nested dictionary with all information of the books, poems, stanza and lines. In total it has 4 layers (book, poem title, stanza number, lines). I tried to use stack() and explode() to transform it into a dataframe. But it only works if there are only 3 layers (so for each book separately). Now with the 4 layers, it removes the "deepest" level when trying to explode() it. Someone any clue/idea on that?

[mcallaghan]

Hm, I don't know if I have ever "exploded" a dictionary. Can you give an example of your data structure?

[mcallaghan]

My solution for getting things into pandas is often a list of dictionaries, which looks like this:

[   {   'book': 'SONGS OF INNOCENCE',
        'line_n': 0,
        'poem': 'INTRODUCTION',
        'stanza_n': 0,
        'text': 'Piping down the valleys wild,'},
    {   'book': 'SONGS OF INNOCENCE',
        'line_n': 1,
        'poem': 'INTRODUCTION',
        'stanza_n': 0,
        'text': 'Piping songs of pleasant glee,'}]

Then you can simply do df = pd.DataFrame.from_dict.

Perhaps you can construct data like this by iterating through your levels?