How to convert dataframe to a list of dictionary

Question

I have a hive table like

col1 col2 
id1  value1
id2  value2
id2  value3

I would like to covert it into a list of dictionary like

[{"col1": "id1", "col2": "value1"}, {"col1": "id2", "col2": "value2"}, {"col1": "id2", "col2": "value3"}]

Can anyone suggest what is the simplest way to achieve this?

score 1 · Answer 1 · answered Nov 21 '20 at 17:34

1

You can do:

df.to_dict(orient='records')

Source

answered Nov 21 '20 at 17:34

Tom

8,310
2
16
36

Thank you. Yes this is exactly what I need. – GLP Nov 21 '20 at 23:29

score 1 · Answer 2 · answered Nov 21 '20 at 17:35

1

You could use:

df.to_dict('records')

as mentioned in here

answered Nov 21 '20 at 17:35

Kostas Letros

53
1
11

Thank you. Yes this is exactly what I need. – GLP Nov 21 '20 at 23:29

score 0 · Answer 3 · answered Nov 21 '20 at 17:59

For pandas, using df.to_dict('records') is great, but if you'd like to see how we can convert it from a regular dictionary to your expected result:

import pandas as pd

df = pd.DataFrame({'col1': ['id1', 'id2', 'id3'],
                   'col2': ['value1', 'value2', 'value3']})

dct = df.to_dict() # Convert to regular dict
lst = [dict(zip(dct, values)) for values in zip(*[dct[k].values() for k in dct])]

print(lst)

Output:

[{'col1': 'id1', 'col2': 'value1'}, 
 {'col1': 'id2', 'col2': 'value2'}, 
 {'col1': 'id3', 'col2': 'value3'}]

How to convert dataframe to a list of dictionary

3 Answers3