Intersection of two list of dictionaries based on a key

Question

I have two different list of dictionaries,

list1 = [{'count': 351, 'att_value': 'one'},
         {'count': 332,  'att_value': 'two'},
         {'count': 336,  'att_value': 'six'},
         {'count': 359,  'att_value': 'nine'},
         {'count': 304,  'att_value': 'four'}]

list2 = [{'count': 359,'person_id' : 4},
         {'count': 351, 'person_id' : 12},
         {'count': 381, 'person_id' : 8}]

How to find an intersection of list_A with list_B based on "count" key by including rest of the key as like list_C?

list3 = [{'count':359, 'att_value' : 'nine', 'person_id':4},
         {'count':351, 'att_value' : 'one', 'person_id':12},
         {'count':381, 'att_value' : '-', 'person_id':8}]

I would like to retain the keys from list2, but with missing values from list1 represented by "-".

Mayank Porwal · Answer 1 · 2018-12-22T06:55:51.810

13

You can also use pandas library for this:

In [102]: df1 = pd.DataFrame(list1)
In [104]: df2 = pd.DataFrame(list2)

In [106]: pd.merge(df2,df1, on='count', how='left').fillna('-')
Out[106]: 
     count att_value
0    359      nine
1    351       one
2    381         -

edited Dec 22 '18 at 06:55

answered Dec 21 '18 at 06:15

Mayank Porwal

33,470
8
37
58

cs95 · Accepted Answer · 2018-12-21T10:05:39.797

You can do this with a list comprehension. First, build a set of all counts from list2, and then filter out dictionaries based on constant time set membership check.

counts = {d2['count'] for d2 in list2}
list3 = [d for d in list1 if d['count'] in counts]

print(list3)
# [{'count': 351, 'att_value': 'one', 'person_id': 12}, 
#  {'count': 359, 'att_value': 'nine', 'person_id': 4}]

(Re:Edit) To handle other keys (besides just "att_value") appropriately, giving a default value of '-' in the same way, you can use:

keys = list1[0].keys() - {'count'}
idx = {d['count'] : d for d in list1}
list3 = []
for d in list2:
    d2 = idx.get(d['count'], dict.fromkeys(keys, '-'))
    d2.update(d)
    list3.append(d2)

print(list3)
# [{'count': 359, 'att_value': 'nine', 'person_id': 4},
#  {'count': 351, 'att_value': 'one', 'person_id': 12},
#  {'person_id': 8, 'att_value': '-', 'count': 381}]

timgeb · Answer 3 · 2018-12-21T09:43:13.167

Assuming the dictionaries in list1 share the same keys and that you have Python 3.5 or newer, you can write the following list comprehension.

>>> count2dict = {d['count']:d for d in list1}                                                                                                                  
>>> dummies = dict.fromkeys(list1[0], '-')                                                                                                                      
>>> [{**count2dict.get(d['count'], dummies), **d} for d in list2]                                                                                              
[{'count': 359, 'att_value': 'nine', 'person_id': 4},
 {'count': 351, 'att_value': 'one', 'person_id': 12},
 {'count': 381, 'att_value': '-', 'person_id': 8}]

score 2 · Answer 4 · answered Dec 21 '18 at 12:43

With a more verbose for loop, updates objects of list2:

for item2 in list2:
  item2['att_value'] = '-'
  item1 = [ item1 for item1 in list1 if item1['count'] == item2['count'] ]
  if item1: item2.update(item1[0])

print(list2)
#=> [{'count': 359, 'person_id': 4, 'att_value': 'nine'}, {'count': 351, 'person_id': 12, 'att_value': 'one'}, {'count': 381, 'person_id': 8, 'att_value': '-'}]

Intersection of two list of dictionaries based on a key

4 Answers4

Linked