All geek questions in one place

The row contains two pandas series

I have a series with some lines in a pandas frame. I would like to find the existence of this row in a neighboring column.

In the example below, I would like to search if the row in the selection series is contained in the fruit series, returning either true (1) or false (0) in the new choice_match column.

Example DataFrame:

import pandas as pd
d = {'ID': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10], 'fruit': [
'apple, banana', 'apple', 'apple', 'pineapple', 'apple, pineapple',            'orange', 'apple, orange', 'orange', 'banana', 'apple, peach'],
'choice': ['orange', 'orange', 'apple', 'pineapple', 'apple', 'orange',  'orange', 'orange', 'banana', 'banana']}
df = pd.DataFrame(data=d)

Required data format:

import pandas as pd
d = {'ID': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10], 'fruit': [
'apple, banana', 'apple', 'apple', 'pineapple', 'apple, pineapple',   'orange', 'apple, orange', 'orange', 'banana', 'apple, peach'],
'choice': ['orange', 'orange', 'apple', 'pineapple', 'apple', 'orange',      'orange', 'orange', 'banana', 'banana'],
'choice_match': [0, 0, 1, 1, 1, 1, 1, 1, 1, 0]}
df = pd.DataFrame(data=d)
+4
source share
4 answers

Here is one way:

df['choice_match'] = df.apply(lambda row: row['choice'] in row['fruit'].split(','),\
                              axis=1).astype(int)

Explanation

  • df.applywith axis=1loops through each line and applies logic; It takes anonymous functions lambda.
  • row['fruit'].split(',')creates a list from a column fruit. This is necessary, so that, for example, is applenot considered in pineapple.
  • astype(int) .
+5
In [75]: df['choice_match'] = (df['fruit']
                                 .str.split(',\s*', expand=True)
                                 .eq(df['choice'], axis=0)
                                 .any(1).astype(np.int8))

In [76]: df
Out[76]:
   ID     choice             fruit  choice_match
0   1     orange     apple, banana             0
1   2     orange             apple             0
2   3      apple             apple             1
3   4  pineapple         pineapple             1
4   5      apple  apple, pineapple             1
5   6     orange            orange             1
6   7     orange     apple, orange             1
7   8     orange            orange             1
8   9     banana            banana             1
9  10     banana      apple, peach             0

:

In [78]: df['fruit'].str.split(',\s*', expand=True)
Out[78]:
           0          1
0      apple     banana
1      apple       None
2      apple       None
3  pineapple       None
4      apple  pineapple
5     orange       None
6      apple     orange
7     orange       None
8     banana       None
9      apple      peach

In [79]: df['fruit'].str.split(',\s*', expand=True).eq(df['choice'], axis=0)
Out[79]:
       0      1
0  False  False
1  False  False
2   True  False
3   True  False
4   True  False
5   True  False
6  False   True
7   True  False
8   True  False
9  False  False

In [80]: df['fruit'].str.split(',\s*', expand=True).eq(df['choice'], axis=0).any(1)
Out[80]:
0    False
1    False
2     True
3     True
4     True
5     True
6     True
7     True
8     True
9    False
dtype: bool

In [81]: df['fruit'].str.split(',\s*', expand=True).eq(df['choice'], axis=0).any(1).astype(np.int8)
Out[81]:
0    0
1    0
2    1
3    1
4    1
5    1
6    1
7    1
8    1
9    0
dtype: int8
+5

Option 1
Use Numpy find
When it finddoes not find the value, it returns-1

from numpy.core.defchararray import find

choice = df.choice.values.astype(str)
fruit = df.fruit.values.astype(str)

df.assign(choice_match=(find(fruit, choice) > -1).astype(np.uint))

   ID     choice             fruit  choice_match
0   1     orange     apple, banana             0
1   2     orange             apple             0
2   3      apple             apple             1
3   4  pineapple         pineapple             1
4   5      apple  apple, pineapple             1
5   6     orange            orange             1
6   7     orange     apple, orange             1
7   8     orange            orange             1
8   9     banana            banana             1
9  10     banana      apple, peach             0

Option 2
Setting logic
C set <there is a strict subset, and <=a subset. Make yourself pd.Seriesout setand use <=to find out if some columns are a subset of other sets of columns.

choice = df.choice.apply(lambda x: set([x]))
fruit = df.fruit.str.split(', ').apply(set)

df.assign(choice_match=(choice <= fruit).astype(np.uint))

   ID     choice             fruit  choice_match
0   1     orange     apple, banana             0
1   2     orange             apple             0
2   3      apple             apple             1
3   4  pineapple         pineapple             1
4   5      apple  apple, pineapple             1
5   6     orange            orange             1
6   7     orange     apple, orange             1
7   8     orange            orange             1
8   9     banana            banana             1
9  10     banana      apple, peach             0

Option 3
Inspired by @Wen answer
Using get_dummiesandmax

c = pd.get_dummies(df.choice)
f = df.fruit.str.get_dummies(', ')
df.assign(choice_match=pd.DataFrame.mul(*c.align(f, 'inner')).max(1))

   ID     choice             fruit  choice_match
0   1     orange     apple, banana             0
1   2     orange             apple             0
2   3      apple             apple             1
3   4  pineapple         pineapple             1
4   5      apple  apple, pineapple             1
5   6     orange            orange             1
6   7     orange     apple, orange             1
7   8     orange            orange             1
8   9     banana            banana             1
9  10     banana      apple, peach             0
+4
source

Ummm find an interesting way get_dummies

(df.fruit.str.replace(' ','').str.get_dummies(',')+df.choice.str.get_dummies()).gt(1).any(1)
Out[726]: 
0    False
1    False
2     True
3     True
4     True
5     True
6     True
7     True
8     True
9    False
dtype: bool

After appointing him

df['New']=(df.fruit.str.replace(' ','').str.get_dummies(',')+df.choice.str.get_dummies()).gt(1).any(1).astype(int)
df
Out[728]: 
   ID     choice             fruit  New
0   1     orange     apple, banana    0
1   2     orange             apple    0
2   3      apple             apple    1
3   4  pineapple         pineapple    1
4   5      apple  apple, pineapple    1
5   6     orange            orange    1
6   7     orange     apple, orange    1
7   8     orange            orange    1
8   9     banana            banana    1
9  10     banana      apple, peach    0
+3
source

Source: https://habr.com/ru/post/1694270/

More articles:


All Articles