There is a method for this - pandas.DataFrame.drop_duplicates :
>>> df.drop_duplicates() Col1 Col2 Col3 0 12 AB 13 1 11 AB 13 3 12 AC 14
You can do it inplace :
>>> df.drop_duplicates(inplace=True) >>> df Col1 Col2 Col3 0 12 AB 13 1 11 AB 13 3 12 AC 14
If you need to get unique values for specific columns:
>>> df[['Col2','Col3']].drop_duplicates() Col2 Col3 0 AB 13 3 AC 14
as @jezrael suggests, you can also use the subset drop_duplicates() parameter:
>>> df.drop_duplicates(subset=['Col2','Col3']) Col1 Col2 Col3 0 12 AB 13 3 12 AC 14
source share