DataFrame.drop_duplicates()
pandas.DataFrame.drop_duplicates
-
DataFrame.drop_duplicates(*args, **kwargs)
-
Return DataFrame with duplicate rows removed, optionally only considering certain columns
Parameters: subset : column label or sequence of labels, optional
Only consider certain columns for identifying duplicates, by default use all of the columns
keep : {‘first’, ‘last’, False}, default ‘first’
-
first
: Drop duplicates except for the first occurrence. -
last
: Drop duplicates except for the last occurrence. - False : Drop all duplicates.
-