Compare two dataframe using pyspark in azure data bricks I have two data frames. first contains id, inUse, otherId second contains id, otherId.