A passage set is used for doors that do not need to be locked, like hallways or closets, while a privacy set has a locking mechanism and is used for rooms where privacy is needed, like bedrooms or bathrooms.