How to modify Sort By in the `taxonomy.php` template

Using the Directory Theme on a search results, which seems to use the taxonomy.php theme template, there is the functionality to sort by criteria such as title, date, popularity, featured, rating, and nearest, how would one go about removing some of these options but not all of them. Specifically I would like to remove to sort by date, popularity, and rating and nearest.