I'd recommend Postman for this.
- It supports all HTTP verbs, not just GET, POST, PUT and DELETE. Some operations might require HTTP headers to be set (e.g. for authentication) and it supports that too.
- You can supply a raw body for your request, or key-value pairs which Postman can transform into e.g. URL encoded form content.
- It has a UI.
- While it does offer additional functionality like collaboration, I'm using it myself just for basic functionality like grouping and saving requests.
- It's free and runs on Windows and a couple of other OSes.