@USBhump A friendly belated update, it looks like YouTube has -finally- added a "..." dropdown in the Watch Later playlist view, letting you remove videos from it without having to open a video or revert to the old UI.
Only took 'em over a month >.>';