I’ve reproduced this. Delete Handler only removes the handler you right-clicked, while pressing Delete with multiple handlers selected removes none.
I’ve logged it here. I’ll fix both paths so they delete the whole selection as one undoable action.
Thanks for reporting it 🙂