Managing widget text and interactions in Notes

Using the drop down to add either the text or interactions makes sense, but I think removing them seems a little weird. I know it’s acting like a toggle since it’s on or off, but I wonder if a remove icon in the note couldn’t work here. Maybe on hover or something.