These are the nymph stage of milkweed bugs. A native bug, it does not do significant harm. However, if you are trying to collect seeds, its feeding can have a negative impact on seed formation.
Knocking them into soapy water is probably the easiest solution.
Here's more: https://www.missouribotanicalgarden.org/gardens-gardening/your-garden/help-for-the-home-gardener/adv...