What is this wasp/hornet-like insect that is black with two yellow stripes?
Your hunch was correct. This is not a moth but is a type of wasp. It looks like a Double-banded Scoliid (Scolia bicincta). https://www.marylandbiodiversity.com/view/10194
In general, scoliid waps are good natural predators in the environment.