These underground bees are likely yellowjackets which can become very aggressive while defending their nest. It is important to identify the hole where the wasps are coming from, and while wearing protective clothing in the early evening when their activity slows down, place about 2 teaspoons of 5% Sevin dust on the end of a long handle shovel and spread liberally around the entrance of the nest hole. As they exit and enter the entrance hole, they will brush against the Sevin dust.
Following is a link to a North Carolina State University article describing the behavior of yellowjackets.

https://durham.ces.ncsu.edu/2020/05/nows-the-perfect-time-to-test-your-soil/

Thank you,

Gene 

Extension Master Gardener Volunteer