Insect nest identification
These look like nests of mud dauber wasps. They are beneficial predators of spiders and they are not aggressive like other wasps or yellow jackets.
The mud nests can be scraped off and discarded at night if they are objectionable.
There is additional information in the links below.