Are these tent caterpillars?
This late in the season it is probably not Eastern tent caterpillar or Forest tent caterpillar. This article shows pictures of these two caterpillars so you can be sure of ID.
It is probably Fall webworm
This article recommends doing nothing or pulling the web and worms from the tree. Just spraying the web with insecticide is not effective because the worms are generally on the inside. If you catch it early you can just cut it off and dispose of it.
Thank you! It does look like the Fall Webworm. I will try pulling them off with a stick.