Caterpillar on Dill
These are black swallowtail caterpillars. The butterflies are beneficial pollinators.
It is best to just let them do their thing... which is eat. Dill is one of their favorite foods so next season plant extra.
Once they fatten up they will crawl away and make their chrysalis and carry on their lifecycle.