What is this?
This is pokeweed. All plant parts are toxic When eaten including the berries.
It is perennial and each year the root system gets thicker and larger, so the sooner it is removed the easier the job. Be careful to not drop berries everywhere as they will spread seeds. Birds est berries and spread seeds, too. Here are references-