This is our native pokeweed. Birds eat the fruit and move the seeds all over.
Here is our page on it: http://extension.umd.edu/hgic/pokeweed
It grows from a big taproot. Use a shovel to rock it out.
Also, see this information for additional ways to control it.