This appears to be creeping or roving bellflower (Campanula rapunculoides). Creeping bellflower is an introduced herbaceous perennial in Michigan and most of the U.S. It spreads both by seed and underground stems called rhizomes. If this is indeed creeping bellflower it will produce stalks 1-3 feet in height with bell-shaped purple-blue flowers in the summer to early fall.

For more information on this plant consider visiting the following sites:
https://www.minnesotawildflowers.info/flower/creeping-bellflower
http://www.missouribotanicalgarden.org/PlantFinder/PlantFinderDetails.aspx?taxonid=359085&isprofile=0&
You can compare and see if this is indeed a match to the plants you are seeing.

To control this plant, you could try digging it out, but you need to try to get as much of that rhizome and root system as possible. Another option would be to spot-treat it with a herbicide, like glyphosate. 

When using products containing glyphosate there are a few important points to consider. First, as with any pesticide, remember to read and follow all labeled instructions. Second, glyphosate is a broad-spectrum herbicide, meaning it will injure or kill other plants contacted during application, so care is needed to avoid green plant material, exposed roots, and injured bark of desired plants. Third, glyphosate is relatively safe in the environment when used as labeled. It adsorbs strongly to soil in most cases (i.e. clay and organic matter), allowing even sensitive crops to be planted shortly after application; meaning no carry over issues are expected. Fourth, glyphosate alone can take up to 14 days to show full activity under ideal growing conditions. Retreatment of the area may be needed depending on the degree of infestation. Glyphosate is most effective for perennial control in the fall but can be applied anytime the plants are actively growing (temperatures consistently above 50F). Finally, be sure that the product you choose has only the active ingredient glyphosate or glyphosate + pelargonic acid. Products with additional active ingredients may have other unwanted effects and may delay the planting of other plants in the coming season(s).

Products with glyphosate may be difficult to find as they are changing the active ingredients in Roundup products.  You can also use products with the active ingredient triclopyr.  However, when using triclopyr you will not be able to plant anything in that area for some time.  Always read and follow the label instructions.  They will give information on replanting times. 

Let me know if you have additional questions or concerns.