What is the identity of this weed ?
This is shephard's purse. Pull it before the purse-shaped seed pods mature and open. Each "purse" can contain thousands of seeds and they will live a long time in your soil and continue to come up.
This is a native plant, so if you want to move it to a wild area--far from cultivation-- that would be ok.