This is a type of groundcherry (Physalis). It is sometimes called husk-tomato, and makes a seed inside of a roundish, lantern-type papery husk. It is a weed, and though it is found throughout the Eastern U.S.
There are many species, and we are not sure whether your particular plant is native or not. Our native specialist is out of the office today. If this fact important to you, please let us know and we will consult with her upon her return.