Cicada killer vs European wasp?
This looks like a European hornet. They can be attracted to the light and may have come in inadvertently. We are not sure if you are dealing with one or many. Here is our webpage http://extension.umd.edu/hgic/european-hornets
If they are not an issue inside your house, no control is necessary. Otherwise , you may need to contact a beekeepr or pest control company http://www.mdbeekeepers.org/swarms.html