That does appear to be yellow nutsedge. Ideally, the earlier you can control this plant the better. In a small space, hand-pulling can achieve control. The plant will send up multiple rounds of growth, so you would need to stay on top of removing the regrowth.

Chemical herbicides can be used This Home, Yard, and Garden article from Illinois Extension gives more detail on chemical controls.