How to get rid of these spikes out of the ground
This looks like it could be wineberry, which is considered an invasive plant. It is a type of bramble so it resembles wild raspberries or blackberries. It does produce edible fruit so if you have this growing in areas around you the birds eat the fruit and spread the seeds making it difficult to control. The following is information on wineberry. Right now just dig out the plants you show in your photos.Look under 'invasive shrub control' for more information about getting rid of it.