Yes, the insects are aphids.
Because it is normally an indoor plant, I suggest you begin without using a pesticide.
Consider getting ahead of the game by starting by physically dispatching as many of the aphids as possible. Don some gloves and squish as many as you can, then was both the tops and the bottoms of the leaves, as well as the stems, with only water.
Although insecticidal soap, used according to directions, is safe for most plants, it's always wise to check the label before applying it. Don't use a homemade soapy concoction because they often damage plants.
After the plant is indoors, isolate it from your other plants for at least a month, perhaps in bright room by itself. During isolation, check every several days for aphids because any that were missed will continue to give live birth to an already-pregnant aphid every 20 days!
Consider an aphid-free interval of 4 weeks a requirement before you integrate the plant among your others.