What gnats are in house plants?
My best guess, without a picture at hand, is fungus gnats. They are quite small dark insects which flit around the plant and soil surface. They’re sometimes a nuisance for people.
The management is to allow the soil to dry out a bit more than you are currently doing to limit the youngsters which thrive in moist soil and feed on roots. You can also add an anti-mosquito product such as Mosquito Dunks (or granules) to the water you use. Continue for at least three weeks or more to break the life cycle.