On the fruit the hole is caused by codling moth, or perhaps oriental fruit moth. The sawdust-looking frass is from the larvae. You may be able to still find a light, slightly pink colored larvae. Codling moth and oriental fruit moth are controlled by spraying with insecticide starting when the fruit becomes about 1 inch in diameter.
Here is a link to an article with details about controlling these insects.
The spots on the leaves are caused by a rust fungus, maybe cedar apple rust or possibly juniper rust. See the following article for further details, including control strategies.