It’s not just you. St. Isaac the Syrian says:
Whenever you wish to make a beginning in some good work, first prepare yourself for the temptations that will come upon you, and do not doubt the truth. For it is the enemy’s custom, whenever he sees a man beginning a good mode of life with fervent faith, to confront him with diverse and fearful temptations…. It is not that our adversary has such power – for then no one could ever do good – but that God concedes it to him, as we have learned with the righteous Job. Therefore prepare yourself manfully to encounter temptations.