Your tendency to have to control everything around you scares him off. He feels that you do not trust him one hundred percent.
Therefore, he cannot move as freely as he would like. At the same time, you are very dominant in conflicts and know how to get your way, which greatly intimidates him in his role as a man.
For more detailed information on topics like love, career and more, check out The Emperor.