Another woman still takes a big place in his life. This emotional dependence prevents him from developing more serious feelings for you.
In addition, the issue of envy plays a big role with him. Other friendships are tolerated only very reluctantly, so you have to justify yourself constantly.
You should make it clear from the beginning that you will not give up your own life because of him.
For more detailed information on topics like love, career and more, check out The Empress.