It sounds like you have a great relationship with your father, every girl wants and needs that from a parent. I think you feel safe with him and comfortable thats why you miss him and want to be with him. There comes a time when you have to take control of your own life and grow up and take responsibility for your own family. Your husband sounds like a nice man and you have a lovely dughter to consider. Why can't you and your family move closer to your father that way you can visit him more frequently.
Remeber your husband and daughter need you too. You need to detatch emotionally. I hope in some way I have helped. Good luck.