He has no right to contact? What will it take?

To cut a very long story short I was in a very bad relationship were he hit me regularly through my pregnancy. Hit me the first night I brought my daughter home from hospital and for the first year of her life infront of her. I got the courage to split up and after I did get him out of the house he called drunk on a number of occasions hit me... tried to kick my door and windows in. On several occasions I had to leave the house (when he was drunk and I knew he was on his way up as he would text threatening to slice my throat,) with my daughter and myself in my jammies to go to a relatives late at night. I finally went through with a court order to keep him away from me and the house. Now Im the one in court for him lookin contact with my 3 year old. Which Im told he will get.... he is so violent his temper and jealousy is awful yet Im the one being made to suffer. A judge who knows nothing about me will decide my daughters fate with this cruel bully. What a **** justice system. Im so worried as I know he will behave in the contact centres. But thats only for so long. What the law has more or less told me is he has a right so my daughter unless he hurts her or me..... so Ive just to wait on something bad happening first.