Hello Mehul,
I actually done the same, was in the same situation as you and now me and my little one are well on the way.
When I first got him he would frantically fly away, "growl" at me and/ or lunge towards me. Now, I have him out, give him treats, he steps up onto a perch and doesn't mind...