He never believed he could be loved, just look at who his father is. So when you, a Death Eater like his parents but considerably less believing and more sensible, made him believe that YES he could be loved!... How is he supposed to get over the fact that you never actually loved him and it was all his parents' doing?