He said "I love you"

The last time he called me, that was after quite a long time since we talked to each other on the phone. He said "I love you". And... i didnt reply him. I know it could be an "ouch" moment for him for not hearing the same from me but i had my reservations, i just hope he understands "our" situation :)