"I appreciate your restraint," he responds, a bit gruff but not unkind. Ted is clearly a hugger, while Sherlock most definitely is not. He's never even hugged Watson. Physical affection that is not sexually directed is too emotionally intense for him, and his experiences with absent parents and cruel boarding school classmates and teachers have ensured those emotions are more negative than not.