It sounds like you weren't trying to diffuse any friction there probably because you have some weird hang up about this guys age. Personally I don't think age matters, I've had mind blowing sex with a 21 year old as well as a 50 year old. Sometimes older guys can be more mature which is a plus...