Well, I think 'Cold' doesn't just imply apathy these days, it's almost as if it implies some sort of malice.
Wholly apathetic people are thought of as being strange or inhuman, though it takes someone who at least seems to be forcefully uncaring or spiteful to deserve the title of cold.
You however, are rarely cold, and when you are it is a by-product of minute ignorance on a given emotional or interpersonal topic rather than pure wickedness.
Thats not cold in my books, just... sharp through lack of handling.