Discussion Forum—A Way with Words, a fun radio show and podcast about language

I've always been thrown off when others refer to an appointment or meeting time "getting pushed back". Most people are intending to say the appointment time will be delayed or postponed when they say this. To me, the phrase "pushed back" has the connotation of pushed back in time, rather than pushed forward in time. Am I alone in this interpretation?