How can we tell whether a distant star is racing toward us or away?

A star might be rushing toward us, or racing away, at tens or even hundreds of kilometres every single second. Yet in the night sky it just sits there, a still and silent dot that never seems to budge at all. So how can anyone tell which way a distant star is actually travelling?