Why do bridges and railway lines have gaps in them?

Next time you cross a long bridge, listen for the rhythmic clunk-clunk under the wheels. That sound comes from deliberate gaps built into the road: toothy metal joints with space between them. Older railway tracks have tiny gaps too. It seems mad to leave holes in something that has to be strong and solid. So why do engineers put them there on purpose?