Does mud left on cars damage cars?

I drive in a lot of muddy terrain, and I usually leave the mud on the car, as it's too much of a hle to clean it everytime. Is this bad for the car? what damages would it cause?