How is the timestamp of a block determined?

As a miner, what happens if I propagate a block with a timestamp in the future or a timestamp from yesterday? How are block times determined? Can I give it any amount of time here, or can I change it to 1 or 2 seconds?