This is a problem with using the POP protocol. Your mail program forgets which messages it has downloaded, so it downloads the same ones again. The way to make this stop happening is to stop leaving messages on server (a setting in your mail program) or preferably, to stop using POP.

You can read about how to reconfigure your mail program here:

http://www.columbia.edu/cuit/software/email.html