Depends on who needs to connect to it and from where. Is it behind a hardware firewall or is it Internet facing with iptables? I would suggest encrypting all connections (imaps/pop3s/https) and restricting to as narrow of a scope of addresses as you can. It would also be best to require authentication for sending mail.
I would certainly make sure only necessary ports are exposed with iptables as a first step baseline. Then you have to make sure the services on the other end of the ports left exposed are as secure as you can make them.