You can try to disable the IMAP service. Not too sure what app you are use for the IMAP service. If you are using the CPanel control panel (which is what I am using) you can see if it is courier by running.
service courier-imap restart
If it does in fact restart then you can disable the service, you could also firewall the IMAP port 143 also.