Refused connections

Hello, I've been in touch with the support as well as various forums/IRC trying to figure out why I have a max of 3 refused connection and an average of 2.08. This is a stable rejection of connections, probably a misconfiguration somewhere (from my side). However, the problem is that I've tried several things such as; log_warnings = 2, log_error_verbosity = 3, turned on the general log etc, but I cannot identify what would be causing this. So I'm wondering if anyone else had a similar issue and how to our point me in the correct direction to solve it, would be greatly appreciated! kind regards, Fredrik Hilmersson