If my followers want to talk to me, drop an ask in my askbox. If they want it private, they just need to say that they want their asks to be private.
the reason why the IM is a huge inconvinience is because of people like Nero who I blocked 4 times because they keep making multiple accounts and following me.