I personally don't find it to be all that annoying. The people really do mean it in a modest way. People can take "modesty" the wrong way when it's done by overly-successful people. Imagine a public figure saying 'I'm sorry, I can't respond because I'm getting flooded with too many emails right now.' I find myself taking this as a hidden gloat. Oh, you're so popular and everyone wants to talk to you... Oh you're so special that god helps you instead of starving children...
Meandering Atheist: Several friends on a journey of romance and adventure, to talk about moderately interesting topics.
