I agree, I don't really mind it unless it seems random. I know lots of times my friends have acted out of character for various reasons, and sometimes characters I read about do too. Often it's because of a good reason though.
I feel you, bro. I'm always afraid of when it is ok or not ok in my own writing. ;-;