The definition does not indicate it can be not derogatory—which makes sense because it's derogatory.
You despite claiming sans evidence that it is possible to refer to a human being with a pejorative adjective and it be anything other than derogatory, won't even back up your claim with a single non-derogatory example of its use.
I get why you won't—'cause you can't—but if you were right you'd think You could give an example rather than litigating the implied corollaries to "sometimes".