Trolling, echo chambers and general suspicious behaviour online are a serious cause of concern due to their potential disruptive effects beyond social media. This motivates a better understanding of the characteristics of disruptive behaviour on the internet and methods of detection. In this work we focus on Reddit which provides a rich social media platform for community focused interactions. Using network representations of user activity alongside temporal statistics and other features we assess the behaviour of a sample of potentially disruptive users, based on their assigned comment karma (an aggregate of a user's comment up-votes), relative to the wider population. We explore how these signals contribute to the accurate prediction of disruptive users, and note that this is achieved without requiring any semantic analysis. Our results show that it is possible to detect signs of disruptive behaviour with good accuracy using limited inputs that are primarily based on the reply patterns that users generate. This is of potential value for large-scale detection problems and operation across different languages.
