> Abstract: Malicious crowdsourcing forums are gaining traction as sources of spreading misinformation online, but are limited by the costs of hiring and managing human workers. In this paper, we identify a new class of attacks that leverage deep learning language models (Recurrent Neural Networks or RNNs) to automate the generation of fake online reviews for products and services. Not only are these attacks cheap and therefore more scalable, but they can control rate of content output to eliminate the signature burstiness that makes crowdsourced campaigns easy to detect.
>
> Using Yelp reviews as an example platform, we show how a two phased review generation and customization attack can produce reviews that are indistinguishable by state-of-the-art statistical detectors. We conduct a survey-based user study to show these reviews not only evade human detection, but also score high on "usefulness" metrics by users. Finally, we develop novel automated defenses against these attacks, by leveraging the lossy transformation introduced by the RNN training and generation cycle. We consider countermeasures against our mechanisms, show that they produce unattractive cost-benefit tradeoffs for attackers, and that they can be further curtailed by simple constraints imposed by online service providers.
{"cvss": {"score": 0.0, "vector": "NONE"}, "href": "https://www.schneier.com/blog/archives/2017/09/new_techniques_.html", "references": [], "enchantments_done": [], "id": "SCHNEIER:243732604070BC26C7A35AD4C62A55B3", "modified": "2017-09-04T12:08:02", "lastseen": "2017-09-04T12:43:09", "published": "2017-09-04T12:08:02", "description": "Research paper: \"[Automated Crowdturfing Attacks and Defenses in Online Review Systems](<https://arxiv.org/pdf/1708.08151.pdf>).\"\n\n> **Abstract**: Malicious crowdsourcing forums are gaining traction as sources of spreading misinformation online, but are limited by the costs of hiring and managing human workers. In this paper, we identify a new class of attacks that leverage deep learning language models (Recurrent Neural Networks or RNNs) to automate the generation of fake online reviews for products and services. Not only are these attacks cheap and therefore more scalable, but they can control rate of content output to eliminate the signature burstiness that makes crowdsourced campaigns easy to detect. \n> \n> Using Yelp reviews as an example platform, we show how a two phased review generation and customization attack can produce reviews that are indistinguishable by state-of-the-art statistical detectors. We conduct a survey-based user study to show these reviews not only evade human detection, but also score high on \"usefulness\" metrics by users. Finally, we develop novel automated defenses against these attacks, by leveraging the lossy transformation introduced by the RNN training and generation cycle. We consider countermeasures against our mechanisms, show that they produce unattractive cost-benefit tradeoffs for attackers, and that they can be further curtailed by simple constraints imposed by online service providers.", "title": "New Techniques in Fake Reviews", "cvelist": [], "viewCount": 47, "enchantments": {"score": {"value": 2.1, "vector": "NONE", "modified": "2017-09-04T12:43:09", "rev": 2}, "dependencies": {"references": [], "modified": "2017-09-04T12:43:09", "rev": 2}, "vulnersScore": 2.1}, "reporter": "Bruce Schneier", "bulletinFamily": "blog", "type": "schneier", "immutableFields": [], "cvss2": {}, "cvss3": {}}
