Cost-Aware Robust Tree Ensembles for Security Applications [article]

Yizheng Chen, Shiqi Wang, Weifan Jiang, Asaf Cidon, Suman Jana
<span title="2021-02-23">2021</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
There are various costs for attackers to manipulate the features of security classifiers. The costs are asymmetric across features and to the directions of changes, which cannot be precisely captured by existing cost models based on L_p-norm robustness. In this paper, we utilize such domain knowledge to increase the attack cost of evading classifiers, specifically, tree ensemble models that are widely used by security tasks. We propose a new cost modeling method to capture the feature
more &raquo; ... on cost as constraint, and then we integrate the cost-driven constraint into the node construction process to train robust tree ensembles. During the training process, we use the constraint to find data points that are likely to be perturbed given the feature manipulation cost, and we use a new robust training algorithm to optimize the quality of the trees. Our cost-aware training method can be applied to different types of tree ensembles, including gradient boosted decision trees and random forest models. Using Twitter spam detection as the case study, our evaluation results show that we can increase the attack cost by 10.6X compared to the baseline. Moreover, our robust training method using cost-driven constraint can achieve higher accuracy, lower false positive rate, and stronger cost-aware robustness than the state-of-the-art training method using L_∞-norm cost model. Our code is available at https://github.com/surrealyz/growtrees.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1912.01149v5">arXiv:1912.01149v5</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/xkckv3cg2bgxbiy2dhhlotmg3q">fatcat:xkckv3cg2bgxbiy2dhhlotmg3q</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20210227092444/https://arxiv.org/pdf/1912.01149v5.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/74/f6/74f61086d15cb4b3f8f90fe9909a920a290f1a25.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1912.01149v5" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>