Deep neural network based malware detection using two dimensional binary program features
By Joshua Saxe, Konstantin Berlin. 2015
716 citations recorded by the source corpus.
In this paper we introduce a deep neural network based malware detection system that Invincea has developed, which achieves a usable detection rate at an extremely low false positive rate and scales to real world training example volumes on commodity hardware. We show that our system achieves a 95% detection rate at 0.1% false positive rate (FPR), based on more than 400,000 software binaries sourced directly from our customers and internal malware databases. In addition, we describe a non-parametric method for adjusting the classifier's scores to better represent expected precision in the deployment environment. Our results demonstrate that it is now feasible to quickly train and deploy a low resource, highly accurate machine learning classification model, with false positive rates that approach traditional labor intensive expert rule based malware detection, while also detecting previously unseen malware missed by these traditional approaches. Since machine learning models tend to improve with larger datasizes, we foresee deep neural network classification models gaining in importance as part of a layered network defense strategy in coming years.
Subfields: Artificial Intelligence, Computer Networks and Communications, Anomaly & Outlier Detection, Privacy & Security, Signal Processing
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Nicholas Carlini
- Bo Li
- Dawn Song
- Nicolas Papernot
- Xinyun Chen
- Percy Liang
- Florian Tramèr
- Patrick Drew McDaniel
In Computer Networks and Communications
- Nicolas Papernot
- Patrick Drew McDaniel
- David E. Evans
- H. S. Anderson
- Bo Li
- Kim-Kwang Raymond Choo
- Alina Oprea
- Giorgio Severi
In Anomaly & Outlier Detection
- George D. Webster
- Dawn Song
- Patrick Drew McDaniel
- S. S. Iyengar
- Michael Backes
- D. Adjeroh
- Ömer Aslan
- Phil Roth
In Privacy & Security
- Bo Li
- Nicolas Papernot
- Patrick Drew McDaniel
- George D. Webster
- Luis Muñoz-González
- Xinyun Chen
- Dawn Song
- S. S. Iyengar
In Signal Processing
- Nicholas Carlini
- Bo Li
- Dawn Song
- Nicolas Papernot
- Patrick Drew McDaniel
- Xinyun Chen
- H. S. Anderson
- David E. Evans
Citations in the corpus
- Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoning (2017, background): “Therefore, deep learning systems have become prevalent in our lives, including security-sensitive applications such as face recognition [55], [62], fingerprint identification [66], spam filtering [64], [56], malware detection [21], [57], and autonomous vehicles [17].”
- Deep k-Nearest Neighbors: Towards Confident, Interpretable and Robust Deep Learning (2018, background): “Deep learning is ubiquitous: deep neural networks achieve exceptional performance on challenging tasks like machine translation [1], [2], diagnosing medical conditions such as diabetic retinopathy [3], [4] or pneumonia [5], malware detection [6], [7], [8], and classification of images [9], [10].”
- Adversarial Examples: Attacks and Defenses for Deep Learning (2017, methodology): “Deep learning has been used in static and behavioral-based malware detection because it can be well-generalized to zeroday malware [32], [118], [129], [145].”
- A Detailed Investigation and Analysis of Using Machine Learning Techniques for Intrusion Detection (2019, neutral): “[177] [178] [179] [180] [181] [182] [183] [184] [185] [186] [187] [188]”
- Adversarial Examples for Malware Detection (2017, methodology): “This includes Deep neural networks (DNNs) in security-critical applications, such as malware detection [6,31].”
- Survey on the Usage of Machine Learning Techniques for Malware Analysis (2017, methodology): “Indeed, the majority of reviewed works has this as main goal [8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33].”
- A Survey of Deep Learning Methods for Cyber Security (2019, methodology): “DNN Saxe and Berlin [89] 127 Malware Detection Jotti commercial malware feed Invincea‘s private data”
- Procedural Noise Adversarial Examples for Black-Box Attacks on Deep Convolutional Networks (2018, background): “Advances in computation and machine learning have enabled deep learning methods to become the favoured algorithms for various tasks such as computer vision [31], malware detection [64], and speech recognition [22].”
- A Comprehensive Review on Malware Detection Approaches (2020, methodology): “Deep neural network based malware detection using two dimensional binary program features explained is in [50].”
- Deep Learning for Classification of Malware System Call Sequences (2016, methodology): “[24] used feedforward neural networks to classify static analysis results.”
- LEMNA: Explaining Deep Learning based Security Applications (2018, methodology): “For example, researchers have trained MLP to detect malware at the binary code level [48] and classify Android malware [2, 21].”
- Robust Malware Detection for Internet of (Battlefield) Things Devices Using Deep Eigenspace Learning (2019, methodology): “Berlin [11] presented a detection method using deep feedforward neural network based on a set of Windows program features (e.”
- Adversarial Initialization - when your network performs the way I want (2019, background): “The usage ranges from computer vision [13] over autonomous driving, natural language processing [23] and Malware detection [32] to healthcare [25].”
- Security and Privacy in Smart Farming: Challenges and Opportunities (2020, background): “Many AI assisted malware detection techniques [114]–[120] are proposed and used in practice; however, there are no smart-farming-specific malware detection techniques that consider the context and environment in which smart farms reside.”
- Learning to Evade Static PE Machine Learning Malware Models via Reinforcement Learning (2018, background): “Machine learning-based static PE malware detectors have been used since at least 2001 [27], and owing largely to the structured file format and backwards-compatibility requirements, many concepts remain surprisingly similar in subsequent works [8, 16, 24, 26, 28].”