This repo is the source code for DeepSIM: GPS Spoofing Detection on UAVs using Satellite Imagery Matching.
In this artifact, we will provide the source codes of our implementations as well as the corresponding dataset (approx.~12.08 Gigabyte with 967 aerial photos and paired satellite images), which are used in Section 8 of our accepted paper. The dataset consists of training set and test set which can be used to train a new model from scratch and evaluate a trained model, respectively. We also provide trained models that were used in our evaluation procedure. The training and testing of our models require a CUDA-enabled GPU in Linux OS, and the software is implemented using Python. To run our on-board model, i.e. SqueezeNet v1.1, on the IoT platform, a Raspberry Pi is needed, where 3B+ with CPU
Run our deep learning models, and they will compare the aerial photos with the satellite images, to see whether a drone is attacked by GPS spoofing.
An example of a paired aerial photo and its corresponding image is shown as follows.
Follow the instructions below, you can reproduce our program easily.
Anaconda + Python 3.7 or higher, and other software in requirements.txt.
Please create a conda env and install pytorch 1.4 and other software. Refer to run.sh for an example.
Download the dataset we provided and put them under the source code folder.
- On-ground If you want to train a model from scratch, a GPU with at least 16G video memory is recommended. We trained our models on an NVIDIA Tesla V100. Batch size is set to 2 if video memory is 16G and 4 if 32G. Training new models on Cloud platform like Google Colab is an option for your reference.
- On-board Raspberry Pi is needed, where 3B+ with CPU ≥ 1.4GHz and memory ≥ 1GB is recommended.
Pytorch, Numpy, cuDNN, CUDA, OpenCV, pandas, h5py, tqdm,matplotlib, seaborn, sklearn, packaging.
The data derectories are available at Google Drive.
| Directory | Functionality |
|---|---|
| mid_product | h5 files, i.e., features extracted by the backbone neural network, ResNet. With those files you do not need to extract features from the original images, thus can speed up the detection process. |
| models | A series of trained models for GPS spoofing detection. |
| dataset | Collected aerial photos and satellite images. |
| GPS-Spoofing-Detection | Source code for training and test. |
Here we only provide preprocessed data for easy running and evalution. In general, these photos in our dataset can be devided into categories: aerial photography and satellite imagery. Each has its corresponding counterpart.
| Name | Description |
|---|---|
| England_960x720 | For generalization ability test-only. |
| error_tolerance | For error tolerance test. |
| full_960x720 | For training and validation. |
| full_aug_960x720 | For training and validation with data augmentation technology. |
If you want the raw dataset, please send an email to [email protected].
Please first visit Satellite imagery VS Aerial Photos to download the dataset and necessary files.
Then put the data into config.GDRIVE_DIR.
For the raw aerial photos from Merlischachen, Renens，Lausanne and Le Bourget Airport, please visit senseFly dataset for more information.
We have provided data after augmentation. However, if you want to do it by yourself, For data augmentation source, please visit Here.
The implemented augmentation methods are: grayscaling, blurring, cropping, weather augmentation (e.g. snow, fog, clouds), rotating and adjusting the brightness (e.g. lighter or darker).
An example of cloud and fog effect is shown below:
- generate the newly preprocessed images by running the augmentation.py file with the desired amount of generated image pairs and adapted filepaths
- if you want to generate preprocessed images for all available images, then run the augmentation.py file for every available method and the amount of all available pairs
python augmentation.py
We also provide our trained models for GPS spoofing inferences. With these models, you do not need to train a new one from scratch for detection. You can directly use it to carry out the evaluation.
Besides, you can use the preprocessed data to train a completely new model as you like.
-
With proper environment setup and dataset downloaded to the source code folder, you can now start to run the training and evaluation procedure.
-
For training Siamese ResNet, please run:
python train.py --model SiameseResNet --data aug --margin 4 --lr 3e-4 --step 10 --nepoch 50 --batch_size 4For evaluation, please run:python evaluate.py --model SiameseResNet --margin 4 --weight [modelname].pth -
Please see more examples and explanations in
run.sh.
| File | Functionality |
|---|---|
| config.py | Configurations. |
| DataLoader.py | Basic data loader functions, mostly used for model 1 in the paper. |
| Dataset.py | Pytorch Dataset Classes. |
| train.py | Training code. |
| evaluate.py | Evaluation code (spoofing detection). |
| net.py | Neural Network definitions. |
| preprocess.py | Resize rename and generate h5py data file. |
| utils.py | Utility code. |
| euclidean_distance.py | Model 1 code. |
| run.sh | Examples of commands to run our software. |
| rpi.md | Instruction for Raspberry Pi. |
| requirements.txt | Python software requirements. |
| Draw_ROC_loss.ipynb | Jupyter notebook to draw ROC curves. |
| GPS_Spoofing_Detection.ipynb | Model 1 Jupyter notebook. |
| Visualize_Model.ipynb | Jupyter notebook to visualize the models. |
If you want to run models on Raspberry Pi, please refer to rpi.md.
An successful training result (1 epoch) is shown below.
Please visit here for the newest updating.
Please use the following bibtex code to cite our work:
@InProceedings{nian2020deepsim,
title={{DeepSIM: GPS Spoofing Detection on UAVs using Satellite Imagery Matching}},
author={Nian Xue, Liang Niu, Xianbin Hong, Zhen Li, Larissa Hoffaeller, Christina Pöpper},
booktitle={Proceedings of the Annual Computer Security Applications Conference
(ACSAC)},
year={2020},
doi={10.1145/3427228.3427254}
}