Looking through your smartphone screen to steal your pin using a 3D camera

Diksha Shukla, Vir Phoha, Saurav Prakash

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recent research shows that video recordings of the user’s hand movement and his or her smartphone screen display can be used to steal sensitive information such as pins and passwords. The methods presented in the past assume the victim to be present in a well illuminated place. In this paper, we present a novel attack on the smartphone users’ pins that does not require a highly illuminated room and works even in the complete darkness. We use a DS325 Soft Kinect camera to record the users’ interaction with their smartphones while they type their pins. Using the 900 short RGBD video recording of the pin entry process from 30 different users, we show our attack was able to break 43% of the pins in the first attempt and 61% of the pins in the first 10 attempts. With the advancements in the quality and accessibility of the depth-sensing cameras day by day, we believe our work exposes a major security risk in the present and future and calls the community to take a closer look at the security measures for the usage of the smart devices.

Original languageEnglish (US)
Title of host publicationIntelligent Computing - Proceedings of the 2018 Computing Conference
EditorsSupriya Kapoor, Rahul Bhatia, Kohei Arai
PublisherSpringer Verlag
Pages1010-1020
Number of pages11
ISBN (Print)9783030011765
DOIs
StatePublished - Jan 1 2019
EventComputing Conference, 2018 - London, United Kingdom
Duration: Jul 10 2018Jul 12 2018

Publication series

NameAdvances in Intelligent Systems and Computing
Volume857
ISSN (Print)2194-5357

Other

OtherComputing Conference, 2018
CountryUnited Kingdom
CityLondon
Period7/10/187/12/18

Fingerprint

Smartphones
Video recording
Cameras
Display devices

Keywords

  • 3D video recording
  • Infra red sensor
  • Pins and passwords
  • Security
  • Smartphone

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science(all)

Cite this

Shukla, D., Phoha, V., & Prakash, S. (2019). Looking through your smartphone screen to steal your pin using a 3D camera. In S. Kapoor, R. Bhatia, & K. Arai (Eds.), Intelligent Computing - Proceedings of the 2018 Computing Conference (pp. 1010-1020). (Advances in Intelligent Systems and Computing; Vol. 857). Springer Verlag. https://doi.org/10.1007/978-3-030-01177-2_73

Looking through your smartphone screen to steal your pin using a 3D camera. / Shukla, Diksha; Phoha, Vir; Prakash, Saurav.

Intelligent Computing - Proceedings of the 2018 Computing Conference. ed. / Supriya Kapoor; Rahul Bhatia; Kohei Arai. Springer Verlag, 2019. p. 1010-1020 (Advances in Intelligent Systems and Computing; Vol. 857).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Shukla, D, Phoha, V & Prakash, S 2019, Looking through your smartphone screen to steal your pin using a 3D camera. in S Kapoor, R Bhatia & K Arai (eds), Intelligent Computing - Proceedings of the 2018 Computing Conference. Advances in Intelligent Systems and Computing, vol. 857, Springer Verlag, pp. 1010-1020, Computing Conference, 2018, London, United Kingdom, 7/10/18. https://doi.org/10.1007/978-3-030-01177-2_73
Shukla D, Phoha V, Prakash S. Looking through your smartphone screen to steal your pin using a 3D camera. In Kapoor S, Bhatia R, Arai K, editors, Intelligent Computing - Proceedings of the 2018 Computing Conference. Springer Verlag. 2019. p. 1010-1020. (Advances in Intelligent Systems and Computing). https://doi.org/10.1007/978-3-030-01177-2_73
Shukla, Diksha ; Phoha, Vir ; Prakash, Saurav. / Looking through your smartphone screen to steal your pin using a 3D camera. Intelligent Computing - Proceedings of the 2018 Computing Conference. editor / Supriya Kapoor ; Rahul Bhatia ; Kohei Arai. Springer Verlag, 2019. pp. 1010-1020 (Advances in Intelligent Systems and Computing).
@inproceedings{8244e3eee3084e7c8099d2b8bed1ea66,
title = "Looking through your smartphone screen to steal your pin using a 3D camera",
abstract = "Recent research shows that video recordings of the user’s hand movement and his or her smartphone screen display can be used to steal sensitive information such as pins and passwords. The methods presented in the past assume the victim to be present in a well illuminated place. In this paper, we present a novel attack on the smartphone users’ pins that does not require a highly illuminated room and works even in the complete darkness. We use a DS325 Soft Kinect camera to record the users’ interaction with their smartphones while they type their pins. Using the 900 short RGBD video recording of the pin entry process from 30 different users, we show our attack was able to break 43{\%} of the pins in the first attempt and 61{\%} of the pins in the first 10 attempts. With the advancements in the quality and accessibility of the depth-sensing cameras day by day, we believe our work exposes a major security risk in the present and future and calls the community to take a closer look at the security measures for the usage of the smart devices.",
keywords = "3D video recording, Infra red sensor, Pins and passwords, Security, Smartphone",
author = "Diksha Shukla and Vir Phoha and Saurav Prakash",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/978-3-030-01177-2_73",
language = "English (US)",
isbn = "9783030011765",
series = "Advances in Intelligent Systems and Computing",
publisher = "Springer Verlag",
pages = "1010--1020",
editor = "Supriya Kapoor and Rahul Bhatia and Kohei Arai",
booktitle = "Intelligent Computing - Proceedings of the 2018 Computing Conference",

}

TY - GEN

T1 - Looking through your smartphone screen to steal your pin using a 3D camera

AU - Shukla, Diksha

AU - Phoha, Vir

AU - Prakash, Saurav

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Recent research shows that video recordings of the user’s hand movement and his or her smartphone screen display can be used to steal sensitive information such as pins and passwords. The methods presented in the past assume the victim to be present in a well illuminated place. In this paper, we present a novel attack on the smartphone users’ pins that does not require a highly illuminated room and works even in the complete darkness. We use a DS325 Soft Kinect camera to record the users’ interaction with their smartphones while they type their pins. Using the 900 short RGBD video recording of the pin entry process from 30 different users, we show our attack was able to break 43% of the pins in the first attempt and 61% of the pins in the first 10 attempts. With the advancements in the quality and accessibility of the depth-sensing cameras day by day, we believe our work exposes a major security risk in the present and future and calls the community to take a closer look at the security measures for the usage of the smart devices.

AB - Recent research shows that video recordings of the user’s hand movement and his or her smartphone screen display can be used to steal sensitive information such as pins and passwords. The methods presented in the past assume the victim to be present in a well illuminated place. In this paper, we present a novel attack on the smartphone users’ pins that does not require a highly illuminated room and works even in the complete darkness. We use a DS325 Soft Kinect camera to record the users’ interaction with their smartphones while they type their pins. Using the 900 short RGBD video recording of the pin entry process from 30 different users, we show our attack was able to break 43% of the pins in the first attempt and 61% of the pins in the first 10 attempts. With the advancements in the quality and accessibility of the depth-sensing cameras day by day, we believe our work exposes a major security risk in the present and future and calls the community to take a closer look at the security measures for the usage of the smart devices.

KW - 3D video recording

KW - Infra red sensor

KW - Pins and passwords

KW - Security

KW - Smartphone

UR - http://www.scopus.com/inward/record.url?scp=85057140297&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85057140297&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-01177-2_73

DO - 10.1007/978-3-030-01177-2_73

M3 - Conference contribution

SN - 9783030011765

T3 - Advances in Intelligent Systems and Computing

SP - 1010

EP - 1020

BT - Intelligent Computing - Proceedings of the 2018 Computing Conference

A2 - Kapoor, Supriya

A2 - Bhatia, Rahul

A2 - Arai, Kohei

PB - Springer Verlag

ER -