Locating Your Smart Devices with a Single Speaker
Authors: 
Guanyu Cai, Jiliang WangAuthors Info & Claims
Guanyu Cai, Jiliang WangAuthors Info & ClaimsPages 28 - 40
Abstract
The ability of smart devices to determine their locations is the basis for many applications. We present LEAD, a system which can simultaneously Locate Everyday smArt Devices, such as smartphone, smartwatch, and headphone, with only one speaker. The principle of LEAD is leveraging the reflected path (e.g., by the wall) for single speaker based localization. Previous works cannot simultaneously locate multiple devices with unknown orientations. To overcome the challenges, we estimate the direction difference and distance difference between the LoS and Echo paths and combine them to derive the device location. Given limited sound bandwidth, we develop a high-resolution method to estimate the distance difference. To address the sparsity of microphones with large inter-distance, we generate virtual microphones on smart devices to estimate the direction difference. We reduce the computation overhead by searching the decomposed space for distance and direction. We extensively evaluate LEAD's performance in different scenarios. The results show a median relative distance error of 2.0 cm, relative direction error of 0.7°, and localization error of 0.29 m across various settings.
References
[1]
Fortune Business InsightsTM | Global Market Research Reports & Consulting. https://www.fortunebusinessinsights.com/.
[2]
Apple Health. https://apps.apple.com/us/app/apple-health/id1242545199.
[3]
Wenguang Mao, Jian He, and Lili Qiu. CAT: High-precision acoustic motion tracking. In Proceedings of ACM MobiCom, 2016.
[4]
Wei Wang, Alex X. Liu, and Ke Sun. Device-free gesture tracking using acoustic signals. In Proceedings of ACM MobiCom, 2016.
[5]
Chunyi Peng, Guobin Shen, and Yongguang Zhang. BeepBeep: A high-accuracy acoustic-based system for ranging and localization using COTS devices. ACM Transactions on Embedded Computing Systems, 2012.
[6]
Wenguang Mao, Zaiwei Zhang, Lili Qiu, Jian He, Yuchen Cui, and Sangki Yun. Indoor Follow Me Drone. In Proceedings of ACM MobiSys, 2017.
[7]
Kaikai Liu, Xinxin Liu, and Xiaolin Li. Guoguo: Enabling fine-grained indoor localization via smartphone. In Proceedings of ACM MobiSys, 2013.
[8]
Qiongzheng Lin, Zhenlin An, and Lei Yang. Rebooting Ultrasonic Positioning Systems for Ultrasound-incapable Smart Devices. In Proceedings of ACM MobiCom, 2019.
[9]
Guanyu Cai and Jiliang Wang. ATP: Acoustic tracking and positioning under multipath and doppler effect. In Proceedings of IEEE INFOCOM, 2024.
[10]
Qingli Yan, Jianfeng Chen, Geoffrey Ottoy, and Lieven De Strycker. Robust AOA based acoustic source localization method with unreliable measurements. Signal Processing, 2018.
[11]
Wenchao Huang, Yan Xiong, Xiang-Yang Li, Hao Lin, Xufei Mao, Panlong Yang, and Yunhao Liu. Shake and walk: Acoustic direction finding and fine-grained indoor localization using smartphones. In Proceedings of IEEE INFOCOM, 2014.
[12]
Mei Wang, Wei Sun, and Lili Qiu. MAVL: Multiresolution Analysis of Voice Localization. In Proceedings of USENIX NSDI, 2021.
[13]
Weiguo Wang, Jinming Li, Yuan He, and Yunhao Liu. Symphony: Localizing multiple acoustic sources with a single microphone array. In Proceedings of ACM SenSys, 2020.
[14]
Sheng Shen, Daguan Chen, Yu-Lin Wei, Zhijian Yang, and Romit Roy Choudhury. Voice localization using nearby wall reflections. In Proceedings of ACM MobiCom, 2020.
[15]
Weiguo Wang, Luca Mottola, Yuan He, Jinming Li, Yimiao Sun, Shuai Li, Hua Jing, and Yulei Wang. MicNest: Long-Range Instant Acoustic Localization of Drones in Precise Landing. In Proceedings of ACM SenSys, 2022.
[16]
Patrick Lazik, Niranjini Rajagopal, Oliver Shih, Bruno Sinopoli, and Anthony Rowe. ALPS: A Bluetooth and Ultrasound Platform for Mapping and Localization. In Proceedings of ACM SenSys, 2015.
[17]
Patrick Lazik and Anthony Rowe. Indoor Pseudo-ranging of Mobile Devices using Ultrasonic Chirps. In Proceedings of ACM SenSys, 2012.
[18]
R. Schmidt. Multiple emitter location and signal parameter estimation. IEEE Transactions on Antennas and Propagation, 1986.
[19]
M.C. Vanderveen, B.C. Ng, C.B. Papadias, and A. Paulraj. Joint angle and delay estimation (JADE) for signals in multipath environments. In Conference Record of The Thirtieth Asilomar Conference on Signals, Systems and Computers, 1997.
[20]
C. Knapp and G. Carter. The generalized correlation method for estimation of time delay. IEEE Transactions on Acoustics, Speech, and Signal Processing, 1976.
[21]
John C Curlander and Robert N McDonough. Synthetic aperture radar, volume 11. Wiley, New York, 1991.
[22]
Sheng Shen, Mahanth Gowda, and Romit Roy Choudhury. Closing the Gaps in Inertial Motion Tracking. In Proceedings of ACM MobiCom, 2018.
[23]
Jeffrey R. Blum, Daniel G. Greencorn, and Jeremy R. Cooperstock. Smartphone Sensor Reliability for Augmented Reality Applications. In Mobile and Ubiquitous Systems: Computing, Networking, and Services, pages 127--138. Springer, 2013.
[24]
Alwin Poulose, Odongo Steven Eyobu, and Dong Seog Han. An Indoor Position-Estimation Algorithm Using Smartphone IMU Sensor Data. IEEE Access, 7:11165--11177, 2019.
[25]
Alberto Pretto and Giorgio Grisetti. Calibration and performance evaluation of low-cost IMUs. In Proceedings of IMEKO TC4 International Symposium, 2014.
[26]
R. Roy and T. Kailath. ESPRIT-estimation of signal parameters via rotational invariance techniques. IEEE Transactions on Acoustics, Speech, and Signal Processing, 1989.
[27]
Wenguang Mao, Mei Wang, Wei Sun, Lili Qiu, Swadhin Pradhan, and Yi-Chao Chen. RNN-Based Room Scale Hand Motion Tracking. In Proceedings of ACM MobiCom, 2019.
[28]
Cesar Iovescu and Sandeep Rao. The fundamentals of millimeter wave sensors. Texas Instruments, pages 1--8, 2017.
[29]
Tie-Jun Shan, M. Wax, and T. Kailath. On spatial smoothing for direction-of-arrival estimation of coherent signals. IEEE Transactions on Acoustics, Speech, and Signal Processing, 1985.
[30]
Manikanta Kotaru, Kiran Joshi, Dinesh Bharadia, and Sachin Katti. SpotFi: Decimeter Level Localization Using WiFi. In Proceedings of ACM SIGCOMM, 2015.
[31]
Redmi 8A @6,999 | 5000mAh High-Capacity Battery - Mi India. https://www.mi.com/in/redmi-8a/.
[32]
Mi-11 - Mi Global Home. https://www.mi.com/global/product/mi-11/.
[33]
ReSpeaker 4-Mic Linear Array Kit | Seeed Studio Wiki. https://wiki.seeedstudio.com/ReSpeaker_4-Mic_Linear_Array_Ki_for_Raspberry_Pi/.
[34]
Raspberry Pi Ltd. Raspberry Pi 4 Model B. https://www.raspberrypi.com/products/raspberry-pi-4-model-b/.
[35]
Philips USB Notebook speakers SPA20/00 USB Notebook speakers. https://www.usa.philips.com/c-p/SPA20_00/usb-notebook-speakers.
[36]
Dong Li, Shirui Cao, Sunghoon Ivan Lee, and Jie Xiong. Experience: Practical Problems for Acoustic Sensing. In Proceedings of ACM MobiCom, 2022.
[37]
Shirui Cao, Dong Li, Sunghoon Ivan Lee, and Jie Xiong. Powerphone: Unleashing the acoustic sensing capability of smartphones. In Proceedings of ACM MobiCom, 2023.
[38]
Sangki Yun, Yi-Chao Chen, Huihuang Zheng, Lili Qiu, and Wenguang Mao. Strata: Fine-Grained Acoustic-based Device-Free Tracking. In Proceedings of ACM MobiSys, 2017.
[39]
Rajalakshmi Nandakumar, Vikram Iyer, Desney Tan, and Shyamnath Gollakota. FingerIO: Using Active Sonar for Fine-Grained Finger Tracking. In Proceedings of ACM CHI, 2016.
[40]
Rajalakshmi Nandakumar, Shyamnath Gollakota, and Nathaniel Watson. Contactless Sleep Apnea Detection on Smartphones. In Proceedings of ACM MobiSys, 2015.
[41]
Haiming Cheng and Wei Lou. Push the Limit of Device-Free Acoustic Sensing on Commercial Mobile Devices. In Proceedings of IEEE INFOCOM, 2021.
[42]
Yongzhao Zhang, Hao Pan, Yi-Chao Chen, Lili Qiu, Yu Lu, Guangtao Xue, Jiadi Yu, Feng Lyu, and Haonan Wang. Addressing Practical Challenges in Acoustic Sensing To Enable Fast Motion Tracking. In Proceedings of ACM IPSN, 2023.
[43]
Yang Cong, Changjun Gu, Tao Zhang, and Yajun Gao. Underwater robot sensing technology: A survey. Fundamental Research, 1(3):337--345, 2021.
[44]
Yanchao Zhao, Yiming Zhao, Si Li, Hao Han, and Lei Xie. Ultrasnoop: Placement-agnostic keystroke snooping via smartphone-based ultrasonic sonar. ACM Trans. Internet Things, 4(4), 2023.
[45]
Sangki Yun, Yi-Chao Chen, and Lili Qiu. Turning a Mobile Device into a Mouse in the Air. In Proceedings of ACM MobiSys, 2015.
[46]
Linsong Cheng, Zhao Wang, Yunting Zhang, Weiyi Wang, Weimin Xu, and Jiliang Wang. AcouRadar: Towards Single Source based Acoustic Localization. In Proceedings of IEEE INFOCOM, 2020.
[47]
Viktor Erdélyi, Trung-Kien Le, Bobby Bhattacharjee, Peter Druschel, and Nobutaka Ono. Sonoloc: Scalable positioning of commodity mobile devices. In Proceedings of ACM MobiSys, 2018.
[48]
Zengbin Zhang, David Chu, Xiaomeng Chen, and Thomas Moscibroda. Sword-Fight: Enabling a new class of phone-to-phone action games on commodity phones. In Proceedings of ACM MobiSys, 2012.
[49]
Yunting Zhang, Jiliang Wang, Weiyi Wang, Zhao Wang, and Yunhao Liu. Vernier: Accurate and Fast Acoustic Motion Tracking Using Mobile Devices. In Proceedings of IEEE INFOCOM, 2018.
[50]
Anran Wang and Shyamnath Gollakota. MilliSonic: Pushing the Limits of Acoustic Motion Tracking. In Proceedings of ACM CHI, 2019.
[51]
Tuochao Chen, Justin Chan, and Shyamnath Gollakota. Underwater 3D positioning on smart devices. In Proceedings of ACM SIGCOMM, 2023.
[52]
Jialin Liu, Dong Li, Lei Wang, Fusang Zhang, and Jie Xiong. Enabling Contact-free Acoustic Sensing under Device Motion. In Proceedings of the ACM IMWUT, 2022.
[53]
Masanari Nakamura, Kento Fujimoto, Hiroaki Murakami, Hiromichi Hashizume, and Masanori Sugimoto. Indoor Localization Method For a Microphone Using a Single Speaker. In International Conference on Indoor Positioning and Indoor Navigation, 2021.
[54]
Yang Bai, Nakul Garg, and Nirupam Roy. SPiDR: Ultra-low-power acoustic spatial sensing for micro-robot navigation. In Proceedings of ACM MobiSys, 2022.
[55]
Nakul Garg, Yang Bai, and Nirupam Roy. Owlet: Enabling spatial information in ubiquitous acoustic devices. In Proceedings of ACM MobiSys, 2021.
[56]
Yu-Chih Tung and Kang G. Shin. EchoTag: Accurate Infrastructure-Free Indoor Location Tagging with Smartphones. In Proceedings of ACM MobiSys, 2015.
[57]
Andrew Luo, Yilun Du, Michael Tarr, Josh Tenenbaum, Antonio Torralba, and Chuang Gan. Learning neural acoustic fields. In Advances in Neural Information Processing Systems, 2022.
[58]
Li Zhang, Jinhui Bao, Yi Xu, Qiuyu Wang, Jingao Xu, and Danyang Li. From coarse to fine: Two-stage indoor localization with multisensor fusion. Tsinghua Science and Technology, 28(3):552--565, 2023.
[59]
Fei HUANG, Guangxia LI, Haichao WANG, Shiwei TIAN, YANG Yang, and Jinghui CHANG. Navigation for uav pair-supported relaying in unknown iot systems with deep reinforcement learning. Chinese Journal of Electronics, 31(3):416--429, 2022.
[60]
Deepak Vasisht, Swarun Kumar, and Dina Katabi. Decimeter-Level Localization with a Single WiFi Access Point. In Proceedings of USENIX NSDI, 2016.
[61]
Jie Xiong and Kyle Jamieson. ArrayTrack: A Fine-Grained Indoor Location System. In Proceedings of USENIX NSDI, 2013.
[62]
Chenhao Wu, Xuan Huang, Jun Huang, and Guoliang Xing. Enabling Ubiquitous WiFi Sensing with Beamforming Reports. In Proceedings of ACM SIGCOMM, 2023.
[63]
Elahe Soltanaghaei, Avinash Kalyanaraman, and Kamin Whitehouse. Multipath Triangulation: Decimeter-level WiFi Localization and Orientation with a Single Unaided Receiver. In Proceedings of ACM MobiSys, 2018.
[64]
Minghui Zhao, Tyler Chang, Aditya Arun, Roshan Ayyalasomayajula, Chi Zhang, and Dinesh Bharadia. ULoc: Low-Power, Scalable and cm-Accurate UWB-Tag Localization and Tracking for Indoor Applications. In Proceedings of the ACM IMWUT, 2021.
[65]
Jing Yang, BaiShun Dong, and Jiliang Wang. VULoc: Accurate UWB Localization for Countless Targets without Synchronization. In Proceedings of the ACM IMWUT, 2022.
[66]
Bernhard Großwindhager, Michael Rath, Josef Kulmer, Mustafa S. Bakr, Carlo Alberto Boano, Klaus Witrisal, and Kay Römer. Salma: Uwb-based single-anchor localization system using multipath assistance. In Proceedings of ACM SenSys, 2018.
Index Terms
- Locating Your Smart Devices with a Single Speaker
Recommendations
Changing How We Make and Deliver Smart Devices: When Can I Print Out My New Phone?
The research vision of printing physical devices has been around for a decade, and in research prototypes this vision is being realized. With fabrication laboratories (fab labs) emerging around the world and with more powerful modular computing ...
Key Extraction Using Ambient Sounds for Smart Devices
To secure communications, this article presents a key extraction scheme for smart devices using ambient sounds. Specifically, it is designed for the scenario when smart devices do not have any pre-loaded secrets. Moreover, it can be implemented when smart ...
Demand Forecasting and Smart Devices as Building Blocks of Smart Micro Grids
IMIS '12: Proceedings of the 2012 Sixth International Conference on Innovative Mobile and Internet Services in Ubiquitous ComputingThe Internet of Things aims at creating smart environments. One of those fields of applications are smart micro grids. In those grids the energy producers and consumers become smart in the sense that they can plan and coordinate their actions. For those ...
Comments
Information & Contributors
Information
Published In
November 2024
950 pages
ISBN:9798400706974
DOI:10.1145/3666025
- Chair:
- Jie Liu,
- Co-chairs:
- Yuanchao Shu,
- Jiming Chen,
- Program Chair:
- Yuan He,
- Program Co-chair:
- Rui Tan
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike International 4.0 License.
Sponsors
- SIGARCH: ACM Special Interest Group on Computer Architecture
- SIGBED: ACM Special Interest Group on Embedded Systems
- SIGMETRICS: ACM Special Interest Group on Measurement and Evaluation
- SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing
- SIGOPS: ACM Special Interest Group on Operating Systems
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 November 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
Conference
SenSys '24
SenSys '24: 22nd ACM Conference on Embedded Networked Sensor Systems
November 4 - 7, 2024
Hangzhou, China
Acceptance Rates
Overall Acceptance Rate 174 of 867 submissions, 20%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 375Total Downloads
- Downloads (Last 12 months)375
- Downloads (Last 6 weeks)148
Reflects downloads up to 05 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in