Volume 20, Issue 3 (12-2023)
JSDP 2023, 20(3): 13-26 |
Back to browse issues page
Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
Hajizadeh N, Vahdat-Nejad H, Havangi R. The Architecture of the Blind Assistant System for Passing Intersection by Mobile Cloud Computing. JSDP 2023; 20 (3) : 2
URL: http://jsdp.rcisp.ac.ir/article-1-1298-en.html
URL: http://jsdp.rcisp.ac.ir/article-1-1298-en.html
University of Birjand
Abstract: (967 Views)
Subject- Today, with the advancement of technologies to assist blind and visually impaired people, navigation systems are of great importance. As a result of emerging technologies in telecommunication and smartphones, these people can be helped. Identifying pedestrian and traffic lights is important to help pedestrians with visual impairments cross the intersection safely and securely.
Background- researchers have studied the detection and identification of traffic lights in the assistive system or blind assist device. These researches can be divided into three main types: based on pattern matching, based on circular shape extraction, and based on color distribution.
Methodology- In this research, an architecture based on mobile cloud computing is proposed, which can help blind pedestrians in crossing intersections. The architecture consists of three tiers: mobile phone, cloud, and supervision. The most important component is located on the mobile phone. It recognizes the color of pedestrian light by using image processing techniques. Spatial information (time and location) of the blind person is collected and held in a cloud storage database so that acquaintances can monitor him if needed. In order to detect the status of pedestrian lights, pictures of crossing streets with cameras will be captured. Using the features of color and morphology operations, the color of pedestrian lights is recognized and reported to the blind person. To this end, morphological operations are performed to eliminate small elements in the background and to restore the original size of the traffic light sign. Therefore, the operations of dilation, filling, and erosion are used.
Result- We gathered a dataset including 280 photos of pedestrian lights (170 photos at day, 110 photos at night) in different illumination conditions (early day, noon, early night, night) and weather (sunny, cloudy, rainy). Matlab software and notebook system with Intel (R) Core (TM) i5 CPU and AMD Mobility Radeon HD 5100 graphics card were used to implement pedestrian traffic-light status detection. The scenario-based method is used to evaluate the system architecture and show that the proposed system can satisfy the investigated scenario. At last, the implementation results on taken images show excellent performance in detecting pedestrian lights with approximately 100% accuracy for the day and night.
Background- researchers have studied the detection and identification of traffic lights in the assistive system or blind assist device. These researches can be divided into three main types: based on pattern matching, based on circular shape extraction, and based on color distribution.
Methodology- In this research, an architecture based on mobile cloud computing is proposed, which can help blind pedestrians in crossing intersections. The architecture consists of three tiers: mobile phone, cloud, and supervision. The most important component is located on the mobile phone. It recognizes the color of pedestrian light by using image processing techniques. Spatial information (time and location) of the blind person is collected and held in a cloud storage database so that acquaintances can monitor him if needed. In order to detect the status of pedestrian lights, pictures of crossing streets with cameras will be captured. Using the features of color and morphology operations, the color of pedestrian lights is recognized and reported to the blind person. To this end, morphological operations are performed to eliminate small elements in the background and to restore the original size of the traffic light sign. Therefore, the operations of dilation, filling, and erosion are used.
Result- We gathered a dataset including 280 photos of pedestrian lights (170 photos at day, 110 photos at night) in different illumination conditions (early day, noon, early night, night) and weather (sunny, cloudy, rainy). Matlab software and notebook system with Intel (R) Core (TM) i5 CPU and AMD Mobility Radeon HD 5100 graphics card were used to implement pedestrian traffic-light status detection. The scenario-based method is used to evaluate the system architecture and show that the proposed system can satisfy the investigated scenario. At last, the implementation results on taken images show excellent performance in detecting pedestrian lights with approximately 100% accuracy for the day and night.
Article number: 2
Type of Study: Research |
Subject:
Paper
Received: 2022/02/25 | Accepted: 2023/06/2 | Published: 2024/01/14 | ePublished: 2024/01/14
Received: 2022/02/25 | Accepted: 2023/06/2 | Published: 2024/01/14 | ePublished: 2024/01/14
References
1. [1] S.Zafar, M.Asif, M.Bin Ahmad, T.M.Ghazal, T. Faiz, M. Ahmad, M.A.Khan, " Assistive Devices Analysis for Visually Impaired Persons: A Review on Taxonomy", IEEE Access 2022, 10, 13354-13366.
2. [2] M.D.Messaoudi ,B.J. Menelas ,H.Mcheick, "Review of Navigation Assistive Tools and Technologies for the Visually Impaired", Sensors,vol.22,no.20,2022.
3. [3] Q. Wang, Q. Zhang ,X.Liang ,Y.Wang1, C. Zhou, V.Mikulovich , "Traffic Lights Detection and Recognition Method Based on the Improved YOLOv4 Algorithm", Sensors, vol.22,no.1,2022.
4. [4] Y. Jie, Ch. Xiaomin, G. Pengfei, Xi. Zhonglong, "A New Traffic Light Detection and Recognition Algorithm for Electronic Travel Aid", International Conference on Intelligent Control and Information Processing (ICICIP), IEEE, 2013, pp 644-648.
5. [5] Q. Zhang, L. Cheng, R. Boutaba, 2010,"Cloud computing: state-of-the-art and research challenges", Journal of Internet Services and Applications Springer-Verlag, 2010, vol. 1, Issue 1, pp. 7-18.
6. [6] A.K.Pandey,S.Maneria, "Cloud computing methods based on IoT for better patient data planning: A research", 11th International Conference on System Modeling & Advancement in Research Trends (SMART),2022.
7. [7] H. Vahdat-Nejad, "context- Aware Middleware: A Review", in Context in Computing: A Cross-Disciplinary Approach for Modeling the Real World, Springer, 2014, pp. 83-96.
8. [8] M. Omachi, Sh. Omachi, "Detection of Traffic Light Using Structural Information", Signal Processing (ICSP), International Conference on, IEEE, 2010, pp. 809 - 812.
9. [9] M. Yusro, K. Hou, E. Pissaloux, H. Shi, "SEES: Concept and Design of a Smart Environment
10. Explorer Stick" International Conference on Human System Interaction (HSI), IEEE, 2013, pp. 70-77.
11. [10] P. Angin, B. Bhargava, S. Helal, "A Mobile-Cloud Collaborative Traffic Lights Detector for Blind Navigation" International Conference on Mobile Data Management (MDM), IEEE, 2010, pp. 396-401.
12. [11] Y. Freund, R. Schapire, "A Decision-Theoretic Generalization of On-line Learning and an Application to Boosting" Journal of Computer and System Sciences, Elsevier, 1997, vol. 55, Issue 1, pp. 119-139.
13. [12] Y. Chunhe, B. Ying, "A Traffic Light Detection Method", Springer-Verlag Berlin Heidelberg, 2012, vol. 163, pp. 745-751.
14. [13] AN. Lapyko, Li. Tung, B. Lin, "A Cloud-based Outdoor Assistive Navigation System for the Blind and Visually Impaired", Wireless and Mobile Networking Conference (WMNC), IEEE, 2014, pp. 1-8.
15. [14] Y. Jie, T. Niu,"A Novel Electronic Travel Aid for the Blind", International Conference on Photonics, 3D-Imaging, and Visualization, edited by Egui Zhu, Proc. of SPIE, SPIE, 2011, vol. 8205, 820503, pp. 1-4.
16. [15] W. Zong, Q. Chen, "Traffic Light Detection Based on Multi-feature Segmentation and Online Selecting Scheme", International Conference on Systems, Man, and Cybernetics (SMC), IEEE, 2014, pp. 204-209.
17. [16] M. Diaz-Cabrera, P. Cerri, "Robust real-time traffic light detection and distance estimation using a single camera", Expert Systems with Applications , Elsevier, 2015, vol. 42, Issue 8, pp. 3911-3923.
18. [17] X. Shi, N. Zhao, Y. Xia, "Detection and classification of traffic lights for automated setup of road surveillance systems", Journal Multimedia Tools and Applications, Springer, 2014, pp. 1-16.
19. [18] T. Adep, R. Nikaml, , S. Wanewel, & K. B. Naik, "Visual Assistant for Blind People using Raspberry Pi", International Journal of Scientific Research in Computer Science, Engineering and Information Technology ,vol.7,no.3,pp.671-675, 2021.
20. [19] K.Ding, K.Ma, S.Wang & E.P. Simoncelli , "Comparison of Full-Reference image quality models for optimization of image processing systems", International Journal of Computer Vision , vol.129, pp.1258-1281,2021.
21. [20] M. Mattsson, H. Crahn, F. Martensson, "Software Architecture Evaluation Methods for Performance, Maintainability, Testability, and Portability", Proceedings of second International Conference on the Quality of software Architectures (QoSA), 2006.
22. [21] L. Dobrica, E. Niemela, "A survey on software architecture analysis methods. Software Engineering", IEEE Transactions on Software Engineering, vol. 28, Issue 7, pp. 638-653,2002.
Send email to the article author
| Rights and permissions | |
 |
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. |
