Performance of Voice-Based Personalized AI Assistant using Python and JavaScript

Authors

  • Sushil R. Mishra Final year Department of Computer Science and Engineering, Mauli Group of Institutions College of Engineering and Technology, Shegaon, Maharashtra, India Author
  • Anjali K. Ingle Final year Department of Computer Science and Engineering, Mauli Group of Institutions College of Engineering and Technology, Shegaon, Maharashtra, India Author
  • Dr. Avinash S. Kapse Head, Department of Computer Science and Engineering, Mauli Group of Institutions College of Engineering and Technology, Shegaon, Maharashtra, India Author

DOI:

https://doi.org/10.32628/IJSRST251222677

Keywords:

Voice-Based AI Assistant, Personalized Assistance, Voice Recognition Technology, Smart Home Automation, User-Centric Design, Privacy-Focused AI

Abstract

This paper details the design, development, and deployment of Vaani, a voice-activated AI personal assistant focused on local-first data handling and user privacy. Building upon the initial design concepts, this work presents concrete implementation results of Vaani's core features, including real-time voice recognition, personalized response behavior, and integration with smart home devices, all achieved without reliance on cloud-based storage or third-party APIs for data persistence. A proprietary local database architecture was developed to ensure zero data leakage, enabling full user control over sensitive information. We present benchmarks of Vaani’s performance across multiple tasks, analyze accuracy in voice recognition under varying acoustic conditions, and demonstrate adaptability to individual user commands and patterns through incremental learning. Security assessments validate Vaani’s robustness against typical attack vectors seen in voice-activated systems. The assistant was tested in real-world scenarios such as daily schedule management, environmental control, and task automation, with usability feedback collected to iterate on interface design. This work substantiates the claim that highly functional voice assistants can be both user-friendly and privacy-preserving, challenging the prevailing trade-off between convenience and data security. Our results set a precedent for decentralized, ethical AI systems and contribute practical insights into building responsible, locally-executing AI solutions for daily use.

Downloads

Download data is not yet available.

References

S. Padó and R. Huang, Eds., “Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP): System Demonstrations,” Association for Computational Linguistics, 2019.

A. R. Patil, “A survey on deep learning approaches for text classification,” IRJET, vol. 11, no. 4, pp. 139-145, 2024.

A. R. Patil and S. S. Kharat, “A survey on natural language processing: Applications and challenges,” IRJET, vol. 11, no. 1, pp. 114-118, 2024..

S. K. Gupta, “IntelliAssistant - AI based personal assistant,” unpublished

H. Xu, Y. Wang, S. Yao, and A. C. Champion, "Protecting user privacy in voice input," Proc. ACM Int. Joint Conf. Pervasive Ubiquitous Comput. (UbiComp), 2019, pp. 1261–1273.

Downloads

Published

28-04-2025

Issue

Section

Research Articles