vAssist — Virtual Voice & Vision Assistant

  • Originally started with the idea of assisting those with vision challenges
  • vAssist is a virtual assistant with voice and vision features
  • Currently working on extending this project to assist all users in general with the usual virtual assistant functionalities and also vision related tasks

  • Reading out events from calendar, playing songs along with vision related tasks like object detection, people recognition, food menu reader etc
  • vAssist uses Speech Recognition(speech to text), speech synthesis(text to speech), NLU and conversation making using Rasa, object detection and face recognition
  • Tools used: Rasa, TensorFlow, Google Speech API, Python, Flask, OpenCV