Video X – Raying [Dec 2017 – May 2018]

Implemented a system to detect objects in the video using SIFT Features and buy them online by clicking on the object using web-scrapping. Also provided, provision to click on the character’s face to open up the IMDb database about the person using LBPH Face Recognition Algorithm.

  • An additional feature was added to this project by employing LBPH face recognition algorithm. By means of clicking on the person’s face on the video, the IMDb database about the character pops up which makes it easy for the viewers if they want to know more about the character in the video.
  • Amazon X-Ray feature implemented in Kindle Amazon gives access to the general reference information such as a dictionary, encyclopedia, and information about characters featured in stories without using the internet.
  • This feature was further upgraded in Amazon Prime Videos to display the IMDb profile of characters, and information about music and trivia of the video instantaneously while watching it without disturbing the viewer’s experience.
  • Our idea is to employ face recognition and display information about the character by clicking on the character’s face during video playback itself.
  • We extend this to a further step by providing an advertising platform during the course of the video itself, instead of having an intermission to advertise products.
  • A new method of advertising products was introduced – Products to be advertised are detected during the course of the video using SIFT features and matched with predefined classifiers to recognize the object.

  • Upon recognition, an easy option was provided to buy them online with the help of web scrapping. Clicking on a button in the keyboard will redirect to the product buying website.
  • This is done by employing object detection algorithms on the video feed and providing an easy option to buy them online with the help of web scraping and an interactive Graphical User Interface (GUI).