Final Year Project - video based communication application (SnapChat Like AR 3D model map to user face)
(b)To implement emotion detect and head motion detection, Google Mobile Vision API will be used in this application, the reason is it is free, it also hide some of the difficulty to detect facial emotion. Through this API, some landmarks will be detected. We can take those landmark to add the effects.
(c),(d) After detect the user emotion, we then started to analysis that which kinds of emotion that user is performing. Next we extract the analysis result to match the predefined set of emotions condition.
(e,f,h) Next, after matching the condition, it will extract the preset 3D models(include 2D, 3D graphics and objects). To implement the rendering part, OpenGL and RAJAWALI will be used in this application. The usage of OpenGL is a library to rendering 2D and 3D vector graphics. Via OpenGL, we can interact will graphics processing unit to achieve hardware accelerated rendering. Mean- while, RAJAWALI is a framework for android application, it can easily to interact between Android and OpenGL, make it more lite to render the 3D models in Android.
Finally, after the 3D models are rendered, we will use the Vuforia library, Vuforia is an Augmented Reality Software Development Kit for mobile devices, it enables the creation of Augmented Reality applications. Via this SDK, we map the corresponding 3D models to the user face
(For the latest updated version, we finally dosen’t need Vuforia for AR 3d project, because what we have been done, is to map the 3D models using RAJAWALI into detected user face. Such that we doesn’t need this library support )
Copyright (c) 2017 Oska Cheng
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.