GENERATIVE ADVERSARIAL NETWORKS AND APPICATION FOR BUILDING CHARACTERS IN VIRTUAL REALITY | Bắc | TNU Journal of Science and Technology

GENERATIVE ADVERSARIAL NETWORKS AND APPICATION FOR BUILDING CHARACTERS IN VIRTUAL REALITY

About this article

Received: 24/08/20                Revised: 30/11/20                Published: 30/11/20

Authors

1. Do Thi Bac Email to author, TNU – University of Information and Communication Technology
2. Le Son Thai, TNU – University of Information and Communication Technology
3. Ma Van Thu, TNU – University of Information and Communication Technology
4. Do Thi Chi, TNU – University of Information and Communication Technology
5. Ha My Trinh, TNU – University of Information and Communication Technology

Abstract


The article explored Generative Adversarial Networks (GAN) neural networks and application of automated material for human characters in virtual reality. A real data set of materials created by 3D designers was used to train two opposing elements in a neural network, which are data generating and data differentiating. Experimental results show that the GAN network allows automatic material generation for 3D models. GAN generated materials meet the technical requirements of meshing and imagery for use in 3D character modeling. This is the direction of research and application of artificial intelligence with great potentials in the production of multimedia data in general and 3D models in particular.


Keywords


Computer graphics; generative adversarial networks; GAN; virtual reality; model 3D.

References


[1]. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, “Generative adversarial nets”, Advances in Neural Information Processing Systems, vol. 27, pp. 2672-2680, 2014.

[2]. C. Ledig, L. Theis, F. Husz´lcr, J. Caballero, A. Cunningham, A. Acosta, A. Aitken, A. Tejani, J. Totz, Z. Wang, and W. Shi, “Photo-realistic single image super-resolution using a generative adversarial network”, IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , pp. 105-114, 2017.

[3]. X. Wang, K. Yu, S. Wu, J. Gu, Y. Liu, C. Dong, Y. Qiao, and C. C. Loy, “Esrgan: Enhanced super-resolution generative adversarial networks”, The European Conference on Computer Vision Workshops (ECCVW), Won Region 3 in the PIRM2018-SR Challenge, 2018.

[4].J.-Y. Zhu, T. Park, P. Isola, and A. A. Efros, “Unpaired image-to-image translation using cycle-consistent adversarial networks”, IEEE International Conference on Computer Vision (ICCV), Venice, pp. 2242-2251, 2017.

[5]. T. Zhang, W. Tian, T. Zheng, Z. Li, X. Du, and F. Li, "Realistic Face Image Generation Based on Generative Adversarial Network", 16th International Computer Conference on Wavelet Active Media Technology and Information Processing, Chengdu, China, pp. 303-306, 2019.

[6]. Y. Cui, and W. Wang, "Colorless Video Rendering System via Generative Adversarial Networks", IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA), Dalian, China, pp. 464-467, 2019.

[7]. K. Gopan, and G. S. Kumar, "Video Super Resolution with Generative Adversarial Network", 2nd International Conference on Trends in Electronics and Informatics (ICOEI), Tirunelveli, pp. 1489-1493, 2018.

[8]. S. Lunz, Y. Li, A. Fitzgibbon, and N. Kushman, “Inverse Graphics GAN: Learning to Generate 3D Shapes from Unstructured 2D Data”, Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG), pp. 1-11, 2020.

[9]. A. Radford, L. Metz, and S. Chintala, “Unsupervised representation learning with deep convolutional generative adversarial networks”, International Conference on Learning Representations, Soumith Chintala, New York, 2016.

[10]. M. Mirza, and S. Osindero, “Conditional Generative Adversarial Nets”, Simon Osindero, San Francisco, CA 94103, 2014.

[11]. Y. Du, W. Zhang, J. Wang, and H. Wu, "DCGAN Based Data Generation for Process Monitoring", IEEE 8th Data Driven Control and Learning Systems Conference (DDCLS), Dali, China, pp. 410-415, 2019.

[12]. S. T. Le, V. T. Ma, N. D. T. Tran, and T. N. Phung, “Guad mesh optimization in controlling 3d objects applied for Vietnamese sign language performance”, TNU Journal of Science and Technology, vol. 178(02), pp. 91-96, 2018.


Refbacks

  • There are currently no refbacks.
TNU Journal of Science and Technology
Rooms 408, 409 - Administration Building - Thai Nguyen University
Tan Thinh Ward - Thai Nguyen City
Phone: (+84) 208 3840 288 - E-mail: jst@tnu.edu.vn
Based on Open Journal Systems
©2018 All Rights Reserved