2D Image to 3D Model

Goal:

To visualize and reciprocate the motion (render and animation) in 3D model or to convert flat 2D image into 3D character.

Software Brief:

My approach is to work with animate characters (3D Model approach) in which we create a mesh as multiple vertices (standard approach) of character then we traces out the key points and generate an automatic layout (Texture Layout) for physics modeling in order to add animation and expressions in the model itself, once this modeling is done we can export the model.

Vision:

• My goal is to create model from flat 2D image with functionality of modeling and animation (rigging).
• Currently my involvement is in to work with predefined models to understand the workflow, once it’s done I will focus on image to model conversion.

Research involves around the subject:

• My implementation is to create custom characters to visualize and that can be used in any form of animation work (focus to be use in Met averse).
• Initially the software comes with limited option in trail version but once we buy PRO version we have n number of options to do
• As it comes with two side one is modeler and second is animator, you can create and do modeling generation in modeler while to do animation and export file as video you have to use animator side.
• Once all the work is done, this software also comes with model viewer console where you can review your model in specific environment.

Implementation:

Editor

• You have to set up all the necessary builds and models in progression of this work.
• As a build you will need to add Microsoft visual installer.
• As a predefined model there is no need to create texture but for image to model conversion you will need to create textures and for that you need to add additional tool as Photoshop or Clip paint studio.
• Once you will able to generate textures you can export those files into .psd format and here you can import as model file.
• As a new file you will need to create automatic mesh generation first and then create a automatic layout basis on your texture available in the image/model.
• Now you can do physics modeling in character with the help of creating group or add specific asset that you want to rig in the model.
• That’s it!!! Now you can export your model for runtime.

Animator:

• You need to load the model and need to create a new scene for your animation.
• Once model is load you need to add control the parameter by adding values in the video sequence for animation, once it’s done you can play the video.
• Here you can also add expression in the video.
• Here you can play with the parameter and values to make it as good animation video.
• Once it’s done you can export your video as animator video.

Note: Once you have model and animated video, you can use any interface to view with amazing environment.

Results:

Here I am sharing video which is tested :

Limitation:

• If you will start work with predefined models, most of the models are available in other language (Not in English) which creates difficulties to tune assets and parameter while working.
• Here, there is no rotation (360 Degree) within the tool, you can only control it to a specific angle.
• It only allows 2 parameters to interact with a specific Art Mesh, while Pro allows 3

Extensions:-

This section has some ideas for extending this article that you may wish to explore.

• Will extend this into platform like Metaverse.

If you explore one of these extension, I’d love to know.

Thank You :) .