Automating 3D Modeling using NLP

I would like to know if there is any way we can automate 3D modeling processes. Like if I give the model a text input such as create a sphere and give it a red color and the we need to get the model. To be precise, I would like to create a bot that can perform actions in a software such as blender, like I tell the bot what I would like to do and then it does it. Any idea how can I achieve this?

Topic 3d-reconstruction chatbot nlp

Category Data Science


Well sure it's doable: the NLP part is just speech recognition + extracting the formal command from the text, it's very similar to "virtual assistants" like Apple Siri, Amazon Alexa, Ok Google.

However the hard part is to formalize all the possible commands that can be given, and then train a model to correctly map voice commands to software instructions.

I'm not convinced that it's very useful, because giving detailed instructions like "move object to position x=3.45678, y=-9.8765, z=1.2345" is not as intuitive as using a mouse to move the object. There's a fallacy in imagining that language commands are easier than learning to use a software or programming language: it works for very simple tasks, but as soon as one needs a bit of precision general language is too ambiguous.

About

Geeks Mental is a community that publishes articles and tutorials about Web, Android, Data Science, new techniques and Linux security.