Generate 3D object from processing 2nd sketch on paper

I want my application to understand the diagrams drawn on paper of three-dimensional objects, such as cubes, cylinders, pyramids, using image processing (openCV) and display the corresponding three-dimensional models in opengl. The following figure shows a simple sketch and the corresponding 3d model. How can I recognize objects drawn on paper in the form of shapes such as a cube, a pyramid, etc., And build a 3d model. Can anyone explain how I can come up to solve this problem. is there any source code or library available for it.

image

+2
source share
5 answers

There is no code (you will understand why), but you might be interested in reading the 1963 PhD Lawrence G Roberts dissertation , entitled β€œMachine Reading of Three-Dimensional Solids,” where it solves this problem. You can view pdf in the first link.

+3
source

What you are trying to do is a very difficult task. At least if you want this to work with arbitrary forms.

This is for a simple reason: the computer does not work like a human brain. For example, take a look at this upper right picture. What do you see? Box? Or is it a flat rectangular shape with two parallelograms attached to the top and left?

Our brain sees a three-dimensional shape, because we live in a three-dimensional world, and most of the things that we see are three-dimensional, and our evolution has led to the formation of neural structures that are easily based on the perception of such.

But there is an even more fundamental problem: image segmentation. You need to separate parts of the image to adjacent areas. In our recognition, brain forms, reconstructions, and segmentations are interconnected, and this happens in an iterative process. You have probably experienced this several times: you saw a figure, but at first you could not understand what it was. And your mind raced with a huge number of objects and forms, which may be what you see. And then after a few minutes you clearly see the form. But not because you finally understood this only from the picture, but because the brain increased the sensory contribution with its existing knowledge of the world.

The task you are asking for affects not only computer vision, but also machine learning and pattern recognition.

+1
source

If you have many images from different angles, you can use ProFORMA - style methods to restore the model.

0
source

This is a very difficult task, including several image processing methods to achieve the desired result.

I suggest you take a look at this work first: Creating 3D models using a simple webcam

-1
source

I think you want to do this . You can email them to access the source code. Good luck

-1
source

Source: https://habr.com/ru/post/1391689/


All Articles