Augmented Reality Apps without Tokens

Question

I made augmented reality using markers. I'm just wondering if any AR applications can be made without the help of markers. For example, using any image / exciting live video and integrating a virtual object in the real world using any buttons. Is this possible if anyone can help me do this process. This will be a big help for me.

Answer 1

Several natural function tracking libraries are now available: Qualcomm AR SDK and Metaio Unifeye SDK and Metaio Junaio Glue allow you to register and track images on mobile devices, and HIT Lab NZ has the Opira library, which provides similar functionality, but on the desktop (with really good tools development).

There are two main approaches to inserting a 3D object into an unprepared, unmodulated video stream: the first is to make some changes in SLAM (simultaneous placement and display) - find the points of the function in the video stream, find those that are reliable -to-frame frames and use them to create a 3D point map that can be used as a model of the environment / tracking to insert a 3D object. The best known in AR circles is PTAM (parallel tracking and matching). The second approach is mainly used outdoors: suppose that the user remains stationary and asks them to create a panorama that you project onto the cylinder around the user. Objects can then be inserted into coordinates around the cylinder, and the environment can be studied and tracked. This is Panoramic Tracking and Matching (vaguely, the same abbreviation).

Hope this helps you get started.

Answer 2

You can try the Sony SmartAR SDK to implement marker-free AR, including a high-speed camera and a large scale. Unfortunately, the project looks abandoned. The documentation will be found in the downloaded zip file.

https://www.sonydna.com/sdna/solution/SmartAR_SDK.html

And here is an incredible demo: https://www.youtube.com/watch?v=XCEp7udJ2n4

Even better, there is an updated tubeless AR SDK called Kudan: https://www.kudan.eu/features/

You have the opportunity to use the Unity 3D package.

Answer 3

This is an area of ​​ongoing research. As far as I know, there are no known reliable (and fast) algorithms yet. Perhaps you can find inspiration in CV Papers .