All geek questions in one place

Audio / video tooltip

What semantic information can be extracted from such media? Everything will be fine, whether it is the differentiation between music and spoken text, the detection of various sounds (for example, shots or birds or cars), the detection of indoor / outdoor captures or the intensity of the camera’s movement.

I know that there are many , many , many , manymanymany research topics in this category, but I have not found any applications with any of them. Does anyone have links to apps / libraries / working prototypes / news about upcoming products on these topics?

+4
source share
3 answers

Take a look at MP4REG , which is the registration authority for code points in MP4 family files.

Short Primer: In the world of MPEG4 and QuickTime, the main physical media building block is called "Atom." Atoms can contain not only actual audio and video, but also technical and non-technical metadata. The last of you sounds interesting.

eg:.

  • albm : album name and track number (user data)
  • jp2i : intellectual property information

I only carefully studied this material regarding metadata, and my impression was that it was a fast and free world. You might want to take a look at some low-level MP4 parsing tools that allow you to examine individual atoms of real media files. I think there are even unofficial (unregistered) user atoms for use in certain systems.

+1
source

The best topic for finding apps is that you might want to take a look at the research topic, “Search and Index Content-Based Content”

Besides:

  • You can use training methods to classify the information received (video, single frames or audio).
  • You can use clustering methods to find similar sections of audio or video.

One application of this is commercial disposal. Commercial removers typically use a cluster approach to exclude sections of commercials in a television video.

0
source

The analysis of musical functions is a huge topic these days. Imagine the possibilities! http://en.wikipedia.org/wiki/Music_information_retrieval

Also check out the Conet project: http://www.archive.org/details/ird059

0
source

Source: https://habr.com/ru/post/1285750/

More articles:


All Articles