Summary:
A German Artificial Intelligence startup has developed an innovative AI for video understanding. The AI combines state-of-the-art Computer Vision and Natural Language Processing to analyze video on various levels for a deep understanding of the content. The vision is to create a European standard General Purpose Technology for video understanding. The startup is looking for industry partners to conclude commercial agreements with technical assistance, research or technical agreements.
Description:
In various industries, the real problem with creating value with AI is the lack of a suitable data basis. For example, media companies produce a lot of content in complex data formats (especially video), unstructured, and not sufficiently documented with meta information. Thus, they often have no overview of their content or transparency within their archives, and many potentials remain unused. At the moment, the best practice is to use the human workforce (up to 50 archivers) to annotate videos, which is very slow, expensive, and not scalable. Still, due to the overwhelming amount of content produced, they can only annotate a small fraction of their videos manually.
This is why the AI startup, based in the South of Germany, developed a novel AI-based video analysis platform for video assets. It utilizes state-of-the-art video captioning techniques to create meaningful, semantically deep annotations to describe what is actually happening in the videos in full sentences. The platform is based on a human-in-the-loop approach, where the AI annotates the videos and the human only refines the ones, where the AI was not perfect. Based on this human input, the AI constantly learns and improves itself, which is specialized to the customer's own, individual needs.
Compared to other solutions, the Unique Selling Point (USP) is that it is not only extracting simple objects, faces, etc., but rather understanding the multi-modal context of the video, and summarizing it in multiple scenes. By taking multiple views (like image and speech) into account, the AI can describe the actual gist, and in doing so also surpasses all current state-of-the-art video captioning models. Furthermore, instead of trying to replace the human with an out-of-the-box AI, he is integrated into an innovative, AI-supported workflow, to make his tasks more natural for humans, and to let the AI continuously learn and adapt to human-level intelligence.
The startup is interested in research and technical cooperation agreements as well as in a commercial agreement with technical assistance with partners from the industry who want to apply, further develop and leverage this technology to their industry-specific use cases. Especially, it would be important that the cooperation partner provides a relevant video dataset, in the best case already annotated with relevant labels.
Type (e.g. company, R&D institution…), field of industry and Role of Partner Sought:
The vision is to create a GPT (General Purpose Technology) and set the European standard for general video understanding, similarly like GPT-3 is doing for Natural Language Processing. In order to achieve this, the startup is currently looking for collaboration partners from the industry who are interested in solving their video management, analytics, and tagging challenges through Artificial Intelligence.
Industries and application fields can be diverse, for example:
- Film and television, for structured archiving
- Social media for content moderation
- News for accelerated post-production
- Sports for statistical analysis
- Production for quality assurance
- Market research for video interviews
- Security for surveillance cameras
- and any industry use case that is handling a lot of video content..
For a future collaboration, a research or a technical cooperation agreement is foreseen. But also a Commercial agreement with technical assistance could be possible.
Stage of Development:
Available for demonstration
IPR Status:
Copyright
External code:
TODE20211122001
