On Feb 10th, 2021, the AI4EU Cafe presents at 3 pm:

the Speaker Hannes Fassold (Senior researcher at the Machine Vision Applications Group of the DIGITAL institute at JOANNEUM RESEARCH)

with his talk on

“Employing AI for the semantic analysis of conventional and immersive video”.  

This Cafe session is a collaboration by AI4EU and AI4MEDIA partners!

Talk description

Description: AI-based methods are nowadays the best choice for automatic extraction of semantic metadata from archive content. In this session, will describe our experience employing deep learning algorithms for face detection and recognition as well as general object detection and tracking. We will discuss the current state of these methods and highlight issues which are still remaining, like the ethnic bias occurring in all face recognition methods trained on public datasets. We will then present use cases how these methods can help archives to annotate and exploit their content in a more convenient way. We address here not only conventional video content, but also emerging content types like immersive video, which pose new challenges for archives. We will show how face recognition and scene object extraction can be used for the semi-automatic annotation of video content and for automatic cinematography / editing of a 360° video.

BIO: Hannes Fassold received a MSc degree in Applied Mathematics from Graz University of Technology in 2004. Since then he works at JOANNEUM RESEARCH, where he is currently a senior researcher at the Machine Vision Applications Group of the DIGITAL institute. His main research interests are the automatic analysis and enhancement of video (e.g. object detection & tracking, optical flow, speaker recognition, defect detection, superresolution, denoising) with deep learning methods. He has published several publications in these fields and coordinates the machine learning workflow / infrastructure at DIGITAL.