Abstract: Audio-visual zero-shot learning (ZSL) leverages both video and audio information for model training, aiming to classify new video categories that were not seen during the training. However, ...

- checkpoints/ - audio-cond_animation/ - avsync15_audio-cond_cfg/ - landscapes_audio-cond_cfg/ - thegreatesthits_audio-cond_cfg/ - avsync/ - vggss_sync_contrast ...

Abstract: This article presents a robot control algorithm suitable for safe reactive navigation tasks in cluttered environments. The proposed approach consists of transforming the robot workspace into ...

In this paper, we propose a new multi-modal task, termed audio-visual instance segmentation (AVIS), which aims to simultaneously identify, segment and track individual sounding object instances in ...

SAM Audio is the first unified AI model that can segment sound from complex audio mixtures using text, visual, and time span prompts. This technology has the potential to transform audio and video ...