Széchenyi Plan Plus | Government of Hungary. Funded by the European Union. NextGeneration EU.

EN HU
  • Discover
    • News
    • Events
    • Report
  • Research & development
    • Areas of application
    • Research topics
  • Resources
    • Publications
    • Lead researchers
  • Partners
    • Consortium members
    • International partners
    • Industry contacts
    • University contacts
  1. Home
  2. Publications
Proceedings of the 3rd Cognitive Mobility Conference (COGMOB 2024) / 25 February 2025

Dynamic Prompt-Based Approach for Open Vocabulary Multi-Object Tracking

Multi-Object Tracking (MOT) remains a significant challenge in computer vision. While deep learning has improved accuracy, challenges persist. Traditional methods rely on extensive datasets and can only detect classes included in their training, limiting their ability to track new objects. Annotating tracking datasets is complex, requiring unique identification for each object across frames, adding to the difficulty. This research explores integrating open-set object detection with MOT. Using language-based prompts, the system can recognize and track objects beyond predefined classes, adapting to new environments and objects described in natural language. This approach allows users to generate their own datasets for any desired objects. Unlike previous methods, which require significant user interaction, this research offers a user-friendly solution with high accuracy.

Url
https://doi.org/10.1007/978-3-031-81799-1_25
Authors
Fésüs, Á.
Kővári, B.
Bécsi, T.
Leginusz, L.
Institutes

Kapcsolat

Prof. Dr. Péter Gáspár

H-1111 Budapest, Kende u. 13-17.

+36 1 279 6000

autonom@nemzetilabor.hu

© 2020-2023 National Laboratory for Autonomous Systems, Budapest