12.08.2025

Teaser image to Tracking Actions in Space and Time: ICCV 2025 Challenge & Workshop

Tracking Actions in Space and Time: ICCV 2025 Challenge & Workshop

MCML Research Insight - With Tanveer Hannan, Mark Weber, and Thomas Seidl

Tracking actions, not just objects: The Spatiotemporal Action Grounding Challenge and Workshop at ICCV 2025 focusses on detecting and localizing actions both in space and time within complex, real-world videos.

Unlike standard action recognition, this task requires identifying when and where an action occurs, pushing models to handle long, diverse, and occlusion-heavy video content. Applications range from sports analytics to autonomous systems and large-scale video search.

The worksop is organized by MCML Junior Members Tanveer Hannan and Mark Weber, MCML Director Thomas Seidl and collaborators.


«We believe this challenge will bring the community together to push the boundaries of spatiotemporal video understanding.»


Tanveer Hannan

MCML Junior Member, Co-Organizer

Challenge Overview

The challenge provides:

  • A large-scale dataset with dense spatiotemporal annotations.
  • Standardized evaluation for fair comparison.
  • Baseline models & open-source code for quick experimentation.

The Evaluation Server is open until September 19, 2025, allowing teams to submit results and receive immediate feedback.

Evaluation Server

Check out an example video from the dataset

It features dense spatiotemporal annotations, with user queries paired with corresponding object bounding boxes in every frame. At the top, you’ll see the current frame number and a visual summary of the number of queries (shown as boxes). At the bottom, the specific textual user query is displayed.

Example Video

«This is an exciting opportunity to connect research and real-world applications.»


Rajat Koner

Amazon, MCML Alumni, Co-Organizer

Workshop Highlights

The challenge will conclude at our ICCV 2025 Workshop in Hawaii, featuring:

  • Invited talks from leading video understanding researchers.
  • Panel discussions on future directions.
  • Top team presentations detailing innovative solutions.

Full details, including the evaluation package, dataset description, and baseline code, are available on the Workshop Website.

Workshop Website

 


«We want to see methods that not only achieve high accuracy but also work in real-world scenarios.»


Organizers

Why Now?

The explosion of online video makes robust spatiotemporal grounding essential. The complexity of actions, camera changes, and temporal reasoning demands methods that are accurate, generalizable, and efficient. Advances in Vision-Language Models (VLMs) and multimodal learning open new possibilities, and this challenge aims to accelerate progress.


Get Involved

We invite the computer vision community to join us.

Participate in the challenge

Evaluation Server

Explore resources

Workshop Website

Meet us at ICCV 2025

Conference Website

We look forward to your submissions and discussions at ICCV 2025 in Hawaii.


Share Your Research!


Get in touch with us!

Are you an MCML Junior Member and interested in showcasing your research on our blog?

We’re happy to feature your work—get in touch with us to present your paper.

12.08.2025


Subscribe to RSS News feed

Related

Link to Predicting Health with AI - with researcher Simon Schallmoser

22.09.2025

Predicting Health With AI - With Researcher Simon Schallmoser

Simon Schallmoser uses AI to predict health risks, detect low blood sugar in drivers, and advance personalized, safer healthcare.

Link to GCE-Pose – predicting whole objects from partial views

18.09.2025

GCE-Pose – Predicting Whole Objects From Partial Views

From fragments to whole: GCE-Pose, published at CVPR 2025, enhances pose estimation with global context for smarter AI vision.

Link to Research Stay at Harvard University

17.09.2025

Research Stay at Harvard University

Hannah Laus spent 11 weeks at Harvard with the AI X-Change Program, advancing research on LLMs and exploring new collaborations.

Link to Robots Seeing in the Dark - with researcher Yannick Burkhardt

15.09.2025

Robots Seeing in the Dark - With Researcher Yannick Burkhardt

Yannick Burkhardt erforscht Event-Kameras, die Robotern ermöglichen, blitzschnell zu reagieren und auch im Dunkeln zu sehen.

Link to 3D Machine Perception Beyond Vision - with researcher Riccardo Marin

08.09.2025

3D Machine Perception Beyond Vision - With Researcher Riccardo Marin

Researcher Riccardo Marin explores 3D geometry and AI, from manufacturing to VR, making machine perception more human-like.

Back to Top