Skip to content
Saif Khan
Saif Khan

Call: SIMSPINE Benchmark Extensions and Baselines

Muhammad Saif Ullah Khan

Abstract

This collaboration call focuses on extending SIMSPINE with stronger baselines, broader evaluation settings, and reproducibility-first benchmark protocols for spine-aware motion understanding.

Scope

I’d like to extend the SIMSPINE benchmark with stronger baselines and clearer evaluation rules.

Good scores matter, but I also want comparisons that other groups can reproduce and learn from.

Open Collaboration Tasks

  1. Add stronger 2D and 3D reference baselines under a unified training and evaluation protocol.
  2. Expand stress tests for cross-subject generalization, motion complexity, and failure-case analysis.
  3. Improve evaluation tooling, reporting templates, and reproducibility checklists.
  4. Contribute ablation studies around simulation choices and biomechanical constraints.

What Is Already Available

  • Public SIMSPINE dataset release.
  • Initial baseline code and benchmark setup.
  • Paper-level description of annotation pipeline and biomechanical checks.

Collaboration Format

  • Joint protocol design and benchmark planning.
  • Shared implementation checkpoints with reproducibility reviews.
  • Co-authored technical reports or paper submissions when outcomes are publication-grade.

If this scope matches your interests, contact me at mukh07@dfki.de with a short note about your background and preferred collaboration style.