Measuring animal posture

Animal pose estimation 2019

Developing fast, precise methods for measuring animal posture with deep learning.

DeepPoseKit introduced methods for fast, accurate animal pose estimation, combining multi-scale deep learning with efficient body-landmark localization.

Animal body landmarks estimated from video

Drag to reveal the measurement

Actual footage and model-estimated body landmarks.

My contribution

I led the development of DeepPoseKit’s methods, combining multi-scale deep learning, representations of the relationships between body landmarks, and fast landmark localization with subpixel precision. The work addressed the trade-off between speed and accuracy in measuring animal posture across species.

Explore further

Feature Article

Featured in

Quanta Magazine · Nature Methods · Nature News & Views

Citation

Graving, J. M., Chae, D., Naik, H., Li, L., Koger, B., Costelloe, B. R., & Couzin, I. D. (2019). DeepPoseKit, a software toolkit for fast and robust animal pose estimation using deep learning. eLife, 8, e47994. https://doi.org/10.7554/elife.47994

@article{graving2019deepposekit,
  title={{DeepPoseKit, a software toolkit for fast and robust animal pose estimation using deep learning}},
  author={Graving, Jacob M and Chae, Daniel and Naik, Hemal and Li, Liang and Koger, Benjamin and Costelloe, Blair R and Couzin, Iain D},
  journal={eLife},
  volume={8},
  pages={e47994},
  year={2019},
  publisher={eLife Sciences Publications, Ltd},
  doi={10.7554/elife.47994}
}