Rxivist logo

DeepPoseKit, a software toolkit for fast and robust animal pose estimation using deep learning

By Jacob M. Graving, Daniel Chae, Hemal Naik, Liang Li, Benjamin Koger, Blair R. Costelloe, Iain D. Couzin

Posted 26 Apr 2019
bioRxiv DOI: 10.1101/620245 (published DOI: 10.7554/eLife.47994)

Quantitative behavioral measurements are important for answering questions across scientific disciplines—from neuroscience to ecology. State-of-the-art deep-learning methods offer major advances in data quality and detail by allowing researchers to automatically estimate locations of an animal’s body parts directly from images or videos. However, currently-available animal pose estimation methods have limitations in speed and robustness. Here we introduce a new easy-to-use software toolkit, DeepPoseKit , that addresses these problems using an eZcient multi-scale deep-learning model, called Stacked DenseNet , and a fast GPU-based peak-detection algorithm for estimating keypoint locations with subpixel precision. These advances improve processing speed >2× with no loss in accuracy compared to currently-available methods. We demonstrate the versatility of our methods with multiple challenging animal pose estimation tasks in laboratory and field settings—including groups of interacting individuals. Our work reduces barriers to using advanced tools for measuring behavior and has broad applicability across the behavioral sciences.

Download data

  • Downloaded 4,200 times
  • Download rankings, all-time:
    • Site-wide: 2,383
    • In animal behavior and cognition: 14
  • Year to date:
    • Site-wide: 12,949
  • Since beginning of last month:
    • Site-wide: 13,688

Altmetric data

Downloads over time

Distribution of downloads per paper, site-wide


Sign up for the Rxivist weekly newsletter! (Click here for more details.)