#DeepLabCut
She co-created DeepLabCut, an open-source tool that tracks animal movement from ordinary, marker-free video, now used for everything from mouse behavior to gait studies in Parkinson’s trials and mosquito flight. CEBRA, built in her lab, links behavior to large-scale recordings of neural activity.
October 28, 2026 at 8:56 AM
New CRAN package radiatR with initial version 0.1.3
#rstats
https://cran.r-project.org/package=radiatR
CRAN: Package radiatR
A complete pipeline for analysing directional data &ndash; headings and trajectories on the unit disk. Supply a table of angles directly, or reconstruct headings from movement trajectories imported from tracking tools ('EthoVision', 'DeepLabCut', 'SLEAP', 'TRex', 'ANY-maze', 'TrackMate', 'idtracker.ai', and others) via a unified dialect-based loader system, including multi-bodypart pose estimation with likelihood-weighted centroid. Derives per-trial heading directions using multiple rules (ring-crossing, distal point, pose body-axis, velocity-based, and more). Computes circular statistics including mean direction, resultant length, von Mises and wrapped Cauchy parametric fits, circular correlation (circular-linear and circular-circular), circular-linear regression (Fisher and Lee (1992) &lt;<a href="https://doi.org/10.2307%2F2532334" target="_top">doi:10.2307/2532334</a>&gt;), model selection among orientation models (Fitak and Johnsen (2017) &lt;<a href="https://doi.org/10.1242%2Fjeb.167056" target="_top">doi:10.1242/jeb.167056</a>&gt;), and uniformity and multi-sample hypothesis tests (Rayleigh, Watson-Williams, Hermans-Rasson (Landler, Ruxton and Malkemper (2019) &lt;<a href="https://doi.org/10.1186%2Fs12898-019-0246-8" target="_top">doi:10.1186/s12898-019-0246-8</a>&gt;), and others) with multiple-comparison correction. Path tortuosity follows Benhamou (2004) &lt;<a href="https://doi.org/10.1016%2Fj.jtbi.2004.03.016" target="_top">doi:10.1016/j.jtbi.2004.03.016</a>&gt;. Renders publication-quality 'ggplot2' radial plots with overlaid rose diagrams, parametric density curves, non-parametric kernel density estimates, and circular boxplots (Buttarazzi, Pandolfo and Porzio (2018) &lt;<a href="https://doi.org/10.1111%2Fbiom.12889" target="_top">doi:10.1111/biom.12889</a>&gt;). Includes a browser-based 'shiny' graphical interface requiring no R coding via launch_app().
cran.r-project.org
October 27, 2026 at 7:02 PM
New on CRAN: radiatR (0.1.3). View at https://CRAN.R-project.org/package=radiatR
radiatR: Analyse and Visualise Headings and Trajectories on the Unit Disk
A complete pipeline for analysing directional data &ndash; headings and trajectories on the unit disk. Supply a table of angles directly, or reconstruct headings from movement trajectories imported from tracking tools ('EthoVision', 'DeepLabCut', 'SLEAP', 'TRex', 'ANY-maze', 'TrackMate', 'idtracker.ai', and others) via a unified dialect-based loader system, including multi-bodypart pose estimation with likelihood-weighted centroid. Derives per-trial heading directions using multiple rules (ring-crossing, distal point, pose body-axis, velocity-based, and more). Computes circular statistics including mean direction, resultant length, von Mises and wrapped Cauchy parametric fits, circular correlation (circular-linear and circular-circular), circular-linear regression (Fisher and Lee (1992) &lt;<a href="https://doi.org/10.2307%2F2532334" target="_top">doi:10.2307/2532334</a>&gt;), model selection among orientation models (Fitak and Johnsen (2017) &lt;<a href="https://doi.org/10.1242%2Fjeb.167056" target="_top">doi:10.1242/jeb.167056</a>&gt;), and uniformity and multi-sample hypothesis tests (Rayleigh, Watson-Williams, Hermans-Rasson (Landler, Ruxton and Malkemper (2019) &lt;<a href="https://doi.org/10.1186%2Fs12898-019-0246-8" target="_top">doi:10.1186/s12898-019-0246-8</a>&gt;), and others) with multiple-comparison correction. Path tortuosity follows Benhamou (2004) &lt;<a href="https://doi.org/10.1016%2Fj.jtbi.2004.03.016" target="_top">doi:10.1016/j.jtbi.2004.03.016</a>&gt;. Renders publication-quality 'ggplot2' radial plots with overlaid rose diagrams, parametric density curves, non-parametric kernel density estimates, and circular boxplots (Buttarazzi, Pandolfo and Porzio (2018) &lt;<a href="https://doi.org/10.1111%2Fbiom.12889" target="_top">doi:10.1111/biom.12889</a>&gt;). Includes a browser-based 'shiny' graphical interface requiring no R coding via launch_app().
CRAN.R-project.org
October 27, 2026 at 9:07 PM
The absolute joy when you check some numbers in your pipeline on a vague hunch and gut feeling, just to discover that a fraction of data got excluded at the very beginning. 😑😑😑

Time to fix the pipeline.
Luckily we have a good chunk of #hpc wall time left to rerun our #DeepLabCut models.
October 22, 2026 at 12:05 PM
So how do you watch a search you cannot see? Above the skin, we used high-speed videography and trained DeepLabCut to track her front legs, her mouthparts and her maxillary palps, frame by frame. 6/18
October 21, 2026 at 9:31 PM
Evaluation and primer for using DeepLabCut to track small animals in large spaces bioRxivpreprint
Evaluation and primer for using DeepLabCut to track small animals in large spaces
DeepLabCut (DLC), a machine learning-based pose estimation tool, has dramatically increased the throughput of behavioral tracking. Yet its implication remains limited by lack of validation data from diverse scenarios and users' unfamiliarity with the machine learning workflow. Here, we provide a practical primer on DLC terminology and workflow and performance evaluation of DLC in a novel scenario where the target is much smaller than those in previous validation data. We assessed model performance in a total of 36 model configurations across three training proportions, six training iterations, and two recording resolutions. Performance was evaluated on training convergence, prediction error, prediction certainty, and generalizability. Additionally, we selected an optimal model based on a balance between model performance and training time and applied it to 20 recordings at each resolution. In the test frames, 15 and 6 out of 18 model configurations met all performance criteria under high- and low-resolution, respectively. Of these, DLC was able to achieve low prediction error, high prediction confidence, and low train-test loss. Prediction error and confidence varied with training proportion, iteration, and resolution. Inference using the optimal models achieved similar high confidence predictions, with low-likelihood predictions predominantly associated with visual obstruction, low light, and reduced contrast between the subject and the background. Notably, the optimal models for high- and low-resolutions performed similarly despite a multi-fold difference in the cost of the recording devices, providing validation data for DLC in low-budget research, teaching and outreach scenarios.
dlvr.it
October 20, 2026 at 11:00 PM
Evaluation and primer for using DeepLabCut to track small animals in large spaces bioRxivpreprint
Evaluation and primer for using DeepLabCut to track small animals in large spaces
DeepLabCut (DLC), a machine learning-based pose estimation tool, has dramatically increased the throughput of behavioral tracking. Yet its implication remains limited by lack of validation data from diverse scenarios and users' unfamiliarity with the machine learning workflow. Here, we provide a practical primer on DLC terminology and workflow and performance evaluation of DLC in a novel scenario where the target is much smaller than those in previous validation data. We assessed model performance in a total of 36 model configurations across three training proportions, six training iterations, and two recording resolutions. Performance was evaluated on training convergence, prediction error, prediction certainty, and generalizability. Additionally, we selected an optimal model based on a balance between model performance and training time and applied it to 20 recordings at each resolution. In the test frames, 15 and 6 out of 18 model configurations met all performance criteria under high- and low-resolution, respectively. Of these, DLC was able to achieve low prediction error, high prediction confidence, and low train-test loss. Prediction error and confidence varied with training proportion, iteration, and resolution. Inference using the optimal models achieved similar high confidence predictions, with low-likelihood predictions predominantly associated with visual obstruction, low light, and reduced contrast between the subject and the background. Notably, the optimal models for high- and low-resolutions performed similarly despite a multi-fold difference in the cost of the recording devices, providing validation data for DLC in low-budget research, teaching and outreach scenarios.
dlvr.it
October 19, 2026 at 4:00 PM
Evaluation and primer for using DeepLabCut to track small animals in large spaces https://www.biorxiv.org/content/10.64898/2026.10.15.759451v1
October 16, 2026 at 12:45 PM
Evaluation and primer for using DeepLabCut to track small animals in large spaces https://www.biorxiv.org/content/10.64898/2026.10.15.759451v1
October 16, 2026 at 12:45 PM
🇫🇷 Cette étude évalue et propose un guide pratique pour l'utilisation de DeepLabCut afin de suivre de petits animaux dans de grands espaces, en validant les performances du outil dans des scénarios de recherche à faible budget. Elle se concentre sur les capacités de suivi comportementa...
October 16, 2026 at 4:50 PM
A promptable foundation model enables automated multi-task dataset construction and real-time pose estimation in #mice bioRxivpreprint
A promptable foundation model enables automated multi-task dataset construction and real-time pose estimation in #mice
Behavioural experiments often hinge on moments when animals crowd together. In these situations, existing pose-estimation methods usually fail because detected crops include neighbouring animals, and their body parts are easily confused between individuals. We solved it with DeepLabSAM, a pipeline that segments and tracks every animal from a single text prompt using the SAM 3 foundation model, followed by a mask-gated pretrained pose estimation network from DeepLabCut. Across recordings of multiple interacting mice, the proposed method substantially reduces misassigned keypoints under heavy occlusion. Furthermore, we used DeepLabSAM to automatically construct the Multi-Task Mouse Behaviour (MTMB) dataset, comprising 14,300 frames spanning nine behavioural assays, with each instance annotated for bounding box, mask, identity, and pose. SuperAnimal pretrained pose models transferred unpredictably across this dataset. Conversely, MouseLite, our RF-DETR pose-estimation model trained on the MTMB dataset, matched their in-distribution accuracy, generalized better to unseen assays, and achieved real-time (faster-than-acquisition) inference. Combined, DeepLabSAM, MTMB dataset, and MouseLite provide a scalable framework for robust, cross-assay behavioural pose tracking of freely interacting mice.
dlvr.it
October 12, 2026 at 6:42 PM
A promptable foundation model enables automated multi-task dataset construction and real-time pose estimation in #mice bioRxivpreprint
A promptable foundation model enables automated multi-task dataset construction and real-time pose estimation in #mice
Behavioural experiments often hinge on moments when animals crowd together. In these situations, existing pose-estimation methods usually fail because detected crops include neighbouring animals, and their body parts are easily confused between individuals. We solved it with DeepLabSAM, a pipeline that segments and tracks every animal from a single text prompt using the SAM 3 foundation model, followed by a mask-gated pretrained pose estimation network from DeepLabCut. Across recordings of multiple interacting mice, the proposed method substantially reduces misassigned keypoints under heavy occlusion. Furthermore, we used DeepLabSAM to automatically construct the Multi-Task Mouse Behaviour (MTMB) dataset, comprising 14,300 frames spanning nine behavioural assays, with each instance annotated for bounding box, mask, identity, and pose. SuperAnimal pretrained pose models transferred unpredictably across this dataset. Conversely, MouseLite, our RF-DETR pose-estimation model trained on the MTMB dataset, matched their in-distribution accuracy, generalized better to unseen assays, and achieved real-time (faster-than-acquisition) inference. Combined, DeepLabSAM, MTMB dataset, and MouseLite provide a scalable framework for robust, cross-assay behavioural pose tracking of freely interacting mice.
dlvr.it
October 11, 2026 at 11:41 AM
Suzanne C Mills, Ricardo Beldade, Julie Lafaye, David Lecchini, Manuel Vidal: A fully immersive Virtual Reality setup using DeepLabCut reveals species-specific behavioural responses of freely moving coral reef fishes to conspecifics and... https://hal.science/hal-05761670v1 [sde.be]
October 5, 2026 at 3:00 AM
#eNeuro | Automated Behavioral Tracking of Zebrafish Larvae with DeepLabCut and SLEAP: Pretrained Networks and Datasets of Annotated Poses
https://doi.org/10.1523/ENEURO.0071-26.2026
Automated Behavioral Tracking of Zebrafish Larvae with DeepLabCut and SLEAP: Pretrained Networks and Datasets of Annotated Poses
Zebrafish are an important model system in behavioral neuroscience due to their rapid development and suite of distinct, innate behaviors. In this study, we tracked the behavior of 6 d postfertilization larval zebrafish (of indeterminate sex, as larvae at this developmental stage are sexually undifferentiated). Quantifying many of these larval behaviors requires detailed tracking of eye and tail kinematics, which in turn demands imaging at high spatial and temporal resolution, ideally using semi- or fully automated tracking methods for throughput efficiency. However, creating and validating accurate tracking models is time-consuming and labor-intensive, with many research groups duplicating efforts on similar images. With the goal of developing a useful community resource, we trained pose estimation models using a diverse array of video parameters and a 15-keypoint pose model. We deliver an annotated dataset of free-swimming and head-embedded behavioral videos of larval zebrafish, along with four pose estimation networks from DeepLabCut and SLEAP (two variants of each). We also evaluated model performance across varying imaging conditions to guide users in optimizing their imaging setups. This resource will allow other researchers to skip the tedious and laborious training steps for setting up behavioral analyses, guide model selection for specific research needs, and provide ground-truth data for benchmarking new tracking methods.
doi.org
October 4, 2026 at 6:31 PM
Automated pup-level analysis reveals distinct effects of prenatal CBD and THC exposure on maternal retrieval bioRxivpreprint
Automated pup-level analysis reveals distinct effects of prenatal CBD and THC exposure on maternal retrieval
This study examined how prenatal CBD and {Delta}9-tetrahydrocannabinol (THC) exposure affects maternal caregiving in C57BL/6J mice. We developed the Machine-Automated Scoring of the Pup Retrieval Test (MAS-PRT) to overcome limitations of manual behavioral scoring. MAS-PRT integrates Multi-Animal DeepLabCut for dam and pup tracking with Detectron2 for dynamic nest reconstruction. Validated against 170 manually annotated retrieval trials, the pipeline showed high concordance with manual measurements and enabled reproducible extraction of encounter latency, retrieval latency, and locomotor trajectories. Prenatal exposure did not impair general nest-building or overall home-cage maternal care. However, pups from both CBD and THC groups showed reduced body weight at postnatal day 5. Cox proportional hazards modeling revealed divergent effects by compound: CBD-exposed dams exhibited a weight-dependent increase in probability of encountering and retrieving lighter pups, independent of pup sex. Spatial tracking further showed that dams traversed significantly shorter total trajectories when retrieving female progeny exposed to either compound. Longitudinal trial-by-trial analysis indicated intact task acquisition in controls and CBD dams, whereas THC dams displayed a flattened learning curve driven by lower retrieval latencies on initial trials. Together, these findings indicate that prenatal cannabinoid exposure does not produce generalized disruption of maternal care but instead induces compound-specific alterations in maternal reactivity, retrieval kinematics, and learning dynamics.
dlvr.it
October 1, 2026 at 6:53 PM
Tech Tuesday: How can AI help scientists track crayfish behavior? 🤖🦞

Researchers are using cameras and a thermal-gradient system to study how Signal & Ringed Crayfish move and interact.

PhD student Abdullah Alkinani & the Arismendi Lab are using DeepLabCut to track crayfish movement from video. 📹
September 29, 2026 at 6:35 PM
Automated pup-level analysis reveals distinct effects of prenatal CBD and THC exposure on maternal retrieval bioRxivpreprint
Automated pup-level analysis reveals distinct effects of prenatal CBD and THC exposure on maternal retrieval
This study examined how prenatal CBD and {Delta}9-tetrahydrocannabinol (THC) exposure affects maternal caregiving in C57BL/6J mice. We developed the Machine-Automated Scoring of the Pup Retrieval Test (MAS-PRT) to overcome limitations of manual behavioral scoring. MAS-PRT integrates Multi-Animal DeepLabCut for dam and pup tracking with Detectron2 for dynamic nest reconstruction. Validated against 170 manually annotated retrieval trials, the pipeline showed high concordance with manual measurements and enabled reproducible extraction of encounter latency, retrieval latency, and locomotor trajectories. Prenatal exposure did not impair general nest-building or overall home-cage maternal care. However, pups from both CBD and THC groups showed reduced body weight at postnatal day 5. Cox proportional hazards modeling revealed divergent effects by compound: CBD-exposed dams exhibited a weight-dependent increase in probability of encountering and retrieving lighter pups, independent of pup sex. Spatial tracking further showed that dams traversed significantly shorter total trajectories when retrieving female progeny exposed to either compound. Longitudinal trial-by-trial analysis indicated intact task acquisition in controls and CBD dams, whereas THC dams displayed a flattened learning curve driven by lower retrieval latencies on initial trials. Together, these findings indicate that prenatal cannabinoid exposure does not produce generalized disruption of maternal care but instead induces compound-specific alterations in maternal reactivity, retrieval kinematics, and learning dynamics.
dlvr.it
September 30, 2026 at 11:53 AM
AI now objectively spots when fish get stressed by heat—detecting loss of balance with 90%+ accuracy using DeepLabCut & ResNet34. Key for climate change impact studies. 🐠 #conservation

Source: https://phys.org/news/2026-09-ai-fish-thermal-limit.html
September 16, 2026 at 10:34 PM
…but have we looked into how many of the people who contributed to deeplabcut watched ice princess in their formative years?
September 9, 2026 at 1:50 AM
Two doc PRs merged today: DeepLabCut (dead Model Zoo link) and bioacoustics-model-zoo (six README fixes — examples that crashed on copy-paste, a wrong Python-version claim). That's 8 verified contributions to wildlife-tech tools since late August. Verify, file small, respect maintainer policies.
September 8, 2026 at 5:02 PM
Our dear @mguidotti29.bsky.social presenting his fab work on how to infer bird orientation behaviour from videos using DeepLabCut at #ECBB2026 💪
#ECBB2026 still in Sensory landscapes in the Anthropocene and we hear all about electrosmog on orientation behaviour and migratory restlessness in songbirds from Matteo Guidotti!
September 2, 2026 at 11:38 AM
Wow, I just realized that for my current #machinelearning #computervision #DeepLabCut project I have manually placed over 100.000 labels.

Of course the model is still terrible, so it feels a bit like a lot of time wasted.

#academicchatter #postdoclife #phdlife
August 28, 2026 at 9:13 AM
謎ブレイクスルー以前は、1ヶ月トライして1回しか成功しなかった造網が、以後は1週間で3回成功ですよ。もっと早く気づいておけばよかった……

しかし今日もハエトリグモが映り込んだ。deeplabcutは案の定誤認識連発で、ラベリングをもっと強化しなきゃならないことがわかった。これ、面倒だなあ。
造網枠の向きを窓と平行にするという謎のブレイクスルーのおかげで今日も造網行動の撮影に成功したわけだが、今日はケースの壁面をハエトリグモが網を張るクモを追っかけて動き回ってたのね。でもUMATrackerは見事に2個体を分離してトラッキングしてくれた。エライなー。今回してるdeeplabcutがどうかは明日のお楽しみ。
August 22, 2026 at 1:45 AM
Day 1 of the TEATIME Training School kicked off with inspiring talks on experimental design, home-cage monitoring, and DeepLabCut, alongside expert meetups and student presentations—highlighting the power of science, networking, and collaboration.

#animalresearch #training #homecage #welfare
June 19, 2025 at 4:58 AM
Also in Bratislava, @neurodaniela.bsky.social will teach how to use DeepLabCut’s deep learning tools for accurate, automated animal pose estimation and behavioral analysis through its user-friendly GUI.

#DeepLabCut #BehavioralResearch #MachineLearning #Neuroscience #OpenScience
June 9, 2025 at 8:30 AM