#SCIResearch
SciResearch-Eval: Evaluating Scientific Judgment in Autonomous Experimental Agents

Brian T. Weston, Alondra Torres Contreras, Aldair E. Gongora

#arXiv #cs.AI #cs.LG #physics.comp-ph
SciResearch-Eval: Evaluating Scientific Judgment in Autonomous Experimental Agents
We introduce SciResearch-Eval, an interactive benchmark of scientific judgment built on a standard laboratory problem: measuring a material's thermal properties by heating it and fitting a heat-conduction simulator. An agent designs its own experiments, uses a supplied simulator that may be under-r…
arxiv.org
November 17, 2026 at 8:11 PM
The abstract reports that Astra and Fable choose experiments where the flawed simulator is still accurate, for example gentle heating. I trust that pattern in production: agents get safer when they keep their tools inside a valid operating range. #SystemsLiteracy #AIAgents
SciResearch-Eval: Evaluating Scientific Judgment in Autonomous Experimental Agents
We introduce SciResearch-Eval, an interactive benchmark of scientific judgment built on a standard laboratory problem: measuring a material's thermal properties by heating it and fitting a heat-conduction simulator. An agent designs its own experiments, uses a supplied simulator that may be under-resolved or physically wrong, and reports each property with a 95% interval. To our knowledge it is the first benchmark to combine agent-designed experiments, a deliberately flawed simulator, and proper scoring of calibrated intervals against exact ground truth. On a held-out split (93 tasks, 9 models, 2,511 episodes), models handle procedural traps. When the simulator is missing physics, most report wrong values while stating they are 95% sure: their ranges contain the truth in 20-62% of cases, against 94% for GPT-6 Astra and 99% for Claude Fable 5.2. At default effort the failing Claude 5.5 models rarely diagnose the missing physics (Opus in 35% of episodes, against 66% for Astra), and even when they do, their ranges often miss; Astra and Fable design experiments in which the flawed simulator is accurate, such as gentle heating, which keeps Astra calibrated even when it does not name the cause. Asking for wider intervals does not help; stating the strategy improves interval scores 1.6-2.5-fold, replicated on a pre-registered fresh split, but coverage barely moves. A pre-registered effort ablation shows that the correction is latent in the Claude 5.5 models: at maximum effort Opus improves more than tenfold and is no longer detectably behind Astra at default, but only with 13-31 times more reasoning; older and open-weight models gain nothing. Fable 5.2 is the most accurate model at default effort (interval score 1.9 times better than Astra's) but writes 6 times as many tokens, and at Astra's token count it falls short. We release the environment, graders and harness.
arxiv.org
November 21, 2026 at 11:05 PM
Congratulations to Dr. Shane Balthazaar on an Early Career Scholar Award at #ISCoS2026! His presentation on the Praxis-funded MACHINE Study examined cardiovascular and autonomic responses to spinal cord stimulation and treadmill training in people with SCI. #ICORD #SCIResearch
October 20, 2026 at 1:01 PM
Praxis extends our congratulations to the Integrated Knowledge Translation (IKT) Guiding Principles Partnership team on this outstanding achievement!

Read the paper - www.archives-pmr.org/article/S000...

#Praxis #SCIResearch #IKT #RehabilitationResearch #Collaboration
May 1, 2026 at 6:00 PM
📢 Keynote Speaker Announcement! 📢

We are thrilled to welcome Professor Charles H. Hubscher as a keynote speaker at AIM-SCI 2025!

🗓 Join us on October 15, 2025, in Ponta Delgada, Azores, for an insightful presentation on his research!

#AIMSCI2025 #SCIResearch #KeynoteSpeaker #SpinalCordInjury
April 4, 2025 at 2:16 PM
Our logo isn’t just a design — it embodies the very essence of our meeting! 💙💚

#AIMSCI2025 #SpinalCordInjury #SCI #SCIMeeting #SCIConference #SCIResearch #MedicalConference #Neuroscience #Azores #Portugal
March 20, 2025 at 2:18 PM
Echoing much of the sentiments of researchers, besides that I am gobsmacked by the universe, I really would like to say, "thank you", to all of those in SciResearch for peeling back layers of extraordinary matters. Incredibly appreciative that we have this system and are able to become informed!
March 20, 2025 at 3:21 PM
SCI | Wheelchair Maintenance
Knowledge, capacity & frequency of maintenance practices examined in new PM&R study.

Read the full article: https://www.archives-pmr.org/article/S0003-9993(26)00081-X/fulltext

#SpinalCordInjury #WheelchairMobility #SCIResearch #AssistiveTechnology #PMR #ACRM
February 19, 2026 at 8:23 PM
SCI | Wheelchair Maintenance
Knowledge, capacity & frequency of maintenance practices examined in new PM&R study.

Read the full article: https://www.archives-pmr.org/article/S0003-9993(26)00081-X/fulltext

#SpinalCordInjury #WheelchairMobility #SCIResearch #AssistiveTechnology #PMR #ACRM
February 16, 2026 at 8:22 PM
Tell the FDA what your priorities are - register (it’s free) for the SCI Patient-Focused Drug Development virtual meeting, happening September 29!

Link: www.scipfdd.org/register

#scirecovery #scifunding #scicommunity #sciresearch #scirehabilitation
August 20, 2026 at 9:37 PM
Wanna talk to the FDA? Check out our conversation with Ian Burkhart about a ‘once in a generation’ opportunity to meet with regulators and share your lived experience priorities.

Link to full episode: u2fp.org/get-educated...

#spinalcordinjury #spinalcordresearch #sciresearch
August 14, 2026 at 9:19 PM
Help us guide sci drug development at FDA...sign up for an informational webinar this Wed Aug 5 to learn more.

Link: www.scipfdd.org/webinar

#sciresearch #sciawareness #scirecovery #scirehabilitation #sciadvocacy
August 4, 2026 at 6:00 PM
A new study out from Samuel Stupp got the Headline Patrol treatment by U2FP’s Sam Maddox.

Link for full article: u2fp.org/get-educated...

#sci #sciresearch #scirecovery #scitreatments #scirehabilitation
March 20, 2026 at 7:39 PM
U2FP’s 20th Annual Science & Advocacy Symposium. Register now to join us on February 15-17 in Washington, D.C.!

Link to register: secure.qgiv.com/for/2026annu...

#symposium #sci #sciresearch #scirecovery #scirehabilitation
January 22, 2026 at 1:42 AM
ARRCT | Open Access
Does screening location affect depression scores in people with spinal cord injury?

Read the full Open Access article: https://www.archives-rrct.org/article/S2590-1095(26)00009-1/fulltext

#ARRCT #OpenAccess #SpinalCordInjury #DepressionScreening #SCIResearch #Research #ACRM
March 15, 2026 at 7:13 PM
ARRCT | Open Access
Does screening location affect depression scores in people with spinal cord injury?

Read the full Open Access article: https://www.archives-rrct.org/article/S2590-1095(26)00009-1/fulltext

#ARRCT #OpenAccess #SpinalCordInjury #DepressionScreening #SCIResearch #Research #ACRM
March 9, 2026 at 7:13 PM
🎉 Congratulations to Lexi Soltesz, PhD student at Wayne State University, for receiving the 2025 Anthony F. DiMarco MD Award from @ASIA_Neurosci! Wayne State University Eugene Applebaum College of Pharmacy & Health Sciences 👏 #Neuroscience #SCIResearch
February 11, 2025 at 8:49 PM
Excited to begin the next chapter with PTRS & @um-mind.bsky.social in @ummedschool.bsky.social at @umbaltimore.bsky.social! Looking forward to new collaborations, discoveries, & advancing science in neurotrauma & SCI recovery. Hiring all levels soon! Let’s get to work! #Neuroscience #SCIResearch
January 31, 2025 at 3:08 PM
Got research, clinical innovation, or a service improvement project in SCI?
Bring it to ISCoS 2026 (Kuala Lumpur | 7–10 Oct 2026).

Submit by 10 March 2026: iscosmeetings2026.org/abstract-sub...

#SCIResearch #Neurorehabilitation
February 26, 2026 at 1:00 PM
ISCoS 2026 abstract submissions are open (Kuala Lumpur).
Welcoming work across the SCI continuum — clinical care, rehabilitation, research and innovation.
Abstract Submission Guidelines + submit: iscosmeetings2026.org/abstract-sub...

#ISCoS2026 #SpinalCordInjury #SCIResearch
February 3, 2026 at 6:20 PM
One Week Left – Abstract Submission Deadline: 17 March 2025

📅 8-11 October 2025
📍 Gothenburg, Sweden

Don’t miss the chance to present at this leading event in spinal cord care. Submit your abstract today!

Full guidelines and submission: iscosmeetings2025.org/iscos-2025-a...

#SCIResearch
March 10, 2025 at 10:36 AM
For decades, scientists called spinal cord injury (SCI) the “graveyard of neurobiology,” a field where progress was slow and recovery out of reach. Today, that narrative is changing.

#SCIResearch
Progress In Research Winter 2026 - Christopher & Dana Reeve Foundation
For decades, scientists called spinal cord injury (SCI) the “graveyard of neurobiology,” a field where progress was slow and recovery out of reach. Today, that narrative is changing. Across labs, clin...
www.christopherreeve.org
January 29, 2026 at 10:04 PM