Onno Eberhard
@onnoeberhard.com
PhD Student in Tübingen (MPI-IS & Uni Tü), interested in reinforcement learning. Wir müssen wissen. Wir werden wissen. https://onnoeberhard.com/
Reposted by Onno Eberhard
Explaining a poster with both hands, which is how you know the result matters.
August 8, 2026 at 9:28 AM
Explaining a poster with both hands, which is how you know the result matters.
Come see our poster tomorrow morning (#4307 in Hall A)! Paper, code, and more can be found at onnoeberhard.com/q-commit. Joint work with @claireve.bsky.social and Michael Muhelebach.
July 7, 2026 at 10:27 AM
Come see our poster tomorrow morning (#4307 in Hall A)! Paper, code, and more can be found at onnoeberhard.com/q-commit. Joint work with @claireve.bsky.social and Michael Muhelebach.
I am in Seoul at ICML to present our newest paper "Commit to the Bit: Reactive Reinforcement Learning Done Right". We show that finding reactive policies in POMDPs is easier than previously thought and that the ubiquitous 𝑞⋆-realizability assumption is stronger than necessary. 🧵
July 6, 2026 at 7:50 AM
I am in Seoul at ICML to present our newest paper "Commit to the Bit: Reactive Reinforcement Learning Done Right". We show that finding reactive policies in POMDPs is easier than previously thought and that the ubiquitous 𝑞⋆-realizability assumption is stronger than necessary. 🧵
Reposted by Onno Eberhard
Excited that our paper is finally out in @natneuro.nature.com 🎉
Huge thanks to all my co-authors, especially @jonasterlau.bsky.social & @randolph-helfrich.bsky.social for the support and great teamwork 🍀
Huge thanks to all my co-authors, especially @jonasterlau.bsky.social & @randolph-helfrich.bsky.social for the support and great teamwork 🍀
Very excited to share our latest paper led by @nbinish.bsky.social in @natneuro.nature.com
We demonstrate how a communication subspace channels higher-dimensional PFC dynamics into lower-D motor activity to enable efficient behavior using human iEEG.
www.nature.com/articles/s41...
#neuroskyence
We demonstrate how a communication subspace channels higher-dimensional PFC dynamics into lower-D motor activity to enable efficient behavior using human iEEG.
www.nature.com/articles/s41...
#neuroskyence
A communication subspace relays context-dependent actions from human prefrontal to motor cortex - Nature Neuroscience
Context-dependent behavior selects actions according to task demands. Using direct brain recordings in humans, Binish et al. uncover how coordinated population activity efficiently channels informatio...
www.nature.com
May 4, 2026 at 3:13 PM
Excited that our paper is finally out in @natneuro.nature.com 🎉
Huge thanks to all my co-authors, especially @jonasterlau.bsky.social & @randolph-helfrich.bsky.social for the support and great teamwork 🍀
Huge thanks to all my co-authors, especially @jonasterlau.bsky.social & @randolph-helfrich.bsky.social for the support and great teamwork 🍀
Reposted by Onno Eberhard
Very excited to share our latest paper led by @nbinish.bsky.social in @natneuro.nature.com
We demonstrate how a communication subspace channels higher-dimensional PFC dynamics into lower-D motor activity to enable efficient behavior using human iEEG.
www.nature.com/articles/s41...
#neuroskyence
We demonstrate how a communication subspace channels higher-dimensional PFC dynamics into lower-D motor activity to enable efficient behavior using human iEEG.
www.nature.com/articles/s41...
#neuroskyence
A communication subspace relays context-dependent actions from human prefrontal to motor cortex - Nature Neuroscience
Context-dependent behavior selects actions according to task demands. Using direct brain recordings in humans, Binish et al. uncover how coordinated population activity efficiently channels informatio...
www.nature.com
May 4, 2026 at 2:30 PM
Very excited to share our latest paper led by @nbinish.bsky.social in @natneuro.nature.com
We demonstrate how a communication subspace channels higher-dimensional PFC dynamics into lower-D motor activity to enable efficient behavior using human iEEG.
www.nature.com/articles/s41...
#neuroskyence
We demonstrate how a communication subspace channels higher-dimensional PFC dynamics into lower-D motor activity to enable efficient behavior using human iEEG.
www.nature.com/articles/s41...
#neuroskyence
Reposted by Onno Eberhard
The deadline for all SIGBOVIK 2026 papers has officially been extended to March 18! Enjoy the extra procrastination time, and maybe consider starting to write your papers!
March 3, 2026 at 3:23 PM
The deadline for all SIGBOVIK 2026 papers has officially been extended to March 18! Enjoy the extra procrastination time, and maybe consider starting to write your papers!
Reposted by Onno Eberhard
Exciting workshop for RL enthusiasts in Mannheim! 👇
Workshop on Reinforcement Learning 2026, taking place on 𝐅𝐞𝐛𝐫𝐮𝐚𝐫𝐲 𝟔, 𝟐𝟎𝟐𝟔, at the 𝐔𝐧𝐢𝐯𝐞𝐫𝐬𝐢𝐭𝐲 𝐨𝐟 𝐌𝐚𝐧𝐧𝐡𝐞𝐢𝐦, Germany.
Participation in the workshop is 𝐟𝐫𝐞𝐞 𝐨𝐟 𝐜𝐡𝐚𝐫𝐠𝐞!
Check the program and register: www.wim.uni-mannheim.de/doering/conf...
Workshop on Reinforcement Learning 2026, taking place on 𝐅𝐞𝐛𝐫𝐮𝐚𝐫𝐲 𝟔, 𝟐𝟎𝟐𝟔, at the 𝐔𝐧𝐢𝐯𝐞𝐫𝐬𝐢𝐭𝐲 𝐨𝐟 𝐌𝐚𝐧𝐧𝐡𝐞𝐢𝐦, Germany.
Participation in the workshop is 𝐟𝐫𝐞𝐞 𝐨𝐟 𝐜𝐡𝐚𝐫𝐠𝐞!
Check the program and register: www.wim.uni-mannheim.de/doering/conf...
November 25, 2025 at 1:51 PM
Exciting workshop for RL enthusiasts in Mannheim! 👇
Workshop on Reinforcement Learning 2026, taking place on 𝐅𝐞𝐛𝐫𝐮𝐚𝐫𝐲 𝟔, 𝟐𝟎𝟐𝟔, at the 𝐔𝐧𝐢𝐯𝐞𝐫𝐬𝐢𝐭𝐲 𝐨𝐟 𝐌𝐚𝐧𝐧𝐡𝐞𝐢𝐦, Germany.
Participation in the workshop is 𝐟𝐫𝐞𝐞 𝐨𝐟 𝐜𝐡𝐚𝐫𝐠𝐞!
Check the program and register: www.wim.uni-mannheim.de/doering/conf...
Workshop on Reinforcement Learning 2026, taking place on 𝐅𝐞𝐛𝐫𝐮𝐚𝐫𝐲 𝟔, 𝟐𝟎𝟐𝟔, at the 𝐔𝐧𝐢𝐯𝐞𝐫𝐬𝐢𝐭𝐲 𝐨𝐟 𝐌𝐚𝐧𝐧𝐡𝐞𝐢𝐦, Germany.
Participation in the workshop is 𝐟𝐫𝐞𝐞 𝐨𝐟 𝐜𝐡𝐚𝐫𝐠𝐞!
Check the program and register: www.wim.uni-mannheim.de/doering/conf...
Reposted by Onno Eberhard
Nicolo Cesa-Bianchi and Matteo Papini are putting together a great unconference workshop at the @ellis.eu day at @euripsconf.bsky.social
If you want to talk about RL, causality, bandits, online learning, join us there on December 2nd
sites.google.com/view/ilir-wo...
If you want to talk about RL, causality, bandits, online learning, join us there on December 2nd
sites.google.com/view/ilir-wo...
ILIR Workshop, Dec 2, 2025
This workshop covers current research topics in reinforcement learning and causality, and in particular questions at the interface of these research areas. Of particular interest this year are also qu...
sites.google.com
October 16, 2025 at 10:04 PM
Nicolo Cesa-Bianchi and Matteo Papini are putting together a great unconference workshop at the @ellis.eu day at @euripsconf.bsky.social
If you want to talk about RL, causality, bandits, online learning, join us there on December 2nd
sites.google.com/view/ilir-wo...
If you want to talk about RL, causality, bandits, online learning, join us there on December 2nd
sites.google.com/view/ilir-wo...
Reposted by Onno Eberhard
I had such a great time helping organize EWRL 2025 with an amazing team 🎉
Loved being part of it and meeting so many passionate reinforcement learning enthusiasts!
@ewrl18.bsky.social
Loved being part of it and meeting so many passionate reinforcement learning enthusiasts!
@ewrl18.bsky.social
September 22, 2025 at 3:21 PM
I had such a great time helping organize EWRL 2025 with an amazing team 🎉
Loved being part of it and meeting so many passionate reinforcement learning enthusiasts!
@ewrl18.bsky.social
Loved being part of it and meeting so many passionate reinforcement learning enthusiasts!
@ewrl18.bsky.social
Reposted by Onno Eberhard
Truly chuffed for our fearless food physicists @mpipks.bsky.social + collabs from AT @istaresearch.bsky.social, IT & ES who won this year’s Ig Nobel - the #NobelPrize of hearts❤️for cracking the science of perfect pasta !🍝Kudos to all for intrepidly consuming lots of cheese in the name of science!😋
The Secret to a Smooth Pasta Sauce Wins Ig Nobel Prize
Italian researchers studied how the ingredients of the traditional Roman dish cacio e pepe emulsify into a creamy sauce, winning the 2025 Physics Ig Nobel Prize.
www.the-scientist.com
September 19, 2025 at 12:40 PM
Truly chuffed for our fearless food physicists @mpipks.bsky.social + collabs from AT @istaresearch.bsky.social, IT & ES who won this year’s Ig Nobel - the #NobelPrize of hearts❤️for cracking the science of perfect pasta !🍝Kudos to all for intrepidly consuming lots of cheese in the name of science!😋
I wrote a short post on our newest ICML paper addressed at people who are not experts in machine learning. Check it out!
In our latest blog post, @onnoeberhard.com writes about work presented at #ICML2025 on partially observable reinforcement learning which introduces an alternative memory framework - “memory traces”.
aihub.org/2025/09/12/m...
aihub.org/2025/09/12/m...
Memory traces in reinforcement learning - ΑΙhub
aihub.org
September 12, 2025 at 3:19 PM
I wrote a short post on our newest ICML paper addressed at people who are not experts in machine learning. Check it out!
A cute little animation: a critically damped harmonic oscillator becomes unstable with integral control if the gain is too high. Here, at K_i = 2, a Hopf bifurcation occurs: two poles of the transfer function enter the right-hand s-plane and the closed-loop system becomes unstable.
September 9, 2025 at 2:34 PM
A cute little animation: a critically damped harmonic oscillator becomes unstable with integral control if the gain is too high. Here, at K_i = 2, a Hopf bifurcation occurs: two poles of the transfer function enter the right-hand s-plane and the closed-loop system becomes unstable.
Reposted by Onno Eberhard
📣Registration for EWRL is now open📣
Register now 👇 and join us in Tübingen for 3 days (17th-19th September) full of inspiring talks, posters and many social activities to push the boundaries of the RL community!
Register now 👇 and join us in Tübingen for 3 days (17th-19th September) full of inspiring talks, posters and many social activities to push the boundaries of the RL community!
PheedLoop
PheedLoop: Hybrid, In-Person & Virtual Event Software
site.pheedloop.com
August 13, 2025 at 5:02 PM
📣Registration for EWRL is now open📣
Register now 👇 and join us in Tübingen for 3 days (17th-19th September) full of inspiring talks, posters and many social activities to push the boundaries of the RL community!
Register now 👇 and join us in Tübingen for 3 days (17th-19th September) full of inspiring talks, posters and many social activities to push the boundaries of the RL community!
Reposted by Onno Eberhard
I am going to present the poster during the next poster session. 11am Wed.
Poster W #707
Poster W #707
✨Introducing SENSEI✨ We bring semantically meaningful exploration to model-based RL using VLMs.
With intrinsic rewards for novel yet useful behaviors, SENSEI showcases strong exploration in MiniHack, Pokémon Red & Robodesk.
Accepted at ICML 2025🎉
Joint work with @cgumbsch.bsky.social
🧵
With intrinsic rewards for novel yet useful behaviors, SENSEI showcases strong exploration in MiniHack, Pokémon Red & Robodesk.
Accepted at ICML 2025🎉
Joint work with @cgumbsch.bsky.social
🧵
July 16, 2025 at 4:00 PM
I am going to present the poster during the next poster session. 11am Wed.
Poster W #707
Poster W #707
Reposted by Onno Eberhard
I really, really like this paper and as an open question, would love to see it tested on more memory benchmarks
I am in Vancouver at ICML, and tomorrow I will present our newest paper "Partially Observable Reinforcement Learning with Memory Traces". We argue that eligibility traces are more effective than sliding windows as a memory mechanism for RL in POMDPs. 🧵
July 16, 2025 at 6:55 AM
I really, really like this paper and as an open question, would love to see it tested on more memory benchmarks
Reposted by Onno Eberhard
Onno and I will be presenting our poster at # W1005 tomorrow (Wed) morning.
He made a great thread about it, come chat with us about POMDP theory :)
He made a great thread about it, come chat with us about POMDP theory :)
I am in Vancouver at ICML, and tomorrow I will present our newest paper "Partially Observable Reinforcement Learning with Memory Traces". We argue that eligibility traces are more effective than sliding windows as a memory mechanism for RL in POMDPs. 🧵
July 16, 2025 at 3:45 AM
Onno and I will be presenting our poster at # W1005 tomorrow (Wed) morning.
He made a great thread about it, come chat with us about POMDP theory :)
He made a great thread about it, come chat with us about POMDP theory :)
I am in Vancouver at ICML, and tomorrow I will present our newest paper "Partially Observable Reinforcement Learning with Memory Traces". We argue that eligibility traces are more effective than sliding windows as a memory mechanism for RL in POMDPs. 🧵
July 16, 2025 at 1:35 AM
I am in Vancouver at ICML, and tomorrow I will present our newest paper "Partially Observable Reinforcement Learning with Memory Traces". We argue that eligibility traces are more effective than sliding windows as a memory mechanism for RL in POMDPs. 🧵
Great talk by @claireve.bsky.social about our joint work on memory traces this morning. Come join me at poster 94 if you want to know more! #RLDM2025
June 13, 2025 at 2:23 PM
Great talk by @claireve.bsky.social about our joint work on memory traces this morning. Come join me at poster 94 if you want to know more! #RLDM2025
Reposted by Onno Eberhard
This is a joint work with @onnoeberhard.com and Michael Mühlebach, and the poster will be presented by Onno tonight at #RLDM, and later in July at @icmlconf.bsky.social
June 13, 2025 at 9:41 AM
This is a joint work with @onnoeberhard.com and Michael Mühlebach, and the poster will be presented by Onno tonight at #RLDM, and later in July at @icmlconf.bsky.social
Reposted by Onno Eberhard
This morning at #RLDM I talked about Memory Traces, a simple representation for POMDPs that’s probably good at remembering old observations.
arxiv.org/abs/2503.15200
arxiv.org/abs/2503.15200
June 13, 2025 at 9:39 AM
This morning at #RLDM I talked about Memory Traces, a simple representation for POMDPs that’s probably good at remembering old observations.
arxiv.org/abs/2503.15200
arxiv.org/abs/2503.15200
Reposted by Onno Eberhard
Our work on Open Loop RL will be presented by @onnoeberhard.com at L4DC this week. He made a very nice summary thread ⬇️
I'm flying to Michigan today to present our new paper "A Pontryagin Perspective on Reinforcement Learning" at L4DC, where it has been nominated for the Best Paper Award! We ask the question: is it possible to learn an open-loop controller via RL? 🧵
June 4, 2025 at 7:23 PM
Our work on Open Loop RL will be presented by @onnoeberhard.com at L4DC this week. He made a very nice summary thread ⬇️
Reposted by Onno Eberhard
Super interesting work, take a look! 👀
I'm flying to Michigan today to present our new paper "A Pontryagin Perspective on Reinforcement Learning" at L4DC, where it has been nominated for the Best Paper Award! We ask the question: is it possible to learn an open-loop controller via RL? 🧵
June 4, 2025 at 8:13 AM
Super interesting work, take a look! 👀
I'm flying to Michigan today to present our new paper "A Pontryagin Perspective on Reinforcement Learning" at L4DC, where it has been nominated for the Best Paper Award! We ask the question: is it possible to learn an open-loop controller via RL? 🧵
June 4, 2025 at 8:06 AM
I'm flying to Michigan today to present our new paper "A Pontryagin Perspective on Reinforcement Learning" at L4DC, where it has been nominated for the Best Paper Award! We ask the question: is it possible to learn an open-loop controller via RL? 🧵
Reposted by Onno Eberhard
🎤 Meet the speakers!
Marcus Hutter (www.hutter1.net) is a Senior Researcher at DeepMind and Honorary Professor at ANU. His research focuses on the information-theoretic foundations of inductive reasoning and reinforcement learning.
⌛Still time to submit your paper or contributed talk proposal!
Marcus Hutter (www.hutter1.net) is a Senior Researcher at DeepMind and Honorary Professor at ANU. His research focuses on the information-theoretic foundations of inductive reasoning and reinforcement learning.
⌛Still time to submit your paper or contributed talk proposal!
May 30, 2025 at 8:24 AM
🎤 Meet the speakers!
Marcus Hutter (www.hutter1.net) is a Senior Researcher at DeepMind and Honorary Professor at ANU. His research focuses on the information-theoretic foundations of inductive reasoning and reinforcement learning.
⌛Still time to submit your paper or contributed talk proposal!
Marcus Hutter (www.hutter1.net) is a Senior Researcher at DeepMind and Honorary Professor at ANU. His research focuses on the information-theoretic foundations of inductive reasoning and reinforcement learning.
⌛Still time to submit your paper or contributed talk proposal!
Reposted by Onno Eberhard
🎤 Meet the speakers!
Peter Dayan (www.mpg.de/12309370/bio...) is Director of the MPI for Biological Cybernetics and a pioneer in neuroscience and AI.
His work focuses on brain decision-making, the role of neuromodulators and neuronal malfunctions in psychiatric diseases .
🕙 Still time to submit!
Peter Dayan (www.mpg.de/12309370/bio...) is Director of the MPI for Biological Cybernetics and a pioneer in neuroscience and AI.
His work focuses on brain decision-making, the role of neuromodulators and neuronal malfunctions in psychiatric diseases .
🕙 Still time to submit!
May 28, 2025 at 10:00 AM
🎤 Meet the speakers!
Peter Dayan (www.mpg.de/12309370/bio...) is Director of the MPI for Biological Cybernetics and a pioneer in neuroscience and AI.
His work focuses on brain decision-making, the role of neuromodulators and neuronal malfunctions in psychiatric diseases .
🕙 Still time to submit!
Peter Dayan (www.mpg.de/12309370/bio...) is Director of the MPI for Biological Cybernetics and a pioneer in neuroscience and AI.
His work focuses on brain decision-making, the role of neuromodulators and neuronal malfunctions in psychiatric diseases .
🕙 Still time to submit!