Lists of the accepted papers for RetroEval are now available on the symposium website: retroeval.github.io/_pages/accep...
Accepted Papers
RetroEval 2026 Aberdeen, United Kingdom, 1-2 June, 2026
retroeval.github.io
May 28, 2026 at 3:06 PM
Lists of the accepted papers for RetroEval are now available on the symposium website: retroeval.github.io/_pages/accep...
At RetroEval 2026 we will have three fantastic keynotes:
• Sina Zarrieß (@clausebielefeld.bsky.social)
• Beatrice Alex @beatricealex.bsky.social (@heriotwattuni.bsky.social)
• Albert Gatt (@utrechtuniversity.bsky.social)
More details on the keynotes: retroeval.github.io/_pages/keyno...
• Sina Zarrieß (@clausebielefeld.bsky.social)
• Beatrice Alex @beatricealex.bsky.social (@heriotwattuni.bsky.social)
• Albert Gatt (@utrechtuniversity.bsky.social)
More details on the keynotes: retroeval.github.io/_pages/keyno...
retroeval.github.io
May 20, 2026 at 12:02 PM
At RetroEval 2026 we will have three fantastic keynotes:
• Sina Zarrieß (@clausebielefeld.bsky.social)
• Beatrice Alex @beatricealex.bsky.social (@heriotwattuni.bsky.social)
• Albert Gatt (@utrechtuniversity.bsky.social)
More details on the keynotes: retroeval.github.io/_pages/keyno...
• Sina Zarrieß (@clausebielefeld.bsky.social)
• Beatrice Alex @beatricealex.bsky.social (@heriotwattuni.bsky.social)
• Albert Gatt (@utrechtuniversity.bsky.social)
More details on the keynotes: retroeval.github.io/_pages/keyno...
I am happy to announce that registration for RetroEval 2026 (retroeval.github.io) is now open! Additionally, the program is now available including keynote speakers and accepted papers: retroeval.github.io/_pages/progr...
Looking forward to seeing you at the @uniofaberdeen.bsky.social in June!
Looking forward to seeing you at the @uniofaberdeen.bsky.social in June!
Symposium Programme
RetroEval 2026 Aberdeen, United Kingdom, 1-2 June, 2026
retroeval.github.io
May 12, 2026 at 12:39 PM
I am happy to announce that registration for RetroEval 2026 (retroeval.github.io) is now open! Additionally, the program is now available including keynote speakers and accepted papers: retroeval.github.io/_pages/progr...
Looking forward to seeing you at the @uniofaberdeen.bsky.social in June!
Looking forward to seeing you at the @uniofaberdeen.bsky.social in June!
Took lots of noce pictures at my Retroeval retirement symposium. One of my favourites was me with my first and last PhD students, Sandra Williams and Yujun Wang!
June 3, 2026 at 7:47 AM
Took lots of noce pictures at my Retroeval retirement symposium. One of my favourites was me with my first and last PhD students, Sandra Williams and Yujun Wang!
…And we’re live! Interested in *evaluation* and *language generation*? Submit a paper, come join us, celebrate the career of @ehudreiter.bsky.social: A founding pioneer of grounded language generation who has consistently shared clear-eyed insights about the state of the field.
retroeval.github.io
retroeval.github.io
Symposium on Natural Language Generation Evaluations
RetroEval 2026 Aberdeen, United Kingdom, 1-2 June, 2026
retroeval.github.io
February 5, 2026 at 7:23 PM
…And we’re live! Interested in *evaluation* and *language generation*? Submit a paper, come join us, celebrate the career of @ehudreiter.bsky.social: A founding pioneer of grounded language generation who has consistently shared clear-eyed insights about the state of the field.
retroeval.github.io
retroeval.github.io
I’ve been invited to give a keynote at RetroEval 2026. 🤩 Loving the conference title. We all need some retro evaluation in the age of LLM-generated benchmarks.
I am happy to announce that registration for RetroEval 2026 (retroeval.github.io) is now open! Additionally, the program is now available including keynote speakers and accepted papers: retroeval.github.io/_pages/progr...
Looking forward to seeing you at the @uniofaberdeen.bsky.social in June!
Looking forward to seeing you at the @uniofaberdeen.bsky.social in June!
Symposium Programme
RetroEval 2026 Aberdeen, United Kingdom, 1-2 June, 2026
retroeval.github.io
May 19, 2026 at 9:45 PM
I’ve been invited to give a keynote at RetroEval 2026. 🤩 Loving the conference title. We all need some retro evaluation in the age of LLM-generated benchmarks.
I'm looking forward to my retirement workshop, which starts on Monday 1 June!! Will be great to catch up with former students and colleagues, and also discuss NLG evaluation.
retroeval.github.io
retroeval.github.io
Symposium on Natural Language Generation Evaluations
RetroEval 2026 Aberdeen, United Kingdom, 1-2 June, 2026
retroeval.github.io
May 29, 2026 at 11:28 AM
I'm looking forward to my retirement workshop, which starts on Monday 1 June!! Will be great to catch up with former students and colleagues, and also discuss NLG evaluation.
retroeval.github.io
retroeval.github.io
Ehud gave a provocative closing talk about research culture at #RetroEval last week and I really agree with him. It's very hard to move slowly and do good science when the culture is to move fast and not worry too much so long as you're getting published, even if it's not useful or reproducible.
New blog: I am worried by NLP research culture
NLG and NLP are mostly much better in 2026 than when I got my PhD in 1990. Unfortunately research culture has gotten *worse” in this period, which really worries me as I retire.
ehudreiter.com/2026/06/08/n...
NLG and NLP are mostly much better in 2026 than when I got my PhD in 1990. Unfortunately research culture has gotten *worse” in this period, which really worries me as I retire.
ehudreiter.com/2026/06/08/n...
I am worried by NLP research culture
In most ways NLG and NLP are much better in 2026 than when I got my PhD in 1990. Unfortunately research culture has gotten *worse” in this period, which really worries me as I retire. We have…
ehudreiter.com
June 8, 2026 at 9:32 AM
Ehud gave a provocative closing talk about research culture at #RetroEval last week and I really agree with him. It's very hard to move slowly and do good science when the culture is to move fast and not worry too much so long as you're getting published, even if it's not useful or reproducible.
Very exciting to see #RetroEval kicking off with a wonderful welcome from Dean Nir Oren celebrating Ehud's long career at the @uniofaberdeen.bsky.social and a keynote from Sina Zarrieß!
June 1, 2026 at 8:50 AM
Very exciting to see #RetroEval kicking off with a wonderful welcome from Dean Nir Oren celebrating Ehud's long career at the @uniofaberdeen.bsky.social and a keynote from Sina Zarrieß!
On Tuesday at the #RetroEval symposium the SIGGEN board awarded Ehud the Inaugural Prize for Outstanding Contributions to Natural Language Generation, future editions of which will bear his name as the Ehud Reiter Prize for Outstanding Contributions to Natural Language Generation.
Thank you, Ehud!
Thank you, Ehud!
I felt honoured and was very happy to get an Outstanding Contribution in NLG award from @siggen.bsky.social !
June 4, 2026 at 12:12 PM
On Tuesday at the #RetroEval symposium the SIGGEN board awarded Ehud the Inaugural Prize for Outstanding Contributions to Natural Language Generation, future editions of which will bear his name as the Ehud Reiter Prize for Outstanding Contributions to Natural Language Generation.
Thank you, Ehud!
Thank you, Ehud!
I wrote paper on "NLG Evaluation: Past, Present, Future" for Retroeval. Eval has changed enornously over my career! In future, I expect more on stuff relevant to real-world usage, including impact, qualitative studies, safety in worst/adversarial case
arxiv.org/abs/2605.23715
arxiv.org/abs/2605.23715
NLG Evaluation: Past, Present, Future
Natural Language Generation (NLG) evaluation has changed dramatically since 1990, and will continue to evolve in the future. In 1990, when NLG had close ties to linguistics, there was very little form...
arxiv.org
May 25, 2026 at 8:08 AM
I wrote paper on "NLG Evaluation: Past, Present, Future" for Retroeval. Eval has changed enornously over my career! In future, I expect more on stuff relevant to real-world usage, including impact, qualitative studies, safety in worst/adversarial case
arxiv.org/abs/2605.23715
arxiv.org/abs/2605.23715
I am pleased to announce the 1st call for papers for a special symposium on Natural Language Generation evaluations. This is in honour of @ehudreiter.bsky.social career and forthcoming retirement, will look back at how evaluations have changed and what is still left unaddressed.
retroeval.github.io
retroeval.github.io
Symposium on Natural Language Generation Evaluations
RetroEval 2026 Aberdeen, United Kingdom, 1-2 June, 2026
retroeval.github.io
February 4, 2026 at 7:42 PM
I am pleased to announce the 1st call for papers for a special symposium on Natural Language Generation evaluations. This is in honour of @ehudreiter.bsky.social career and forthcoming retirement, will look back at how evaluations have changed and what is still left unaddressed.
retroeval.github.io
retroeval.github.io
Now a real treat at #RetroEval with a talk from @ehudreiter.bsky.social on NLG Evaluation: Past, Present, and Future -- here's the paper: retroeval.github.io/assets/paper...
June 1, 2026 at 1:26 PM
Now a real treat at #RetroEval with a talk from @ehudreiter.bsky.social on NLG Evaluation: Past, Present, and Future -- here's the paper: retroeval.github.io/assets/paper...
I am pleased to announce that the proceedings for RetroEval have now been published on ACL Anthology: aclanthology.org/volumes/2026...
Proceedings of the 1st Symposium on Natural Language Generation Evaluations - ACL Anthology
aclanthology.org
June 17, 2026 at 8:14 PM
I am pleased to announce that the proceedings for RetroEval have now been published on ACL Anthology: aclanthology.org/volumes/2026...
The final talk of the day for #RetroEval is Daniel Braun talking about "Solving the Task but Not the Problem: A Customer Support Case Study on Why Extrinsic Evaluation Matters" -- then we'll be off to Dunnottar Castle
June 1, 2026 at 1:41 PM
The final talk of the day for #RetroEval is Daniel Braun talking about "Solving the Task but Not the Problem: A Customer Support Case Study on Why Extrinsic Evaluation Matters" -- then we'll be off to Dunnottar Castle
Really looking forward to this symposium in June reflecting on evaluation in #NLG / #textgeneration and celebrating @ehudreiter.bsky.social
Check out the CfP and see if you can join us in Aberdeen! It's beautiful in June :D
retroeval.github.io
Check out the CfP and see if you can join us in Aberdeen! It's beautiful in June :D
retroeval.github.io
Symposium on Natural Language Generation Evaluations
RetroEval 2026 Aberdeen, United Kingdom, 1-2 June, 2026
retroeval.github.io
February 20, 2026 at 1:51 PM
Really looking forward to this symposium in June reflecting on evaluation in #NLG / #textgeneration and celebrating @ehudreiter.bsky.social
Check out the CfP and see if you can join us in Aberdeen! It's beautiful in June :D
retroeval.github.io
Check out the CfP and see if you can join us in Aberdeen! It's beautiful in June :D
retroeval.github.io
@satiarshah.bsky.social @danriccio.bsky.social
Not sure you’re right about the PP.
#1. Garland is one their 5 best players.
#2. Garlands puck retroeval is elite. Retaining posession is a critical part of a successful power play.
No one else can do his role as well as he can.
Not sure you’re right about the PP.
#1. Garland is one their 5 best players.
#2. Garlands puck retroeval is elite. Retaining posession is a critical part of a successful power play.
No one else can do his role as well as he can.
December 19, 2024 at 2:53 AM
@satiarshah.bsky.social @danriccio.bsky.social
Not sure you’re right about the PP.
#1. Garland is one their 5 best players.
#2. Garlands puck retroeval is elite. Retaining posession is a critical part of a successful power play.
No one else can do his role as well as he can.
Not sure you’re right about the PP.
#1. Garland is one their 5 best players.
#2. Garlands puck retroeval is elite. Retaining posession is a critical part of a successful power play.
No one else can do his role as well as he can.
The correct keynote link: retroeval.github.io/_pages/keyno...
Keynote Speakers
RetroEval 2026 Aberdeen, United Kingdom, 1-2 June, 2026
retroeval.github.io
May 20, 2026 at 9:52 PM
The correct keynote link: retroeval.github.io/_pages/keyno...
The next talk at #RetroEval is "Never Truly Out of Fashion: A Retrospective Look at Evaluation in NLG" presented by Patrícia Schmidtová
June 1, 2026 at 12:34 PM
The next talk at #RetroEval is "Never Truly Out of Fashion: A Retrospective Look at Evaluation in NLG" presented by Patrícia Schmidtová
And finally Alberto Bugarín-Diz concludes the first oral session at #RetroEval with a talk on "Decomposition Does Not Help: Evidence from Semantic Clustering in LLM-based Causal Graph Discovery"
June 1, 2026 at 11:02 AM
And finally Alberto Bugarín-Diz concludes the first oral session at #RetroEval with a talk on "Decomposition Does Not Help: Evidence from Semantic Clustering in LLM-based Causal Graph Discovery"
Barkavi Sundararajan and Adarsa Sivaprasad are now presenting our joint paper "RAG as a collapsed NLG pipeline" at #RetroEval! This was a fun conceptual paper to work on where we argue that keeping the classic NLG pipeline in mind when designing evaluations is still helpful even with modern LLM RAG.
June 1, 2026 at 10:38 AM
Barkavi Sundararajan and Adarsa Sivaprasad are now presenting our joint paper "RAG as a collapsed NLG pipeline" at #RetroEval! This was a fun conceptual paper to work on where we argue that keeping the classic NLG pipeline in mind when designing evaluations is still helpful even with modern LLM RAG.
Up next at #RetroEval: Fahime Same presents "A Comparative Evaluation of End-to-End and Pipeline Approaches for Summarisation"
June 1, 2026 at 9:55 AM
Up next at #RetroEval: Fahime Same presents "A Comparative Evaluation of End-to-End and Pipeline Approaches for Summarisation"
If you're working on your submission to #RetroEval2026, the Symposium on Natural Language Generation Evaluations in honor of @ehudreiter.bsky.social, I've got some good news!
The deadline has been extended to 28 April for archival submissions!
Updated deadlines, etc, here: retroeval.github.io
The deadline has been extended to 28 April for archival submissions!
Updated deadlines, etc, here: retroeval.github.io
Symposium on Natural Language Generation Evaluations
RetroEval 2026 Aberdeen, United Kingdom, 1-2 June, 2026
retroeval.github.io
April 21, 2026 at 3:09 PM
If you're working on your submission to #RetroEval2026, the Symposium on Natural Language Generation Evaluations in honor of @ehudreiter.bsky.social, I've got some good news!
The deadline has been extended to 28 April for archival submissions!
Updated deadlines, etc, here: retroeval.github.io
The deadline has been extended to 28 April for archival submissions!
Updated deadlines, etc, here: retroeval.github.io