Workshop on Evaluation and Comparison of NLP Systems, co-located with #AACL2025.
Joined October 2019
- Tweets 60
- Following 36
- Followers 303
- Likes 62
2 Photos and videos
📢📢 This year Eval4NLP is co-located with #aacl2025. Our CFP is now out: eval4nlp.github.io/2025/cfp.…
Paper submission deadline: September 29, 2025. Direct submission via OpenReview.
ARR commitment deadline: October 27, 2025
Notification of acceptance: November 3, 2025
3
5
406
Two more days left to apply 👇👇
x.com/NLLG_lab/status/192819…
📢📢👇New job openings. Topic: social bias detection analysis with LLMs across time (1950-now) & languages. There are 2 Post-Doc/PhD positions, supervised by @egere14 (@utn_nuremberg) Simone Ponzetto (@dwsunima). Fully funded, up to 3 yrs.
More infos: nl2g.github.io/positions
3
3
1,078
📢📢📢The NLLG lab has three new open fully funded PhD positions:
1⃣ - Next Generation LLMs
2⃣ - NLP for Science
3⃣ - Multimodal evaluation metrics
Deadlines: End of October
ℹ️More information: nl2g.github.io/positions
3
9
1,046
📢📢👉👉@chrleiter presenting his work on how explainability can improve evaluation metrics for MT and summarization tomorrow at #eacl2024
x.com/ChrLeiter/status/17700…
19 Mar 2024
Excited to present our paper "BMX: Boosting Natural Language Generation Metrics with Explainability" at #EACL2024! Join us in Virtual Poster Session B on 20.03.2024 at 2 p.m. as we unveil how explanations can enhance NLG evaluation metrics.
1
1
3
367
Eval4NLP23 has concluded. We thank everyone congratulate our shared task winners on inducing high-quality metrics for MT summ. using prompting and efficient models: "HIT-MI&T Lab" (even beating GEMBA COMET🚀) & "DSBA".
Shared task overview paper: arxiv.org/pdf/2310.19792.pdf
1
4
16
1,991
Our accepted papers and program are now online:
eval4nlp.github.io/2023/prog…
eval4nlp.github.io/2023/acce…
Moreover, we're excited to have @alexfabbri4 as invited speaker on the topic of "Re-Evaluating Summarization Evaluation in the Era of LLMs"
See u tomorrow 9am (UTC 8), online only!
4
12
2,085
📢📢To accommodate the recent ARR author response period, Eval4NLP @aaclmeeting extends the deadline for pre-reviewed papers until September 30th.
Pre-reviewed papers must include: the paper along with its original reviews and scores.
More details: eval4nlp.github.io/
4
5
719
📢📢 Don't forget: Pre-reviewed papers can be submitted to Eval4NLP @aaclmeeting until September 25 via Openreview
Just include the paper and your meta-reviews along with reviews and all the scores.
eval4nlp.github.io/
2
5
1,219
Due to popular demand, the Eval4NLP workshop @ @aaclmeeting submission deadline has been moved to September 1. We look forward to your submissions! 📣📣
More infos: eval4nlp.github.io/
7
4
1,787
📢📢Brief reminder that Eval4NLP submission deadline is this **Friday, 25.08.2023**
Focus: Evaluation with/of LLMs, all other evaluation aspects also very welcome
2nd call4papers: aclweb.org/portal/content/se…
Webpage: eval4nlp.github.io/2023/inde…
Venue: @aaclmeeting (Bali 🏖️)
7
6
1,564
Shared task on explainable evaluation metrics: The development phase is running, but participation is still easily possible, there's also no necessity to train systems to take part. #nlproc #machinelearning
Find out more @nlp_evaluation:
eval4nlp.github.io/2023/shar…
2
4
442
📢📢📢 We have released the description of Eval4NLP's shared task on "Prompting LLMs as Explainable Evaluation Metrics" (for MT & summarization).
Dev phase: Aug. 7
Test phase: Sep. 18
System Submission Deadline: Sep. 23
More details: eval4nlp.github.io/2023/shar…
🚀🚀🚀
7
12
1,136
📢📢📢 The Eval4NLP workshop will take place this year at AACL 2023. Special focus: Evaluation of/with LLMs. Including a shared task on Prompting LLMs as Explainable Metrics. 📢📢📢
Direct submission deadline: 25.08.
Webpage: eval4nlp.github.io/2023/inde…
CFP: eval4nlp.github.io/2023/cfp.…
13
18
3,153
Eval4NLP is happening tomorrow, starting at 10:30 UTC. Our combined program with @sum_eval includes some great paper presentations and invited talks from @peyrardmax and @rktamplayo. See you there tomorrow!
eval4nlp.github.io/2022/prog…
7
10
The list of accepted papers is now on our website! eval4nlp.github.io/2022/acce… Congratulations to all of the authors, and we look forward to your presentations on November 20.
FYI, registration for AACL is now open! aacl2022.org/Registration
3
11
This year, Eval4NLP is accepting submissions of papers with reviews from other venues (see the CFP for more details eval4nlp.github.io/2022/cfp.…).
Submit your paper and reviews here openreview.net/group?id=aclw… by September 21, AOE!
3
6
The deadline to submit to Eval4NLP has been extended to August 15! We will also be accepting papers with reviews from AACL in addition to ARR, both due September 21!
eval4nlp.github.io/2022/cfp.…
5
9
Eval4NLP retweeted
2 Aug 2022
I got three fully funded PhD positions in new BMBF project "Metrics4NLG". Topic: Evaluation for Text Generation (and text generation itself). Very cool interdisciplinary project :-). If you're interested or know anyone interested, drop me a line (steffen.eger@uni-bielefeld.de).
2
17
51