@NTCIR profile picture
NTCIR @NTCIR

NTCIR organizes shared-tasks in IR, QA, MT, NLP, Summarization, Data/Opinion Mining.

Joined May 2009
  • Tweets 659
  • Following 1,010
  • Followers 706
44 Photos and videos
NTCIR@NTCIR
Jun 9
Registration deadlines have been extended for several #NTCIR19 tasks: AgenticInstruction: July 10, 2026 SciClaimEval: July 10, 2026 ToT: July 1, 2026 DAGRI: July 15, 2026 Check the task details and register here: research.nii.ac.jp/ntcir/ntc… We look forward to your participation!
5
2
237
NTCIR@NTCIR
Jun 9
πŸ“’ NTCIR-19 Registration Extensions are here! Several tasks have updated registration deadlines: πŸ“… AgenticInstruction β†’ July 10 πŸ“… SciClaimEval β†’ July 10 πŸ“… DAGRI β†’ July 15 πŸ“… ToT β†’ July 1 Don't miss your chance to participate! πŸš€ #NTCIR19 #NLP #IR #DeadlineExtension
1
1
139
NTCIR@NTCIR
May 29
🧡 "Show me a dress like this but in blue and shorter." Composed image retrieval is a hard, real-world problem. #NTCIR19 CAMEO benchmarks it using 369,000 reviews from a real Vietnamese e-commerce platform. (1/4)
1
83
more replies
NTCIR@NTCIR
May 29
The ViEcomRec dataset is built from a real Vietnamese e-commerce platform, with product images, metadata, and 369K Vietnamese customer reviews. Retrieved images are pooled TREC-style across submissions and judged by human assessors. (3/4)
1
68
NTCIR@NTCIR
May 29
πŸ“… Registration deadline: July 10, 2026 (AoE) πŸ”— Task: cameo-task.com/ (moved from Google Sites) πŸ“§ allie.tran@dcu.ie πŸ“ Register: research.nii.ac.jp/ntcir/ntc… #NTCIR19 #MultimodalIR #Ecommerce (4/4)
22
NTCIR@NTCIR
May 29
🧡 What if you could search your own memories? That’s the vision behind #NTCIR19 Lifelog-7. The task features four subtasks, including the new CASTLE collection with audio, video, chat transcripts, and interaction logs supporting three retrieval challenges. (1/5)
1
1
1
290
more replies
NTCIR@NTCIR
May 29
The dry run is Feb 20 – May 1. Formal run: Apr 20 – Aug 1. Registration deadline July 10. This is the 7th edition of the NTCIR Lifelog series. (4/5)
1
23
NTCIR@NTCIR
May 29
πŸ“… Registration deadline: July 10, 2026 (AoE) πŸ”— Task: lifelog-ntcir-project-bd9eae… πŸ“ Register: research.nii.ac.jp/ntcir/ntc… #NTCIR19 #Lifelogging #PersonalIR (5/5)
23
NTCIR@NTCIR
May 27
🧡 "Table 1 shows our method outperforms all baselines." Does it? #NTCIR19 SciClaimEval is a benchmark for verifying scientific claims against the actual tables and figures in papers. (1/5)
1
100
more replies
NTCIR@NTCIR
May 27
Published baselines: o4-mini achieves 82.3% accuracy but only 68.2% pair accuracy on subtask 1 and 85.2% on subtask 2. Qwen3-VL-30B also tested. Dataset is live on HuggingFace now. (4/5) huggingface.co/datasets/alab…

alabnii/sciclaimeval-shared-task Β· Datasets at Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

huggingface.co
1
51
NTCIR@NTCIR
May 27
πŸ“… Registration: June 1, 2026 | Formal run submission: July 19, 2026 πŸ”— Task: sciclaimeval.github.io/ πŸ“¦ Data: huggingface.co/datasets/alab… πŸ“ Register: research.nii.ac.jp/ntcir/ntc… sciclaimeval.github.io/#regi… #NTCIR19 #ScientificNLP #FactVerification (5/5)

SciClaimEval

SciClaimEval: Cross-modal Claim Verification in Scientific Papers

sciclaimeval.github.io
30
NTCIR@NTCIR
May 27
🧡 An AI radiologist writes "pneumonia." But what findings led there? AI usually skips that reasoning. #NTCIR19 HIDDEN-RAD2 challenges systems to make it explicit β€” and now to catch their own mistakes too. (1/5)
1
104
more replies
NTCIR@NTCIR
May 27
Two participation tasks: β€’ Radiologist-annotated reports ( optional imaging data) β€’ Crowdsourced questionnaires β€” no licensing restrictions, broader access Evaluation: automatic metrics domain embeddings LLM rubric scoring expert qualitative review. (4/5)
1
33
NTCIR@NTCIR
May 27
πŸ“… Registration deadline: July 10, 2026 (AoE) πŸ”— Task: sites.google.com/view/hidden… πŸ“§ hidden-rad2@googlegroups.com πŸ“ Register: research.nii.ac.jp/ntcir/ntc… #NTCIR19 #MedicalAI #XAI (5/5)

NTCIR19: Hidden-Rad2

Introduction Welcome to the Hidden-RAD2 challenge, a Core Task of NTCIR-19! Building on the success of the NTCIR-18 Hidden-RAD task, Hidden-RAD2 continues to explore how well AI can infer and explain...

sites.google.com
37
Load more