Evaluating state-of-the-art in AI
Joined September 2013
- Tweets 193
- Following 91
- Followers 1,301
- Likes 289
10 Photos and videos
Submissions now open on EvalAI for #AlexaPrize SimBot Challenge from @AmazonScience ๐
Prizes worth $500K, $100K, and $50K for winners!
10 Jan 2022
Today, the #AlexaPrize SimBot Public Benchmark Challenge starts! It's the first time Amazon has welcomed teams other than those sponsored by the company to take part in the challenge. Visit the @eval_ai website for more information, and how to participate: amzn.to/evalai-simbot
ALT Alexa Prize SimBot Public Benchmark Challenge
1
7
17
EvalAI retweeted
19 Dec 2022
Excited to share a look-back on the Ego4D challenges 2022! In spite of being a brand new dataset, we had strong uptake and healthy competition, leading to significant gains over our baselines (upto 300%!). Check out our analysis and join us in 2023 :) discuss.ego4d-data.org/t/egoโฆ
2
13
51
17,529
EvalAI retweeted
7 Jan 2022
New year, new user @AmazonScience and new challenge on @eval_ai ๐. Can't be a better start for 2022!
5 Jan 2022
The #AlexaPrize SimBot Challenge is a competition to advance the development of next-gen virtual assistants that will help humans complete real-world tasks. Learn more about the public benchmark phase on @eval_ai, which starts Jan 10, and ends April 30: amzn.to/evalai-simbot
ALT Alexa Prize SimBot Public Benchmark Challenge
4
13
EvalAI retweeted
EvalAI: :cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI
Lang: Python
โญ๏ธ 1290
#MachineLearning
Author: @eval_ai
github.com/Cloud-CV/EvalAI
2
4
EvalAI retweeted
13 Sep 2021
We provide datasets in the Neurodata Without Borders @NeurodataWB format, accessible via @DANDIarchive. We host benchmarks and leaderboards on the @eval_ai platform, with private held-out data for standardized model evaluation.
1
4
16
Excited to host BEHAVIOR Challenge 2021. Visit eval.ai/web/challenges/challโฆ to participate. ๐
19 Jul 2021
Drum roll! We release BEHAVIOR, an embodied AI benchmark and challenge of 100 complex household activities that would pose significant difficulties to all of todayโs state-of-the-art algorithms. Hope to see great participation to this challenge @ICCV_2021
3
8
EvalAI retweeted
18 May 2021
We are happy to announce that our #sceneunderstanding challenge for #CVPR21 has been extended until May 31st.
Submissions accepted on @eval_ai
eval.ai/web/challenges/challโฆ
@QUTRobotics
1
4
EvalAI retweeted
13 Apr 2021
TextVQA (textvqa.org/challenge) and TextCaps (textvqa.org/textcaps/challenโฆ) 2021 Challenges are live now!
Deadline: May 14th, 2021
Winners to be announced at #CVPR21 VQA Workshop (visualqa.org/workshop).
1/n
1
8
18
EvalAI retweeted
12 Mar 2021
It's that time of the year again :) The 2021 VQA Challenge is now live! It closes May 7th.
Also note the TextVQA and TextCaps challenges that involve reading and reasoning about text in images.
12 Mar 2021
VQA Challenge 2021 is live! Deadline: May 7. Link: visualqa.org/challenge.
Winners to be announced at #CVPR21 VQA Workshop (visualqa.org/workshop).
Other challenges @ workshop: TextVQA, TextCaps.
(1/2)
5
29
EvalAI retweeted
11 Mar 2021
Itโs been a long journey. Thanks for the support GSOC @GoogleOSS!
We are happy to announce that @project_cloudcv has been selected as a mentoring organization for @gsoc 2021. This is the 7th consecutive year and we are excited for the summer with #EvalAI project ๐
1
25
We are happy to announce that @project_cloudcv has been selected as a mentoring organization for @gsoc 2021. This is the 7th consecutive year and we are excited for the summer with #EvalAI project ๐
9 Mar 2021
๐ฅ We have an announcement to make! ๐ฅ
We are pleased to welcome 202 open source projects as our Google Summer of Code 2021 mentoring organizations, including 31 first-time organizations.
Read and see how to get involved โ goo.gle/3rwkPEJ
1
3
13
Here are the project ideas (gsoc.cloudcv.org) for the summer and we are looking forward to student applications. We encourage students to engage with the community through our GitHub (github.com/Cloud-CV) and Gitter (gitter.im/Cloud-CV/EvalAI) channels.
1
3
10
We also have a few positions available for mentors who will help/mentor students during the summer. Please fill this form (forms.gle/KpFmAMMLbd5MvFTC6) if you are interested in mentoring students in the @gsoc program on #EvalAI and we will reach out to you.
1
2
6
EvalAI retweeted
2 Mar 2021
Leaderboards of Habitat Autonomous Navigation Challenge 2021 are live!
Looking forward to your submission on PointNav w/o localization sensors (โ๐บ๐ 5m ๐๐๐๐กโ, 3m ๐ค๐๐ ๐กโ) and ObjectNav (โ๐๐๐๐ ๐ ๐โ๐๐๐โ) tasks.
eval.ai/web/challenges/challโฆ
2
11
EvalAI retweeted
2 Mar 2021
We've released a centralized evaluation server on @eval_ai to track community-wide progress on discovering electrocatalysts using ML.
eval.ai/web/challenges/challโฆ
opencatalystproject.org/leadโฆ
(2/3)
1
5
16
EvalAI retweeted
17 Feb 2021
13 challenges.
6 workshop organizers.
42 challenge organizers.
17 scientific advisors.
21 organizations.
1 workshop: embodied-ai.org/ #CVPR2021
17 Feb 2021
We're excited to launch the third Habitat Challenge at the Embodied AI workshop with 15 research & academic institutions. The 2021 Habitat Challenge invites AI experts from around the world to teach machines to navigate real-world environments. #CVPR2021 ai.facebook.com/blog/2021-haโฆ
16
90
#EvalAI is the new home for Embodied AI challenges ๐ This year we are hosting 5 challenges to be held at the Embodied AI workshop at CVPR 2021 from @facebookai, @StanfordSVL, @ai_habitat, @UTAustin, @IllinoisCS, @RoboticVisionAU, @robVisChallenge, @QUTRobotics
1
14
52