How to Write Science Questions that Are Easy for People and Hard for Computers

21 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge (2018, methodology): “Second, because tests were designed for people rather than machines, large portions of these tests can be easily solved by simple AI methods (e.g. Davis, 2016; Clark et al., 2016).”
CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge (2019, background): “SQUABU created a small hand-curated test of common sense and science questions (Davis, 2016), which are difﬁcult for current techniques to solve.”
Deep Learning: A Critical Appraisal (2018, background): “• Scientific reasoning and understanding, as in the Allen AI institute’s 8th grade science challenge (Schoenick, Clark, Tafjord, P, & Etzioni, 2017; Davis, 2016).”
Does it Make Sense? And Why? A Pilot Study for Sense Making and Explanation (2019, methodology): “SQUABU (Davis, 2016) provides a small hand-constructed test of commonsense and scientiﬁc questions.”
SemEval-2020 Task 4: Commonsense Validation and Explanation (2020, methodology): “SQUABU (Davis, 2016) provides a small hand-constructed test of commonsense and scientiﬁc questions.”