Skip to navigation | Skip to main content | Skip to footer
Menu
Menu
  • Research School Irregular

    Published: Wednesday, 27 May 2020

    A newsletter for PGR

    Research School Irregular - Contents

    [ top ]Research School Irregular

    Mercury Seminar Series - Restart TODAY at 2pm

    Mercury Seminar Series - Restart TODAY @ 2pm

    Our PGRs are doing interesting work that we might all be able to build on in the future.  The Mercury Seminar Series invites final year PGRs to discuss and disseminate their work in just the same way as the Departmental Atlas Seminars. This is your opportunity to understand the breadth of work undertaken in the Department and discuss ideas with our early career researchers. This first session of zoom seminars will occur every other week until the beginning of August.

    Zoom Meeting ID:970 6036 3613 .  Here are details of today's talk:

    Wed 27th May  - 2pm - Viktor Schlegel - Title: Evaluating the Evaluation of Machine Reading Comprehension

    Abstract:  NLP research, particularly the processing of unstructured text, is advancing at an unprecedented rate. Deep neural models optimised on large corpora and the broad availability of large task-specific datasets result in systems that surpass humans on various benchmarks when answering questions over text passages. Recent developments, however, cast doubt on this superb performance. Those benchmarks appear to exhibit superficial cues that deep models learn to exploit, thus bypassing the required natural language understanding capabilities. This raises the following questions: to what extent are state-of-the-art reading comprehension benchmarks suitable to evaluate various capabilities required for the understanding of natural language and how can reading comprehension systems be evaluated with regard to those capabilities. This talk will present methods, their applications and report results of a fine-grained evaluation of state of the art machine reading comprehension benchmarks and corresponding systems.

    gravatar Ruth Maddocks

    gravatar Simon Harper
Generated: Thursday, 28 March 2024 19:54:06
Last change: Wednesday, 27 May 2020 13:35:49