A research team from the University of Melbourne, Facebook AI, and Twitter Cortex proposes a black-box test method for assessing and debugging the numerical translation of neural machine translation systems in a systematic manner. The approach reveals novel types of errors that are general across multiple state-of-the-art translation systems.

Here is a quick read: Melbourne U, Facebook & Twitter Expose Novel Numerical Errors in NMT Systems.

The paper As Easy as 1, 2, 3: Behavioural Testing of NMT Systems for Numerical Translation is on arXiv.

Source link