A Challenge Set Approach to Evaluating Machine Translation

Neural machine translation represents an exciting leap forward in translation quality. But what longstanding weaknesses does it resolve, and which remain? We address these questions with a challenge set approach to translation evaluation and error analysis. A challenge set consists of a small set of sentences, each hand-designed to probe a system's capacity to bridge a particular structural divergence between languages. To exemplify this approach, we present an English-French challenge set, and use it to analyze phrase-based and neural systems. The resulting analysis provides not only a more fine-grained picture of the strengths of neural systems, but also insight into which linguistic phenomena remain out of reach.Comment: EMNLP 2017. 28 pages, including appendix. Machine readable data included in a separate file. This version corrects typos in the challenge se

Towards an Automatic Dictation System for Translators: the TransTalk Project

Professional translators often dictate their translations orally and have them typed afterwards. The TransTalk project aims at automating the second part of this process. Its originality as a dictation system lies in the fact that both the acoustic signal produced by the translator and the source text under translation are made available to the system. Probable translations of the source text can be predicted and these predictions used to help the speech recognition system in its lexical choices. We present the results of the first prototype, which show a marked improvement in the performance of the speech recognition task when translation predictions are taken into account.Comment: Published in proceedings of the International Conference on Spoken Language Processing (ICSLP) 94. 4 pages, uuencoded compressed latex source with 4 postscript figure

Trajectories from public sector of research to private sector : an analysis using french data on young PhD graduates

The organisation of research is a powerful factor structuring the labour market for recent doctorate recipients. The queue for permanent research positions in the academic sector has created a specific labour market for young doctorates, characterised by a proliferation of postdoctoralprogrammes and fixed-term contracts. In that specific context, our paper deals with the way the young PhD graduates enter the labour market, the way they get a job as researcher in the private or public sector and how much the return of the job mobility from the public academic sector to the private sector is. Using a longitudinal survey provided by the Cereq, our results suggest that even if nearly the half of the cohort has a direct access to jobs in the research sector (private or public), 20% remain in trajectories dominated by under-qualifiedjobs or recurrent unemployment. Our empirical investigation show a negative or non significant returns of the job mobility from the public academic sector to the private sector.Marché du travail; Insertion professionnelle; Post Doctorant; Jeune; Mobilité professionnelle; France

Discrete embeddings for Lagrangian and Hamiltonian systems

The general topic of the present paper is to study the conservation for some structural property of a given problem when discretising this problem. Precisely we are interested with Lagrangian or Hamiltonian structures and thus with variational problems attached to a least action principle. Considering a partial differential equation (PDE) deriving from such a variational principle, a natural question is to know whether this structure at the continuous level is preserved at the discrete level when discretising the PDE. To address this question a concept of \textit{coherence} is introduced. Both the differential equation (the PDE translating the least action principle) and the variational structure can be embedded at the discrete level. This provides two discrete embeddings for the original problem. In case these procedures finally provide the same discrete problem we will say that the discretisation is \textit{coherent}. Our purpose is illustrated with the Poisson problem. Coherence for discrete embeddings of Lagrangian structures is studied for various classical discretisations (finite elements, finite differences and finite volumes). Hamiltonian structures are shown to provide coherence between a discrete Hamiltonian structure and the discretisation of the mixed formulation of the PDE, both for mixed finite elements and mimetic finite differences methods.Comment: Acta Mathematica Vietnamica, Springer Singapore, A Para{\^i}tr