Findings of the WMT 2024 Biomedical Translation Task

This document is a technical report detailing the findings of the ninth edition of the Biomedical Translation Task held at WMT 2024. The report outlines the release of test sets for six language pairs including French, German, Italian, Portuguese, Russian, and Spanish, translating from and into English. Each test set comprises 50 abstracts sourced from PubMed, with a clear emphasis on the biomedical domain. The methodology involved no sentence splitting, and the evaluation was conducted at the abstract level. The report discusses the selection criteria for the test sets and highlights the introduction of new features including the use of a baseline system based on the Llama 3.1 model. It also documents the processing times and energy consumption associated with the translation tasks using different hardware setups. The findings are intended to support advancements in machine translation for scientific literature.