From 11bd47ca7449be7670db396b2de4043cf936a9c4 Mon Sep 17 00:00:00 2001
From: HAMIDULLAH Yasser <13780954+yhamidullah@users.noreply.github.com>
Date: Thu, 15 Aug 2024 22:15:09 +0200
Subject: [PATCH] Update 2024.acl.xml
Corrections:
*Name and First name inverted: Yasser Hamidullah
*"van" missing in Josef van Genabith
---
data/xml/2024.acl.xml | 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
diff --git a/data/xml/2024.acl.xml b/data/xml/2024.acl.xml
index d1959f9df6..3a7684192f 100644
--- a/data/xml/2024.acl.xml
+++ b/data/xml/2024.acl.xml
@@ -10446,13 +10446,13 @@
Sign Language Translation with Sentence Embedding Supervision
- HamidullahYasser
- JosefGenabithGerman Research Center for AI and Universität des Saarlandes
+ YasserHamidullah
+ Josefvan GenabithGerman Research Center for AI and Universität des Saarlandes
CristinaEspaña-BonetGerman Research Center for AI
425-434
State-of-the-art sign language translation (SLT) systems facilitate the learning process through gloss annotations, either in an end2end manner or by involving an intermediate step. Unfortunately, gloss labelled sign language data is usually not available at scale and, when available, gloss annotations widely differ from dataset to dataset. We present a novel approach using sentence embeddings of the target sentences at training time that take the role of glosses. The new kind of supervision does not need any manual annotation but it is learned on raw textual data. As our approach easily facilitates multilinguality, we evaluate it on datasets covering German (PHOENIX-2014T) and American (How2Sign) sign languages and experiment with mono- and multilingual sentence embeddings and translation systems. Our approach significantly outperforms other gloss-free approaches, setting the new state-of-the-art for data sets where glosses are not available and when no additional SLT datasets are used for pretraining, diminishing the gap between gloss-free and gloss-dependent systems.
2024.acl-short.40
- yasser-etal-2024-sign
+ hamidullah-etal-2024-sign
STREAM: Simplified Topic Retrieval, Exploration, and Analysis Module