SLT/MT Run Submission Format:

 

   Each participant has to submit at least one run for each of the translation task s/he registered for.

   Multiple run submissions are allowed, but participants must explicitly indicate one PRIMARY run for each track. All other run submissions are treated as CONTRASTIVE runs. In case that none of the runs is marked as PRIMARY, the latest submission (according to the file time-stamp) for the respective track will be used as the PRIMARY run.

   Runs have to be submitted as a gzipped TAR archive (format see below) and e-mailed to iwslt2012.ted AT gmail DOT com.

 

TAR archive file structure:

 

<UserID>/<Set>.<Task>.<UserID>.primary.xml

        /<Set>.<Task>.<UserID>.contrastive1.xml

        /<Set>.<Task>.<UserID>.contrastive2.xml

        /...

where:

 

<UserID> = user ID of participant used to download data files

<Set> =  dev2010 | tst2010 | tst2011 | tst2012

<Task> =  SLT_EF | MT_EF | MT_AE | MT_CE

 

Examples:

 

fbk/dev2010.SLT_EF.fbk.primary.xml

   /dev2010.SLT_EF.fbk.contrastive1.xml

   /dev2010.SLT_EF.fbk.contrastive2.xml

   /tst2010.MT_SC_EF.fbk.primary.xml

   /tst2010.MT_CE.fbk.primary.xml

 

Re-submitting your runs is allowed as far as the mails arrive BEFORE the submission deadline. In case that multiple TAR archives are submitted by the same participant, only runs of the most recent submission mail will be used for the IWSLT 2012 evaluation and previous mails will be ignored.