CTS Speaker Recognition Challenge


Contact Us

Please send questions to: sre_poc@nist.gov

For the CTS Challenge discussion please visit our Google Group. https://groups.google.com/a/list.nist.gov/forum/#!forum/cts-challenge

Summary

Following the success of the 2019 Conversational Telephone Speech (CTS) Speaker Recognition Challenge, which received 1347 submissions from 67 academic and industrial organizations, NIST is organizing a 2020 CTS Challenge, the next iteration of an ongoing series of speaker recognition evaluations conducted by NIST since 1996.

The basic task in the CTS Challenge is speaker detection, i.e., determining whether a specified target speaker is speaking during a given segment of speech. Similar to the 2019 CTS Challenge, the 2020 evaluation will feature a leaderboard-style challenge offering an open/unconstrained training condition, but using CTS recordings extracted from multiple data sources containing multilingual speech. In addition, unlike the 2019 CTS Challenge, no development set will be initially released.

For more information about the challenge please visit the announcement page or send questions to sre_poc@nist.gov.
News
11Jul'20
CTS Challenge is announced
7Aug'20
Evaluation plan is now available
August 7, 2020: Evaluation Plan Published

August 17, 2020 : CTS Challenge Registration Begins

August 17, 2020 : Data Available

Aug 2020-Jun 2021 (tentative): System Output Due to NIST

June 2021 (tentative): Workshop

Test set results will be released periodically


Disclaimer:

Participants are allowed to publish the leaderboard results unaltered, but they must not make advertising claims about their standing/ranking in the evaluation, or winning the evaluation, or claim NIST or the U.S. Government endorsement of their system(s) or commercial product(s). See the evaluation plan for more details regarding the participation rules in the NIST CTS Challenge.

NIST CTS Challenge

Updated: 2021-08-01T22:33:22-04:00
RANK TEAM SET TIMESTAMP EER [%] MIN_C ACT_C
1 STC Progress 20210625-113653 2.55 0.077 0.084
2 THUEE Progress 20210611-000600 2.39 0.073 0.092
3 I4U Progress 20210528-015904 2.53 0.077 0.094
4 TEAM-CDPE-28 Progress 20210616-024452 2.55 0.087 0.101
4 JHU-MIT Progress 20210413-171216 2.33 0.092 0.101
5 AAP Progress 20210621-103112 2.37 0.102 0.106
6 Veridas Progress 20210729-055711 2.60 0.105 0.110
7 TEAM-QSYF-27 Progress 20210625-040137 2.58 0.117 0.122
8 BGU Progress 20210630-030728 2.85 0.124 0.132
9 ROXANNE Progress 20210610-091204 3.13 0.133 0.135
10 LIA Progress 20210405-115008 2.83 0.129 0.136
11 XMUSPEECH Progress 20210702-015042 3.11 0.154 0.160
12 ABC Progress 20210320-165603 2.99 0.159 0.169
13 I2R Progress 20210203-223806 2.70 0.125 0.174
14 TEAM-ZBSM-52 Progress 20210729-075707 3.41 0.171 0.183
15 BiometricVox Progress 20201031-061334 3.40 0.140 0.207
16 Elektronika Progress 20210605-105329 4.51 0.203 0.218
17 NSYSU_CHT Progress 20210702-035631 3.52 0.177 0.222
18 TEAM-MGQG-50 Progress 20210730-125424 2.67 0.136 0.238
19 TEAM-QTUY-05 Progress 20210218-041325 5.43 0.237 0.251
20 dBLab Progress 20210210-044741 5.95 0.275 0.308
21 TEAM-IZYX-36 Progress 20201217-014444 7.00 0.301 0.338
22 TEAM-FKFK-39 Progress 20210216-103739 6.99 0.280 0.399
23 TJU- Progress 20210601-023932 4.01 0.247 0.512
24 GRD Progress 20201021-022551 16.82 0.677 0.930
25 TEAM-QLSB-38 Progress 20210506-204611 63.86 1.000 1.000