Extract from the Register of European Patents

EP About this file: EP3739477

EP3739477 - SPEECH TRANSLATION METHOD AND SYSTEM USING MULTILINGUAL TEXT-TO-SPEECH SYNTHESIS MODEL [Right-click to bookmark this link]
StatusThe patent has been granted
Status updated on  27.06.2025
Database last updated on 28.03.2026
FormerGrant of patent is intended
Status updated on  27.02.2025
FormerExamination is in progress
Status updated on  03.11.2023
FormerRequest for examination was made
Status updated on  16.10.2020
FormerThe international publication has been made
Status updated on  19.07.2019
Most recent event   Tooltip06.02.2026Lapse of the patent in a contracting state
New state(s): ES
published on 11.03.2026  [2026/11]
Applicant(s)For all designated states
Neosapience, Inc.
1208-ho, 16, Maeheon-ro Seocho-Gu
Seoul 06771 / KR
[2025/31]
Former [2020/47]For all designated states
Neosapience, Inc.
1208-ho, 16, Maeheon-ro Seocho-Gu
Seoul 06771 / KR
Inventor(s)01 / KIM, Tae Su
8707-1304, 70, Wellbeing town-ro Yeongtong-gu
Suwon-si Gyeonggi-do 16222 / KR
02 / LEE, Young Gun
Samjin-Jutaek 101-ho, 34-10, Yeonseo-ro 17-gil
Eunpyeong-gu
Seoul 03335 / KR
 [2020/47]
Representative(s)Studio Torta S.p.A.
Via Viotti, 9
10121 Torino / IT
[2020/47]
Application number, filing date19738845.711.01.2019
[2020/47]
WO2019KR00513
Priority number, dateKR2018000404711.01.2018         Original published format: KR 20180004047
KR2018003637729.03.2018         Original published format: KR 20180036377
[2020/47]
Filing languageKO
Procedural languageEN
PublicationType: A1 Application with search report
No.:WO2019139431
Date:18.07.2019
Language:KO
[2019/29]
Type: A1 Application with search report 
No.:EP3739477
Date:18.11.2020
Language:EN
[2020/47]
Type: B1 Patent specification 
No.:EP3739477
Date:30.07.2025
Language:EN
[2025/31]
Search report(s)International search report - published on:KR18.07.2019
(Supplementary) European search report - dispatched on:EP23.09.2021
ClassificationIPC:G10L13/033, G10L13/10, G06N3/084, G06N3/044, G06N3/045, G06F40/40, G10L13/047, // G10L13/08, G10L15/26, G10L25/63
[2025/12]
CPC:
G10L13/033 (EP,KR,US); G06F40/58 (KR); G10L13/10 (EP,US);
G06F40/40 (EP,KR,US); G06N3/04 (US); G06N3/044 (EP,US);
G06N3/0442 (EP); G06N3/045 (EP,US); G06N3/0455 (EP);
G06N3/0464 (EP); G06N3/08 (US); G06N3/084 (EP);
G06N3/09 (EP); G10L13/047 (EP,US); G10L13/08 (KR);
G10L13/086 (EP,US); G10L15/02 (KR); G10L15/26 (EP,KR);
G10L25/30 (US); G10L25/63 (EP) (-)
Former IPC [2021/43]G10L13/033, G10L13/10, G10L25/63, G10L15/26, G06N3/04, G06N3/08, // G10L13/08
Former IPC [2020/47]G06F17/28, G10L13/08, G10L13/033, G10L15/26, G10L15/02
Designated contracting statesAL,   AT,   BE,   BG,   CH,   CY,   CZ,   DE,   DK,   EE,   ES,   FI,   FR,   GB,   GR,   HR,   HU,   IE,   IS,   IT,   LI,   LT,   LU,   LV,   MC,   MK,   MT,   NL,   NO,   PL,   PT,   RO,   RS,   SE,   SI,   SK,   SM,   TR [2020/47]  
Extension statesBANot yet paid
MENot yet paid
Validation statesKHNot yet paid
MANot yet paid
MDNot yet paid
TNNot yet paid
TitleGerman:SPRACHÜBERSETZUNGSVERFAHREN UND -SYSTEM UNTER VERWENDUNG EINES MULTILINGUALEN TEXT-ZU-SPRACHE-SYNTHESEMODELLS[2020/47]
English:SPEECH TRANSLATION METHOD AND SYSTEM USING MULTILINGUAL TEXT-TO-SPEECH SYNTHESIS MODEL[2020/47]
French:PROCÉDÉ ET SYSTÈME DE TRADUCTION DE PAROLE À L'AIDE D'UN MODÈLE DE SYNTHÈSE TEXTE-PAROLE MULTILINGUE[2020/47]
Entry into regional phase10.08.2020Translation filed 
10.08.2020National basic fee paid 
10.08.2020Search fee paid 
10.08.2020Designation fee(s) paid 
10.08.2020Examination fee paid 
Examination procedure10.08.2020Examination requested  [2020/47]
12.04.2022Amendment by applicant (claims and/or description)
06.11.2023Despatch of a communication from the examining division (Time limit: M04)
23.02.2024Reply to a communication from the examining division
28.02.2025Communication of intention to grant the patent
23.06.2025Fee for grant paid
23.06.2025Fee for publishing/printing paid
23.06.2025Receipt of the translation of the claim(s)
Fees paidRenewal fee
22.01.2021Renewal fee patent year 03
24.01.2022Renewal fee patent year 04
23.01.2023Renewal fee patent year 05
24.01.2024Renewal fee patent year 06
23.01.2025Renewal fee patent year 07
Opt-out from the exclusive  Tooltip
competence of the Unified
Patent Court
See the Register of the Unified Patent Court for opt-out data
Responsibility for the accuracy, completeness or quality of the data displayed under the link provided lies entirely with the Unified Patent Court.
Lapses during opposition  TooltipES30.07.2025
HR30.07.2025
PL30.07.2025
NO30.10.2025
RS30.10.2025
GR31.10.2025
IS30.11.2025
[2026/11]
Former [2026/10]HR30.07.2025
PL30.07.2025
NO30.10.2025
RS30.10.2025
GR31.10.2025
IS30.11.2025
Former [2026/09]HR30.07.2025
NO30.10.2025
GR31.10.2025
IS30.11.2025
Former [2026/08]HR30.07.2025
NO30.10.2025
IS30.11.2025
Former [2026/07]IS30.11.2025
Documents cited:Search[T] KR20140120560  (SAMSUNG ELECTRONICS CO LTD et al.)
 [A] US2017255616  (YUN SEUNG et al.) [A]
 [Y]   LATORRE J ET AL: "New approach to the polyglot speech generation by means of an HMM-based speaker adaptable synthesizer", SPEECH COMMUNICATION, ELSEVIER SCIENCE PUBLISHERS , AMSTERDAM, NL, vol. 48, no. 10, 1 October 2006 (2006-10-01), pages 1227 - 1242, XP027926287, ISSN: 0167-6393, [retrieved on 20061001]

DOI:   http://dx.doi.org/10.1016/j.specom.2006.05.003
 [Y]   SERCAN ARIK ET AL: "Deep Voice 2: Multi-Speaker Neural Text-to-Speech", 24 May 2017 (2017-05-24), XP055491751, Retrieved from the Internet [retrieved on 20210907]
 [Y]   YOUNGGUN LEE ET AL: "Emotional End-to-End Neural Speech Synthesizer", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 15 November 2017 (2017-11-15), XP080837327 [Y] 1-10 * the whole document *
 [Y]   YU ZHANG ET AL: "Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloning", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 10 July 2019 (2019-07-10), XP081440090 [Y] 1-10 * the whole document *
International search[Y] KR20140120560  (SAMSUNG ELECTRONICS CO LTD et al.) [Y] 1-10
 [A] KR20170103209  (ELECTRONICS & TELECOMMUNICATIONS RES INST et al.) [A] 1-10
 [A] KR20160138837  (KT CORP et al.) [A] 1-10
 [Y]   YOUNGGUN LEE: "Emotional End-to-End Neural Speech Synthesizer", ARXIV:1711.05447, SOUND (CS.SD); COMPUTATION AND LANGUAGE (CS.CL); AUDIO AND SPEECH PROCESSING (EESS.AS, 28 November 2017 (2017-11-28), XP080837327 [Y] 1-10
 [A]   SERCAN ARIK: "Deep Voice 2: Multi-Speaker Neural Text-to-Speech", ARXIV:1705.08947, COMPUTATION AND LANGUAGE, 20 September 2017 (2017-09-20), XP055491751 [A] 1-10
by applicant  DZMITRY BAHDANAU, NEURAL MACHINE TRANSLATION BY JOINTLY LEARNING TO ALIGN AND TRANSLATE, 2015
   MINH-THANG LUONG, EFFECTIVE APPROACHES TO ATTENTION-BASED NEURAL MACHINE TRANSLATION, 2015 [Y] 1-10
   ILYA SUTSKEVER ET AL., SEQUENCE TO SEQUENCE LEARNING WITH NEURAL NETWORKS, 2014
The EPO accepts no responsibility for the accuracy of data originating from other authorities; in particular, it does not guarantee that it is complete, up to date or fit for specific purposes.