blank Quick help
blank Maintenance news

Scheduled maintenance

Regular maintenance outages:
between 05.00 and 05.15 hrs CET (Monday to Sunday).

Other outages
Availability

2022.02.11

More...
blank News flashes

News Flashes

New version of the European Patent Register – SPC proceedings information in the Unitary Patent Register.

2024-07-24

More...
blank Related links

Extract from the Register of European Patents

EP About this file: EP3888005

EP3888005 - SYSTEM AND METHOD FOR CONVERTING IMAGE DATA INTO A NATURAL LANGUAGE DESCRIPTION [Right-click to bookmark this link]
StatusThe application is deemed to be withdrawn
Status updated on  27.06.2024
Database last updated on 19.10.2024
FormerExamination is in progress
Status updated on  09.11.2023
FormerRequest for examination was made
Status updated on  03.09.2021
FormerThe international publication has been made
Status updated on  06.06.2020
Most recent event   Tooltip27.06.2024Application deemed to be withdrawnpublished on 31.07.2024  [2024/31]
Applicant(s)For all designated states
Sony Interactive Entertainment Inc.
1-7-1, Konan
Minato-ku
Tokyo 108-0075 / JP
[N/P]
Former [2021/40]For all designated states
Sony Interactive Entertainment Inc.
1-7-1 Konan
Minato-ku
Tokyo 108-0075 / JP
Inventor(s)01 / ZHENG, Jian
2207 Bridgepointe Parkway
San Mateo, California 94404 / US
02 / CHEN, Ruxin
2207 Bridgepointe Parkway
San Mateo, California 94404 / US
 [2021/40]
Representative(s)D Young & Co LLP
3 Noble Street
London EC2V 7BQ / GB
[N/P]
Former [2021/40]D Young & Co LLP
120 Holborn
London EC1N 2DY / GB
Application number, filing date19888898.426.11.2019
[2021/40]
WO2019US63298
Priority number, dateUS20181620643930.11.2018         Original published format: US201816206439
[2021/40]
Filing languageEN
Procedural languageEN
PublicationType: A1 Application with search report
No.:WO2020112808
Date:04.06.2020
Language:EN
[2020/23]
Type: A1 Application with search report 
No.:EP3888005
Date:06.10.2021
Language:EN
The application published by WIPO in one of the EPO official languages on 04.06.2020 takes the place of the publication of the European patent application.
[2021/40]
Search report(s)International search report - published on:US04.06.2020
(Supplementary) European search report - dispatched on:EP27.09.2022
ClassificationIPC:G06N3/04, G06K9/62, G06V10/44, G06V10/82, G06V10/764, // G06N3/08
[2022/43]
CPC:
G06V10/454 (EP,US); G06F16/383 (US); G06F16/583 (US);
G06F18/2413 (EP); G06N3/045 (EP); G06N5/046 (US);
G06V10/764 (EP,US); G06V10/82 (EP,US); G06N3/044 (EP);
G06N3/08 (EP) (-)
Former IPC [2021/40]G06K9/00, G06K9/46, H04N5/278
Designated contracting statesAL,   AT,   BE,   BG,   CH,   CY,   CZ,   DE,   DK,   EE,   ES,   FI,   FR,   GB,   GR,   HR,   HU,   IE,   IS,   IT,   LI,   LT,   LU,   LV,   MC,   MK,   MT,   NL,   NO,   PL,   PT,   RO,   RS,   SE,   SI,   SK,   SM,   TR [2021/40]
TitleGerman:SYSTEM UND VERFAHREN ZUR UMWANDLUNG VON BILDDATEN IN EINE BESCHREIBUNG IN NATÜRLICHER SPRACHE[2021/40]
English:SYSTEM AND METHOD FOR CONVERTING IMAGE DATA INTO A NATURAL LANGUAGE DESCRIPTION[2021/40]
French:SYSTÈME ET PROCÉDÉ DE CONVERSION DE DONNÉES D'IMAGE EN UNE DESCRIPTION DE LANGAGE NATUREL[2021/40]
Entry into regional phase16.05.2021National basic fee paid 
16.05.2021Search fee paid 
16.05.2021Designation fee(s) paid 
16.05.2021Examination fee paid 
Examination procedure16.05.2021Examination requested  [2021/40]
25.01.2023Amendment by applicant (claims and/or description)
08.11.2023Despatch of a communication from the examining division (Time limit: M04)
12.03.2024Application deemed to be withdrawn, date of legal effect  [2024/31]
04.04.2024Despatch of communication that the application is deemed to be withdrawn, reason: reply to the communication from the examining division not received in time  [2024/31]
Fees paidRenewal fee
29.11.2021Renewal fee patent year 03
28.11.2022Renewal fee patent year 04
27.11.2023Renewal fee patent year 05
Opt-out from the exclusive  Tooltip
competence of the Unified
Patent Court
See the Register of the Unified Patent Court for opt-out data
Responsibility for the accuracy, completeness or quality of the data displayed under the link provided lies entirely with the Unified Patent Court.
Documents cited:Search[IY]  - Chen Long ET AL, "SCA-CNN: Spatial and Channel-Wise Attention in Convolutional Networks for Image Captioning", arXiv.org, (20170412), pages 1 - 9, URL: https://arxiv.org/pdf/1611.05594.pdf, (20220909), XP055959325 [I] 1-5,8,13-15 * figure 2 * * sections 3 and 4.2 * [Y] 6,7,9-12
 [Y]  - Kaiming He ET AL, "Deep Residual Learning for Image Recognition", doi:10.1109/CVPR.2016.90, (20151210), pages 1 - 12, URL: https://arxiv.org/pdf/1512.03385.pdf, (20200724), XP055717904 [Y] 6,7,9-12 * figures 3, 5 * * page 7, left-hand side, second paragraph;; table 1 *

DOI:   http://dx.doi.org/10.1109/CVPR.2016.90
International search[A]US2017200065  (WANG ZHAOWEN [US], et al) [A] 1-16* , entire document *;
 [A]US2018005082  (BLUCHE THEODORE DAMIEN CHRISTIAN [FR]) [A] 1-16 * , entire document *;
 [Y]US2018121734  (MIN RENQIANG [US], et al) [Y] 1-16 * , entire document, especially Abstract; para [0070]-[0072], [0075], [0084]-[0087] *;
 [Y]  - ANDERSON et al., "Bottom-Up and Top-Down Attention for Image Captioning and VQA", In: Cornell University Library/ Computer Science /Computer Vision and Pattern Recognition, (20180618), pages 6077 - 6086, XP033473523 [Y] 1-16 * , entire document, especially Abstract; page 2-6 *

DOI:   http://dx.doi.org/10.1109/CVPR.2018.00636
The EPO accepts no responsibility for the accuracy of data originating from other authorities; in particular, it does not guarantee that it is complete, up to date or fit for specific purposes.