blank Quick help
blank Maintenance news

Scheduled maintenance

Regular maintenance outages:
between 05.00 and 05.15 hrs CET (Monday to Sunday).

Other outages
Availability
Register Forum

2022.02.11

More...
blank News flashes

News Flashes

New version of the European Patent Register – SPC proceedings information in the Unitary Patent Register.

2024-07-24

More...
blank Related links

Release notes
European Patent Register Assistant
European Patent Register Resource Book
European Patent Register – pocket guide
FAQ - European Patent Register
FAQ - Register Alert
Federated Register (Flyer)
Global Dossier (Flyer)
Register events
Deep link coverage
Federated Register content
The Patent Information Tour
Fair use charter

Extract from the Register of European Patents

EP About this file: EP4034840

EP4034840 - SYSTEM AND METHOD FOR NAVIGATING A VEHICLE USING LANGUAGE INSTRUCTIONS [Right-click to bookmark this link]
StatusThe patent has been granted
Status updated on  12.01.2024
Database last updated on 24.08.2024
FormerGrant of patent is intended
Status updated on  21.08.2023
FormerRequest for examination was made
Status updated on  01.07.2022
FormerThe international publication has been made
Status updated on  03.04.2021
Formerunknown
Status updated on  08.10.2019
Most recent event   Tooltip08.08.2024Lapse of the patent in a contracting state
New state(s): SE		published on 11.09.2024 [2024/37]
Applicant(s)For all designated states
Toyota Motor Europe
Avenue du Bourget 60
1140 Brussels / BE
For all designated states
ETH Zurich - The Swiss Federal Institute of Technology Zurich
Raemistrasse 101
8092 Zurich / CH
[2022/31]
Inventor(s)01 / ABBELOOS, Wim
c/o TOYOTA MOTOR EUROPE Technical Strategic
Planning Operation Avenue du Bourget 60
1140 BRUSSELS / BE
02 / DAI, Dengxin
c/o ETH Zurich THE SWISS FEDERAL INSTITUTE OF
TECHNOLOGY ZURICH Raemistrasse 101
8092 ZURICH / CH
03 / VASUDEVAN, Arun, Balajee
c/o ETH Zurich THE SWISS FEDERAL INSTITUTE OF
TECHNOLOGY ZURICH Raemistrasse 101
8092 ZURICH / CH
04 / VAN GOOL, Luc
c/o ETH Zurich THE SWISS FEDERAL INSTITUTE OF
TECHNOLOGY ZURICH Raemistrasse 101
8092 ZURICH / CH
 [2022/31]
Representative(s)Cabinet Beau de Loménie
158, rue de l'Université
75340 Paris Cedex 07 / FR
[2022/31]
Application number, filing date19778944.924.09.2019
[2022/31]
WO2019EP75704
Filing languageEN
Procedural languageEN
PublicationType: A1 Application with search report
No.:WO2021058090
Date:01.04.2021
Language:EN
[2021/13]
Type: A1 Application with search report 
No.:EP4034840
Date:03.08.2022
Language:EN
The application published by WIPO in one of the EPO official languages on 01.04.2021 takes the place of the publication of the European patent application.
[2022/31]
Type: B1 Patent specification 
No.:EP4034840
Date:14.02.2024
Language:EN
[2024/07]
Search report(s)International search report - published on:EP01.04.2021
ClassificationIPC:G01C21/36
[2022/31]
CPC:
G06N3/084 (EP); G01C21/3629 (EP); G01C21/3644 (EP);
G06N3/044 (EP); G06N3/045 (EP); G06N3/047 (EP)
Designated contracting statesAL,   AT,   BE,   BG,   CH,   CY,   CZ,   DE,   DK,   EE,   ES,   FI,   FR,   GB,   GR,   HR,   HU,   IE,   IS,   IT,   LI,   LT,   LU,   LV,   MC,   MK,   MT,   NL,   NO,   PL,   PT,   RO,   RS,   SE,   SI,   SK,   SM,   TR [2022/31]
Extension statesBANot yet paid
MENot yet paid
Validation statesKHNot yet paid
MANot yet paid
MDNot yet paid
TNNot yet paid
TitleGerman:SYSTEM UND VERFAHREN ZUM LENKEN EINES FAHRZEUGS DURCH SPRACHBEFEHLE[2022/31]
English:SYSTEM AND METHOD FOR NAVIGATING A VEHICLE USING LANGUAGE INSTRUCTIONS[2022/31]
French:SYSTÈME ET PROCÉDÉ DE PILOTAGE D'UN VÉHICULE A L'AIDE D'INSTRUCTIONS DE LANGAGE[2022/31]
Entry into regional phase10.03.2022National basic fee paid 
10.03.2022Designation fee(s) paid 
10.03.2022Examination fee paid 
Examination procedure10.03.2022Examination requested  [2022/31]
10.03.2022Date on which the examining division has become responsible
14.11.2022Amendment by applicant (claims and/or description)
22.08.2023Communication of intention to grant the patent
29.12.2023Fee for grant paid
29.12.2023Fee for publishing/printing paid
29.12.2023Receipt of the translation of the claim(s)
Fees paidRenewal fee
10.03.2022Renewal fee patent year 03
20.09.2022Renewal fee patent year 04
22.09.2023Renewal fee patent year 05
Opt-out from the exclusive  Tooltip
competence of the Unified
Patent Court		 See the Register of the Unified Patent Court for opt-out data
Responsibility for the accuracy, completeness or quality of the data displayed under the link provided lies entirely with the Unified Patent Court.
Lapses during opposition  TooltipAT14.02.2024
BG14.02.2024
ES14.02.2024
FI14.02.2024
HR14.02.2024
LT14.02.2024
LV14.02.2024
NL14.02.2024
PL14.02.2024
SE14.02.2024
NO14.05.2024
RS14.05.2024
GR15.05.2024
IS14.06.2024
PT14.06.2024
[2024/37]
Former [2024/36]AT14.02.2024
BG14.02.2024
ES14.02.2024
FI14.02.2024
HR14.02.2024
LT14.02.2024
LV14.02.2024
NL14.02.2024
PL14.02.2024
NO14.05.2024
RS14.05.2024
GR15.05.2024
IS14.06.2024
PT14.06.2024
Former [2024/35]AT14.02.2024
BG14.02.2024
ES14.02.2024
FI14.02.2024
HR14.02.2024
LT14.02.2024
NL14.02.2024
NO14.05.2024
RS14.05.2024
GR15.05.2024
IS14.06.2024
Former [2024/34]BG14.02.2024
FI14.02.2024
HR14.02.2024
LT14.02.2024
NL14.02.2024
NO14.05.2024
RS14.05.2024
GR15.05.2024
IS14.06.2024
Former [2024/33]LT14.02.2024
NO14.05.2024
IS14.06.2024
Former [2024/32]IS14.06.2024
Cited inInternational search[IA]US2017314954  (GOLDING ANDREW R [US], et al) [I] 11-15 * paragraphs [0036] , [0 37] , [0 40] , [0 51] , [0 58] , [0 69] - [0071]; figures 1, 2; claim 1 *[A] 1-10
by applicant   - AGRAWAL, A.LU, J.ANTOL, S.MITCHELL, M.ZITNICK, C.L.PARIKH, D.BATRA, D., "Vqa: Visual question answering", International Journal of Computer Vision, (20170000), vol. 123, no. 1, doi:doi:10.1007/s11263-016-0966-6, pages 4 - 31, XP036221792

DOI:   http://dx.doi.org/10.1007/s11263-016-0966-6
    - WORTSMAN, M.EHSANI, K.RASTEGARI, M.FARHADI, A.MOTTAGHI, R., "Learning to learn how to learn: Self-adaptive visual navigation using meta-learning", The IEEE Conference on Computer Vision and Pattern Recognition (CVPR
    - HOLSCHER, C.TENBRINK, T.WIENER, J.M., "Would you follow your own route description? cognitive strategies in urban route planning", Cognition, (20110000), vol. 121, no. 2, doi:doi:10.1016/j.cognition.2011.06.005, pages 228 - 247, XP028389860

DOI:   http://dx.doi.org/10.1016/j.cognition.2011.06.005
    - MILLONIG, A.SCHECHTNER, K., "Developing landmark-based pedestrian-navigation systems", IEEE Transactions on Intelligent Transportation Systems, (20070000), vol. 8, no. 1, doi:doi:10.1109/TITS.2006.889439, pages 43 - 49, XP011171951

DOI:   http://dx.doi.org/10.1109/TITS.2006.889439
    - XU, K.BA, J.KIROS, R.CHO, K.COURVILLE, A.SALAKHUDINOV, R.ZEMEL, R.BENGIO, Y., "Show, attend and tell: Neural image caption generation with visual attention", International conference on machine learning, (20150000), pages 2048 - 2057
    - VASWANI, A.SHAZEER, N.PARMAR, N.USZKOREIT, J.JONES, L.GOMEZ, A.N.KAISER, L.POLOSUKHIN, I., "Attention is all you need", Advances in Neural Information Processing Systems, (20170000), pages 5998 - 6008
    - KUMAR, A.GUPTA, S.FOUHEY, D.LEVINE, S.MALIK, J., "Visual memory for robust path following", Advances in Neural Information Processing Systems
    - ZHU, X.LI, L.LIU, J.PENG, H.NIU, X., "Captioning transformer with stacked attention modules", Applied Sciences, (20180000), vol. 8, no. 5, page 739
    - B. COORSA. PAUL CONDURACHEA. GEIGER, "Spherenet: Learning spherical representations for detection and classification in omnidirectional images", Proceedings of the European Conference on Computer Vision (ECCV, (20180000), pages 518 - 533
    - LECUN, Y.BOTTOU, L.BENGIO, Y.HAFFNER, P. et al., "Gradient-based learning applied to document recognition", Proceedings of the IEEE, (19980000), vol. 86, no. 11, doi:doi:10.1109/5.726791, pages 2278 - 2324, XP000875095

DOI:   http://dx.doi.org/10.1109/5.726791
The EPO accepts no responsibility for the accuracy of data originating from other authorities; in particular, it does not guarantee that it is complete, up to date or fit for specific purposes.