hh.sePublikationer
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Lifelong Visual Localization for Automated Vehicles
Högskolan i Halmstad, Akademin för informationsteknologi, Halmstad Embedded and Intelligent Systems Research (EIS), CAISR Centrum för tillämpade intelligenta system (IS-lab). Volkswagen AG.
2015 (Engelska)Doktorsavhandling, sammanläggning (Övrigt vetenskapligt)
Abstract [en]

Automated driving can help solve the current and future problems of individualtransportation. Automated valet parking is a possible approach to help with overcrowded parking areas in cities and make electric vehicles more appealing. In an automated valet system, drivers are able to drop off their vehicle close to a parking area. The vehicle drives to a free parking spot on its own, while the driver is free to perform other tasks — such as switching the mode of transportation. Such a system requires the automated car to navigate unstructured, possibly three dimensional areas. This goes beyond the scope ofthe tasks performed in the state of the art for automated driving.

This thesis describes a visual localization system that provides accuratemetric pose estimates. As sensors, the described system uses multiple monocular cameras and wheel-tick odometry. This is a sensor set-up that is close to what can be found in current production cars. Metric pose estimates with errors in the order of tens of centimeters enable maneuvers such as parking into tight parking spots. This system forms the basis for automated navigationin the EU-funded V-Charge project.

Furthermore, we present an approach to the challenging problem of life-long mapping and localization. Over long time spans, the visual appearance ofthe world is subject to change due to natural and man-made phenomena. The effective long-term usage of visual maps requires the ability to adapt to these changes. We describe a multi-session mapping system, that fuses datasets intoiiia single, unambiguous, metric representation. This enables automated navigation in the presence of environmental change. To handle the growing complexityof such a system we propose the concept of Summary Maps, which contain a reduced set of landmarks that has been selected through a combination of scoring and sampling criteria. We show that a Summary Map with bounded complexity can achieve accurate localization under a wide variety of conditions.

Finally, as a foundation for lifelong mapping, we propose a relational database system. This system is based on use-cases that are not only concerned with solving the basic mapping problem, but also with providing users with a better understanding of the long-term processes that comprise a map. We demonstrate that we can pose interesting queries to the database, that help us gain a better intuition about the correctness and robustness of the created maps. This is accomplished by answering questions about the appearance and distribution of visual landmarks that were used during mapping. This thesis takes on one of the major unsolved challenges in vision-based localization and mapping: long-term operation in a changing environment. We approach this problem through extensive real world experimentation, as well as in-depth evaluation and analysis of recorded data. We demonstrate that accurate metric localization is feasible both during short term changes, as exemplified by the transition between day and night, as well as longer term changes, such as due to seasonal variation.

Ort, förlag, år, upplaga, sidor
Halmstad: Halmstad University Press , 2015. , s. 74
Serie
Halmstad University Dissertations ; 12
Nyckelord [en]
vision-based localization, automated vehicles
Nationell ämneskategori
Elektroteknik och elektronik
Identifikatorer
URN: urn:nbn:se:hh:diva-28239ISBN: 978-91-87045-27-1 ISBN: 978-91-87045-26-4 OAI: oai:DiVA.org:hh-28239DiVA, id: diva2:811409
Disputation
2015-05-13, Wigforssalen, Visionen, Kristian IV:s väg 3, 301 18, Halmstad, 13:15 (Engelska)
Opponent
Handledare
Tillgänglig från: 2015-05-12 Skapad: 2015-05-11 Senast uppdaterad: 2016-01-08Bibliografiskt granskad
Delarbeten
1. Evaluation of Fisheye-Camera Based Visual Multi-Session Localization in a Real-World Scenario
Öppna denna publikation i ny flik eller fönster >>Evaluation of Fisheye-Camera Based Visual Multi-Session Localization in a Real-World Scenario
2013 (Engelska)Ingår i: Intelligent Vehicles Symposium (IV), 2013 IEEE Workshop on Environment Perception and Navigation for Intelligent Vehicles, Piscataway, NJ: IEEE Operations Center , 2013, s. 57-62Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

The European V-Charge project seeks to develop fully automated valet parking and charging of electric vehicles using only low-cost sensors. One of the challenges is to implement robust visual localization using only cameras and stock vehicle sensors. We integrated four monocular, wide-angle, fisheye cameras on a consumer car and implemented a mapping and localization pipeline. Visual features and odometry are combined to build and localize against a keyframe-based three dimensional map. We report results for the first stage of the project, based on two months worth of data acquired under varying conditions, with the objective of localizing against a map created offline. © 2013 IEEE.

Ort, förlag, år, upplaga, sidor
Piscataway, NJ: IEEE Operations Center, 2013
Serie
IEEE Intelligent Vehicles Symposium, ISSN 1931-0587
Nyckelord
Fish-eye cameras, Fully automated, Low-cost sensors, Mapping and localization, Real-world scenario, Three-dimensional maps, Vehicle sensors, Visual localization
Nationell ämneskategori
Datorseende och robotik (autonoma system)
Identifikatorer
urn:nbn:se:hh:diva-23382 (URN)10.1109/IVS.2013.6629447 (DOI)000333750200010 ()2-s2.0-84892396299 (Scopus ID)978-1-4673-2754-1 (ISBN)
Konferens
IEEE Intelligent Vehicles Symposium, June 23-26, 2013, Gold Cost, Australia
Tillgänglig från: 2013-08-20 Skapad: 2013-08-20 Senast uppdaterad: 2018-01-11Bibliografiskt granskad
2. Summary Maps for Lifelong Visual Localization
Öppna denna publikation i ny flik eller fönster >>Summary Maps for Lifelong Visual Localization
Visa övriga...
2016 (Engelska)Ingår i: Journal of Field Robotics, ISSN 1556-4959, E-ISSN 1556-4967, Vol. 33, nr 5, s. 561-590Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

Robots that use vision for localization need to handle environments which are subject to seasonal and structural change, and operate under changing lighting and weather conditions. We present a framework for lifelong localization and mapping designed to provide robust and metrically accurate online localization in these kinds of changing environments. Our system iterates between offline map building, map summary, and online localization. The offline mapping fuses data from multiple visually varied datasets, thus dealing with changing environments by incorporating new information. Before passing this data to the online localization system, the map is summarized, selecting only the landmarks that are deemed useful for localization. This Summary Map enables online localization that is accurate and robust to the variation of visual information in natural environments while still being computationally efficient.

We present a number of summary policies for selecting useful features for localization from the multi-session map and explore the tradeoff between localization performance and computational complexity. The system is evaluated on 77 recordings, with a total length of 30 kilometers, collected outdoors over sixteen months. These datasets cover all seasons, various times of day, and changing weather such as sunshine, rain, fog, and snow. We show that it is possible to build consistent maps that span data collected over an entire year, and cover day-to-night transitions. Simple statistics computed on landmark observations are enough to produce a Summary Map that enables robust and accurate localization over a wide range of seasonal, lighting, and weather conditions. © 2015 Wiley Periodicals, Inc.

Ort, förlag, år, upplaga, sidor
Hoboken, NJ: John Wiley & Sons, 2016
Nyckelord
Field robotics
Nationell ämneskategori
Robotteknik och automation
Identifikatorer
urn:nbn:se:hh:diva-27978 (URN)10.1002/rob.21595 (DOI)000380103400001 ()2-s2.0-84931069651 (Scopus ID)
Forskningsfinansiär
EU, FP7, Sjunde ramprogrammet, 269916EU, FP7, Sjunde ramprogrammet, 610603
Anmärkning

This work is supported in part by the European Community’s Seventh Framework Programme (FP7/2007-2013) under Grants No. 269916 (V-Charge) and No. 610603 (EUROPA2).

Tillgänglig från: 2015-03-12 Skapad: 2015-03-12 Senast uppdaterad: 2017-11-30Bibliografiskt granskad
3. Designing a Relational Database for Long-Term Visual Mapping
Öppna denna publikation i ny flik eller fönster >>Designing a Relational Database for Long-Term Visual Mapping
(Engelska)Manuskript (preprint) (Övrigt vetenskapligt)
Abstract [en]

We present a map architecture based on a relational database that helps tackle the challenge of lifelong visuallocalization and mapping. The proposed design is rooted in a set of use-cases that describe the processes necessary for creating, using and analyzing visual maps. Our database and software architecture effectively expresses the requiredinteractions between map elements, such as visual frames generated by multi-camera systems. One of the major strengths of the proposed system is the ease of formulating pertinent and novel queries. We show how these queries can help us gaina better intuition about the map contents, taking into account complex data associations, even as session upon session is added to the map. Furthermore, we demonstrate how referential integrity checks, rollbacks and similar features of relational database management systems are beneficial for building long-term maps. Based on our experience with the proposed system during one year of intensive data collection and analysis, we discuss key lessons learned and indicate directions for evolving its design. These lessons show the importance of using higher relational normal forms to make the database schema even more useful for querying, as well as the need for a distributed, versioned system.

Nyckelord
Relational Databases, Visual Localization, Mapping, Automated Vehicles
Nationell ämneskategori
Elektroteknik och elektronik
Identifikatorer
urn:nbn:se:hh:diva-28240 (URN)
Anmärkning

Submitted to: Journal of Software Engineering for Robotics, issn: 2035-3928

Tillgänglig från: 2015-05-11 Skapad: 2015-05-11 Senast uppdaterad: 2016-02-23Bibliografiskt granskad

Open Access i DiVA

fulltext(1413 kB)1546 nedladdningar
Filinformation
Filnamn FULLTEXT01.pdfFilstorlek 1413 kBChecksumma SHA-512
2e0e11f9be60d8c00062fb4268c76a19f511882793076b2eacbc36310180322794576333716a99b6081af9cbc677d329519dcd5bcd769c0bc8fe6e7e1c9ce2ef
Typ fulltextMimetyp application/pdf

Av organisationen
CAISR Centrum för tillämpade intelligenta system (IS-lab)
Elektroteknik och elektronik

Sök vidare utanför DiVA

GoogleGoogle Scholar
Totalt: 1546 nedladdningar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

isbn
urn-nbn

Altmetricpoäng

isbn
urn-nbn
Totalt: 4014 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf