Consider a robot navigating the bustling aisles of a warehouse, swiftly picking up and delivering items. It must decide how quickly to move and how much space to leave when turning corners to avoid accidents, like clipping a shelf and causing a cascade of items. For this, the robot relies on its localisation module which integrates data from its sensors, such as cameras, lidars and wheel odometry, and combines this with a prebuilt map of the environment to pinpoint its precise location. The localisation system must not only output its position but also assess how confident it is in its estimate. This confidence, quantified by something called covariance, is crucial. Accurate location data is essential, but so is the robot’s certainty about this data. If the robot misjudges its certainty, being either too confident or too cautious, it could lead to reckless behaviour or to an overly hesitant and inefficient system.

Covariance

Rather than relying on a single, precise location estimate, our localisation system instead outputs an entire probability distribution. Covariance, which comes from modelling our estimate as a Gaussian distribution, extends the concept of variance to multiple dimensions. It is represented as a matrix and captures both the notion of how spread out our estimates are, as well as the correlation between the different aspects of the robot’s pose such as the x and y coordinates. A larger covariance indicates a wider spread, signalling greater uncertainty: the robot’s true location could fall within a broader range of values.

(Image: two Gaussian distributions each represented by 500 samples and an ellipse depicting the 90% confidence region. The blue distribution has a much smaller covariance than the red distribution, indicating a more certain position estimate.)

Effective decision making relies heavily on covariance. The system needs to determine if its confidence in its location estimate is sufficient to proceed with its current task, or if it must take corrective action and attempt to reduce its position uncertainty. Path planners can take pose covariance as input, and this allows them to adjust movement speed as well as path safety margins.

Covariance also plays a vital role when integrating measurements from different sensors or combining pose estimates output from various internal modules, offering a systematic way to appropriately weight this information. Higher confidence data will be given more weight. This ensures that the most reliable information has the greatest influence on the system’s overall pose estimate.

It is important that the covariance that is output accurately reflects the true level of uncertainty. An overconfident could be dangerous, and a system that is too underconfident might be too inefficient.

Overconfidence

The system is overconfident if it assumes it’s location and map are more accurate than they actually are. The output pose covariance will be smaller than it ought to be, meaning the system is underestimating the probability that its actual location could be further away from where it thinks it is.

This can lead to underestimating new information. If it believes in its current pose estimate too strongly, it may undervalue new, especially conflicting, data. As a consequence it might resist adapting to new situations. This could even lead it to disregard corrective information, potentially preventing it ultimately from reducing error.

An overconfident might cause the robot to exhibit risky behaviours such as travelling too quickly, or not leaving enough obstacle clearance. This could potentially result in dangerous situations, such as collisions or the robot getting stuck.

Underconfidence

Conversely, an underconfident system will be excessively cautious regarding the quality of its pose estimate, resulting in an excessively large covariance. This means it is exaggerating the likelihood that its true location is significantly different from its estimated position.

This would likely result in reduced efficiency, or increased running times as a result from overly cautious behaviours. For example the robot might move at a ridiculously slow pace, or it might repeatedly keep deciding it requires additional data and processing time to confirm already known information.

Understanding covariance quality

It is therefore imperative that we are able to analyse and understand the quality of the covariance estimates that the system, or any of its internal modules, produces. A good covariance should accurately model the probability: the “true” pose should be contained inside the estimated covariance’s 90% confidence region 90% of the time. It is realistic to expect some degree of degradation in the covariance quality because the system is nonlinear. This means the true probability distribution, in general, can’t be perfectly modelled as a Gaussian distribution, so the Gaussian representation will necessarily be an approximation.

To perform this analysis we look at the system’s performance over a large variety of datasets, and compare it to ground-truth. Internally at Kudan we are continuing to explore better ways of measuring and visualising covariance quality, as well as trying to understand which variables have the most significant impact on covariance quality.

Once a system’s covariance quality is understood, the next step is to use this information to calibrate the uncertainty estimation: adjusting the estimated covariance in order to better represent the true uncertainty.

Closing thoughts

The management of uncertainty through covariance is fundamental to the operational success of mobile robots, ensuring both safety and efficiency in dynamic environments such as warehouses. By refining our understanding and calibration of covariance estimates, we continue pushing closer to finding the right balance between avoiding the pitfalls of dangerous overconfidence, and the inefficiencies of undue caution.

Please contact us for learning further technical information

The post Understanding Covariance Quality in Robot Localisation first appeared on Kudan global.

Kudan and Artisense sponsored the successful first workshop on “Map-based Localization for Autonomous Driving” (MLAD), which took place at the European Conference on Computer Vision (ECCV) last August 2020.

This coming workshop is the second edition. Despite the progress over the last few years, there still remain numerous questions in the field of map-based localization. Questions include the ability to efficiently and at a low cost generate maps at a significantly large scale, and more importantly, how those maps can be kept up-to-date. We will explore and answer these questions.

Confirmed speakers for this workshop include Wolfram Burgard (University of Freiburg, Toyota Research Institute), Michael Milford (Queensland University of Technology) and Torstens Sattler (Czech Technical University), with several more speakers to be expected.

The workshop will host the relocalization challenge once again based on the “4Seasons” dataset, a new multi-weather, all-seasons dataset recorded using Artisense’s Visual Inertial Navigation System (VINS). This dataset aims to enable research in robust vision-based odometry, as well as map-based localization.

Kudan and Artisense will continue to promote the further development of SLAM and localization technology in the area of autonomous driving, together with leading internal and external experts in this area.

For more details on the workshop and topics covered, please visit here.
We look forward to great discussion and promising new concepts for map-based relocalization!

About Artisense Corporation
Artisense is a computer vision and sensor fusion software company that develops an integrated positioning platform using cameras as lead sensors for the automation of robots, vehicles, and spatial intelligence applications. On a mission to accelerate the adoption of autonomous robots and machines, Artisense provides products and technology for highly accurate, robust, safe, and low-cost navigation in any space.
For more information, please refer to Artisense’s website at http://www.artisense.ai/.

About Kudan Inc.
Kudan (Tokyo Stock Exchange securities code: 4425) is a Deep Tech research and development company specializing in algorithms to enable artificial perception (AP). As a complement to artificial intelligence (AI), AP functions allow machines to develop autonomy. Currently, Kudan is using its high-level technical innovation to explore business areas based on its milestone models established for Deep Tech, which provide wide-ranging impact on several major industrial fields. For more information, please refer to Kudan’s website at https://www.kudan.io/.

■Company Details
Name: Kudan Inc.
Securities Code: 4425
Representative: CEO Daiu Ko

The post Kudan to sponsor the upcoming ICCV workshop: “Map-based Localization for Autonomous Driving” together with Artisense in October 2021 first appeared on Kudan global.