Tuesday, June 8, 2021

Robots Rejoice: Researchers Create a Camera That Knows Exactly Where It Is

Researchers from the University of Bristol have demonstrated how a new special type of camera can build a pictorial map of where it has been and use this map to know where it currently is, something that will be incredibly useful in the development of smart sensors, driverless cars and robotics.

Overview of the on-sensor mapping. The system moves around and as it does it builds a visual catalogue of what it observes. This is the map that is later used to know if it has been there before.
Credit: University of Bristol


Knowing where you are on a map is one of the most useful pieces of information when navigating journeys. It allows you to plan where to go next and also tracks where you have been before. This is essential for smart devices from robot vacuum cleaners to delivery drones to wearable sensors keeping an eye on our health.

But one important obstacle is that systems that need to build or use maps are very complex and commonly rely on external signals like GPS that do not work indoors, or require a great deal of energy due to the large number of components involved.


Right: the system moves around the world, Left: A new image is seen and a decision is made to add it or not to the visual catalogue (top left), this is the pictorial map that can then be used to localise the system later.
Credit: University of Bristol

Walterio Mayol-Cuevas, Professor in Robotics, Computer Vision and Mobile Systems at the University of Bristol’s Department of Computer Science, led the team that has been developing this new technology.

He said: “We often take for granted things like our impressive spatial abilities. Take bees or ants as an example. They have been shown to be able to use visual information to move around and achieve highly complex navigation, all without GPS or much energy consumption.

“In great part this is because their visual systems are extremely efficient and well-tuned to making and using maps, and robots can't compete there yet.”

During localisation the incoming image is compared to the visual catalogue (Descriptor database) and if a match is found, the system will tell where it is (Predicted node, small white rectangle at the top) relative to the catalogue. Note how the system is able to match images even if there are changes in illumination or objects like people moving.


Credit: University of Bristol

However, a new breed of sensor-processor devices that the team calls Pixel Processor Array (PPA), allow processing on-sensor. This means that as images are sensed, the device can decide what information to keep, what information to discard and only use what it needs for the task at hand.

An example of such PPA device is the SCAMP architecture that has been developed by the team’s colleagues at the University of Manchester by Piotr Dudek, Professor of Circuits and Systems from the University of Manchester and his team. This PPA has one small processor for every pixel which allows for massively parallel computation on the sensor itself.

The team at the University of Bristol has previously demonstrated how these new systems can recognise objects at thousands of frames per second but the new research shows how a sensor-processor device can make maps and use them, all at the time of image capture.

This work was part of the MSc dissertation of Hector Castillo-Elizalde, who did his MSc in Robotics at the University of Bristol. He was co-supervised by Yanan Liu who is also doing his PhD on the same topic and Dr Laurie Bose.

Hector Castillo-Elizalde and the team developed a mapping algorithm that runs all on-board the sensor-processor device.

The algorithm is deceptively simple: when a new image arrives, the algorithm decides if it is sufficiently different to what it has seen before. If it is, it will store some of its data, if not it will discard it.

As the PPA device is moved around by for example a person or robot, it will collect a visual catalogue of views. This catalogue can then be used to match any new image when it is in the mode of localisation.

Importantly, no images go out of the PPA, only the key data that indicates where it is with respect to the visual catalogue. This makes the system more energy efficient and also helps with privacy.

The team believes that this type of artificial visual systems that are developed for visual processing, and not necessarily to record images, is a first step towards making more efficient smart systems that can use visual information to understand and move in the world. Tiny, energy efficient robots or smart glasses doing useful things for the planet and for people will need spatial understanding, which will come from being able to make and use maps.

The research has been partially funded by the Engineering and Physical Sciences Research Council (EPSRC), by a CONACYT scholarship to Hector Castillo-Elizalde and a CSC scholarship to Yanan Liu.





Contacts and sources:
University of Bristol

 

Publication: This work is the subject of a paper that has been accepted for publication in the IEEE International Conference on Robotics and Automation (ICRA) 2021. One of the main annual academic conferences covering advances in robotics.

Instant savings on Body & Mind Wellness package-upgrade your body immunity & brain power today! Immunity, Improved Gut Health, Better Nutrition!

16 comments:

  1. Functional Medicine KL that brings together conventional medicine, nutritional medicine, and bio-identical hormone therapy to restore health and enhance youth. Our doctors are here to educate, inspire & empower you to make better decisions regarding your health.

    ReplyDelete
  2. This is another testimony on how Chief Dr Lucky cured my HIV disease. Do you need a cure for your HIV disease? Do you want to be cured from your cancer disease? Or you want to be free from any type of disease. Kindly visit https://chiefdrluckyherbaltherapy.wordpress.com/ . He just cured my HIV disease and I’m very grateful to him, he is the only herbalist that can cure you.
    WhatsApp number : +2348132777335
    Via Email : chiefdrlucky@gmail.com
    Thank you all for reading,
    God bless"

    ReplyDelete
  3. I'm 40 years old female I tested genital herpes (HSV1-2) positive in 2016. I was having bad outbreaks. EXTREMELY PAINFUL. I have try different kinds of drugs and treatment by the medical doctors all to know was avail. Six months ago I was desperately online searching for a helpful remedies for genital herpes (HSV1-2) cure, which I come across some helpful remedies on how Dr OYAGU have help so many people in curing genital herpes (HSV1-2) with the help of herbal treatment because I too believe there is someone somewhere in the world who can cure herpes completely. At of the past 2 months, however, I've been following his herpes protocol and it stopped all outbreaks completely! To my greatest surprise I was cured completely by following the protocol of his herbal medicine . Don't be discouraged by the medical doctors. There is a cure for HSV with the help of herbs and roots by a herbalist Dr call Dr OYAGU he is so kind and truthful with his herbal treatment, kindly contact him for more information Via oyaguherbalhome@gmail.com or WhatsApp DR on +2348101755322 or visit his website https://oyaguspellcaster.wixsite.com/oyaguherbalhome you will be lucky as I am today

    ReplyDelete
  4. GVS Malaysia
    was founded with a goal to advance positively alongside the local community and in tandem with the group’s strategic expansion plan that would serve both foreign industries and locals alike.

    ReplyDelete
  5. Shintech Malaysia started out with an incredible objective of ensuring environmental sustainability through innovative green engineering. Our journey began as a fertilizer manufacturing company, utilizing available wastes and converting them into value-added nutrition for plants.

    ReplyDelete
  6. Bone Meal started out with an incredible objective of ensuring environmental sustainability through innovative green engineering. Our journey began as a fertilizer manufacturing company, utilizing available wastes and converting them into value-added nutrition for plants.

    ReplyDelete
  7. Nitrogen fertilizer started out with an incredible objective of ensuring environmental sustainability through innovative green engineering. Our journey began as a fertilizer manufacturing company, utilizing available wastes and converting them into value-added nutrition for plants.

    ReplyDelete
  8. EU certified organic input started out with an incredible objective of ensuring environmental sustainability through innovative green engineering. Our journey began as a fertilizer manufacturing company, utilizing available wastes and converting them into value-added nutrition for plants.

    ReplyDelete
  9. Richard Mille Malaysia Abbie & Co focuses on luxury investment watches. We are determined to provide luxury watches that holds value to you. Pre-owned and Brand new watches are part of our offerings. Buying, servicing and trading are also services that we provide.

    ReplyDelete
  10. Rolex Malaysia Abbie & Co focuses on luxury investment watches. We are determined to provide luxury watches that holds value to you. Pre-owned and Brand new watches are part of our offerings. Buying, servicing and trading are also services that we provide.

    ReplyDelete
  11. Abbie & Co focuses on luxury investment watches. We are determined to provide luxury watches that holds value to you. Pre-owned and Brand new watches are part of our offerings. Buying, servicing and trading are also services that we provide.

    ReplyDelete
  12. Mega 888 apk download is the most popular app for online slot games in Malaysia. The free download offers you a huge choice of games, you can even play for free using a test id. You can use the free test id listed on this page.

    ReplyDelete
  13. Mega 888 is the most popular app for online slot games in Malaysia. The free download offers you a huge choice of games, you can even play for free using a test id. You can use the free test id listed on this page.

    ReplyDelete
  14. Mega888 is the most popular app for online slot games in Malaysia. The free download offers you a huge choice of games, you can even play for free using a test id. You can use the free test id listed on this page.

    ReplyDelete
  15. USDA certified organic input started out with an incredible objective of ensuring environmental sustainability through innovative green engineering. Our journey began as a fertilizer manufacturing company, utilizing available wastes and converting them into value-added nutrition for plants.

    ReplyDelete