TY - JOUR
T1 - Search and rescue with airborne optical sectioning
AU - Schedl, David C.
AU - Kurmi, Indrajit
AU - Bimber, Oliver
N1 - Publisher Copyright:
© 2020, The Author(s), under exclusive licence to Springer Nature Limited.
PY - 2020/12/23
Y1 - 2020/12/23
N2 - In the future, rescuing lost, ill or injured persons will increasingly be carried out by autonomous drones. However, discovering humans in densely forested terrain is challenging because of occlusion, and robust detection mechanisms are required. We show that automated person detection under occlusion conditions can be notably improved by combining multi-perspective images before classification. Here, we employ image integration by airborne optical sectioning (AOS)—a synthetic aperture imaging technique that uses camera drones to capture unstructured thermal light fields—to achieve this with a precision and recall of 96% and 93%, respectively. Finding lost or injured people in dense forests is not generally feasible with thermal recordings, but becomes practical with the use of AOS integral images. Our findings lay the foundation for effective future search-and-rescue technologies that can be applied in combination with autonomous or manned aircraft. They can also be beneficial for other fields that currently suffer from inaccurate classification of partially occluded people, animals or objects.
AB - In the future, rescuing lost, ill or injured persons will increasingly be carried out by autonomous drones. However, discovering humans in densely forested terrain is challenging because of occlusion, and robust detection mechanisms are required. We show that automated person detection under occlusion conditions can be notably improved by combining multi-perspective images before classification. Here, we employ image integration by airborne optical sectioning (AOS)—a synthetic aperture imaging technique that uses camera drones to capture unstructured thermal light fields—to achieve this with a precision and recall of 96% and 93%, respectively. Finding lost or injured people in dense forests is not generally feasible with thermal recordings, but becomes practical with the use of AOS integral images. Our findings lay the foundation for effective future search-and-rescue technologies that can be applied in combination with autonomous or manned aircraft. They can also be beneficial for other fields that currently suffer from inaccurate classification of partially occluded people, animals or objects.
UR - http://www.scopus.com/inward/record.url?scp=85096434181&partnerID=8YFLogxK
U2 - 10.1038/s42256-020-00261-3
DO - 10.1038/s42256-020-00261-3
M3 - Article
SN - 2522-5839
VL - 2
SP - 783
EP - 790
JO - Nature Machine Intelligence
JF - Nature Machine Intelligence
IS - 12
ER -