Project

Microsoft Azure Kinect for a Lunar Environment

Copyright

Cody Paige

Cody Paige

The Microsoft Azure Kinect is a commercial-off-the-shelf (COTS) time-of-flight (ToF) depth camera which can provide high resolution near-field depth data. The MIT team has selected to modify the camera for a technology demonstration mission on the Lunar surface in 2023.  The collected data will be used to construct a high resolution, near-field virtual environment of the lunar surface for scientific applications. The ToF camera is mechanically robust; with no baseline calibration requirement, high effective depth image resolution and low computational cost (Bamji et al., 2018). The Azure Kinect combines ToF data with RGB video and an IMU sensor to give a complete picture of the area immediately surrounding the device. By using a COTS part with integrated ToF and RGB imaging we reduce the processing required to align different camera view fields and positions when rendering the image as well as reducing development costs. We are currently working on a set of risk-reduction experiments and hardware modifications in preparation for a 2023 CLPS flight mission in 2023. We have designed an experiment to test the functionality of the camera in Lunar dust conditions that was flown on a Zero-G flight with the MIT Space Exploration Initiative in May 2022.  We are also testing the capabilities in south pole lighting conditions through benchtop testing and field tests in Svalbard, Norway. The unit will be modified for integration with a CLPS payload with several weight reduction modifications, removal of plastics incompatible with spaceflight, and as housing that integrates the camera as a payload on the Lunar Outpost MAPP rover.

Copyright

Ferrous Ward

Azure Kinect ToF camera white paper:

C. S. Bamji et al., "IMpixel 65nm BSI 320MHz demodulated TOF Image sensor with 3μm global shutter pixels and analog binning," 2018 IEEE International Solid - State Circuits Conference - (ISSCC), 2018, pp. 94-96, doi: 10.1109/ISSCC.2018.8310200.