Deep Hyperspectral Imager

Sequence of Execution

1. First, run the micarray_recorder.cpp to capture the sound samples from the sources.
2. Second, run the convert.py to convert the raw files generated by matrix creator into hd5 format.
3. Third, run the basic_beamformer.py to localise the sound source in 2D.
4. Fourth, capture the Realsense IR and Depth Images manually.
5. Finally run the hyperspectral.py with its input arguments being the image locations and the modalities you wish to overlay.
6. Now hover the cursor over the image to see the details of the modalities on the screen.

Results

• Source Location 1:

• Source Location 1: Sound Localization Outputs

• Source Location 1: depth

• Source Location 2:

• Source Location 2: Sound Localization Outputs

• Source Location 2: depth

• Source Location 3: Sound Localization Outputs

• Source Location 3: depth