I am developing an application for HoloLens 2 using Unity 2022.3.30f1. My goal is to capture color and depth data using the HoloLens Research Mode and the Windows.Media API. The project is set up to target the Universal Windows Platform (UWP) and I have the Mixed Reality Toolkit (MRTK) Foundation 2.8.3 and MRTK OpenXR Plugin 1.10.1 installed.
Issue:
Despite following all the necessary steps, I am unable to find the required color and depth frame sources. The log indicates that the frame sources are not found, and the application does not proceed beyond the initialization step.
Steps Taken:
- Enabled Research Mode: Research Mode is enabled on the HoloLens 2 device.
- Restarted Device: Restarted the HoloLens 2 after enabling Research.
- Set Capabilities in Package.appxmanifest:
`<Capabilities>
<Capability Name="internetClientServer" />
<Capability Name="privateNetworkClientServer" />
<DeviceCapability Name="webcam" />
<DeviceCapability Name="microphone" />
<DeviceCapability Name="spatialPerception" />
</Capabilities>`
- Checked Frame Sources: Added detailed logging to identify available frame sources.
Code:
[Code1](https://i.sstatic.net/WxYVZHnw.png)
[Code2](https://i.sstatic.net/82535LQT.png)
[Code3](https://i.sstatic.net/BhA4Tizu.png)
[Code4](https://i.sstatic.net/yrHwGTF0.png)
What I've Tried:
-
Enabled Research Mode and restarted the HoloLens 2 device.
-
Verified capabilities in Package.appxmanifest.
-
Added detailed logging to identify available frame sources.
-
Verified that the application runs up to the initialization of MediaCapture but fails to find the required frame sources.
Question:
-
Have I missed any critical step in setting up the capture for color and depth data using HoloLens 2 Research Mode?
-
Are there specific configurations or settings that need to be verified to ensure the frame sources are recognized?
-
Is there an alternative approach to reliably access color and depth frame sources in Research Mode?
Additional Context:
-
Unity Version: 2022.3.30f1
-
MRTK Foundation: 2.8.3
-
MRTK OpenXR Plugin: 1.10.1
-
Target Platform: UWP
-
Device: HoloLens 2
Any insights or suggestions would be greatly appreciated!
Dhananjay Jagdish Dubey is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.