Quest Passthrough Lab

Working Quest 3 passthrough-camera -> laptop processing prototype.

The current validated path is:

1. Quest passthrough camera frames in unity/TRI_Project
2. QuestVisionStream Android/WebRTC bridge on-device
3. laptop-side Python server in laptop/QuestVisionStreamServer
4. secure wss:// signaling via ngrok or another TLS tunnel
5. detections and/or returned JPEG frames sent back to Unity on the headset

Workspace

• unity/ -> headset Unity project (TRI_Project)
• laptop/ -> laptop-side QuestVisionStream server copy
• docs/ -> setup notes and current runbooks
• external/ -> validated upstream/fork references used during bring-up

Current status

• external/Unity-QuestVisionStream was fixed and validated first
• the working QuestVisionStream integration was then synced into unity/TRI_Project
• TRI now works end-to-end after fixing:
  • Android build/export issues
  • broken WebCamTextureManagerPrefab script reference
  • missing runtime Android plugin jar in TRI

Start here

• Current operator runbook:
  • docs/tri-questvisionstream-runbook.md
• Integration / architecture notes:
  • docs/questvisionstream-integration.md
• Historical Quest setup doc:
  • docs/unity-phase-1-quest-setup.md
• Frame-return upgrade notes:
  • docs/beginner-step-by-step.md

Notes

• All paths in this repo's docs are relative to the repo root. Run commands from the directory where you cloned this repo.
• A wiki tracker was historically kept outside this repo on the original operator's machine (<knowledge-base>/projects/meta-quest-passthrough/quest-passthrough-project.md); it is not part of this checkout.
• Main repo pushed state: 3bb18c0
• External working QuestVisionStream commit: 0666369