Joint Session | EU Lumi

Lumi HL2 App > Joint Session

Introduction Joint Session

The joint session functionality can be used to share the view of 3D patients between multiple users, which makes it possible to explore 3D patients and prepare surgeries with multiple users simultaneously. Lumi has two types of joint sessions:

Co-located joint session can be used if the users are in the same room. Every user sees the 3D patient at the same position (and orientation) in the room. Multiple users can adjust and manipulate the 3D patient itself, as change its position in the room.
Remote joint session can be used if the users are not in the same room. Multiple users can adjust and manipulate the 3D patient.

Create Joint Session

Make sure to open a 3D patient before creating the joint session
Open your wrist menu and select ‘Joint Session’
Select your patient group in the dropdown menu of the joint session menu
Select ‘Create New Room’ to initiate a joint session
Scan your environment carefully
When succeeded, the menu will close automatically and the hologram will be shown

Create joint session

Join Joint Session In Person

Open your wrist menu and select ‘Joint Session’
Select your patient group in the dropdown menu of the joint session menu
Select the room of your colleague
Select 'In Person'
Select Yes if you have a Lumi Marker, select No if you don't have a Lumi Marker
- If Yes:
  - Scan the Lumi Marker
  - When succeeded, the menu will close automatically and the hologram will be shown
- If No:
  - Give the host of the session (your colleague) a fist bump for 3 seconds
  - When succeeded, the menu will close automatically and the hologram will be shown
The hologram in the joint session will be loaded
Other users in the joint session will be identified and a diamond shaped avatar will be projected above their heads (co-located users) or appear as a surgeon's avatar (remote users)

Note: eye calibration should be completed by the user to be able to use the Lumi marker for the joint session. When eyes are not calibrated, the user cannot select the Lumi marker in the sharing screen, the Lumi marker image is grayed out, and a message is shown indicating that without eye tracking the user cannot use sharing with the Lumi marker. Only fist bump is available in this case.

Note: co-located Joint Session tracking is not necessarily perfectly accurate, and you should use it with care and verify independently when cooperating on procedure-relevant pointing/guidance.

Join joint session in person

Join joint session in person without Lumi marker

Join Joint Session Remote

Open your wrist menu and select ‘Joint Session’
Select your patient group in the dropdown menu of the joint session menu
Select the room of your colleague
Select 'Remote'
The hologram in the joint session will be loaded
Other users in the joint session will be identified and appear as a surgeon's avatar

Note: you can hide another participant's avatar to prevent holograms overlapping

Join joint session remotely

Close or Leave Joint Session

Open your wirst menu and select ‘Joint Session’
Press the button ‘Exit room’
- Note: when all users have left the session, the session will stay active for 24 hours, meaning that users can reenter the session

Creating and Joining

You can only access joint sessions in groups to which you have access to
The scanning of your environment while creating a joint session takes approximately 20 seconds and is very important for the HoloLens 2 to show the 3D patient on exactly the same spot for all users
To optimize synchronization; please limit movement and adjustment of 3D patients until the 3D patient is loaded for all users. Loading is finished in case the loading bar is completed and the 3D patient with its menu is visible
In case you move the 3D patient, other users will also see a movement. If you want to look from a different perspective without moving the 3D patient for other users; you can move yourself around the 3D patient

WiFi Connection

The joint session functionality requires a stable WiFi connection with the following network requirements:

Minimum download speed: 6.12 Mbps
Minimum upload speed: 1.05 Mbps
Maximum network ping: 99 ms

Therefore, make sure you are connected to a stable network. You can switch the WiFi network your HoloLens 2 is connected to, using the steps described here.

Note: You will receive a warning in the joint session menu when network connections are poor.

Note: You will receive an error notification when there is no connection (in case of a very poor network).