π§βπ»Expert Console - Start Video Sessions on Web Portal
Video Session Window of the web portal
The expert's console displays the video session window of the web portal where the expert can view the live video stream of the session and guide the field technician using various functional features of the console.
The image below represents the expert's console which displays the video session window of the portal along with various AR tools and functions for live AR remote session.
The expert can record the live session, take screenshots, share screens, add notes, annotate areas of concern with markers and text boxes, and chat with the field technician during the live session for better understanding and communication.
AR Remote Session with Remote Assist Functional Features:
Once both the expert and the on-site technician are live for a session and enters the meeting room, the expert and field technician can interact with each other while using these different features of AR Genie Remote Assist which includes:
AR Annotations: Markers ( Arrows, Circle, Free Hand), highlighted with different colors representing their usage as per the requirement during live session for quick guidance and support.
Text Box: Expert can write certain instructions for the on-site field personnel or technician on the text boxes and point them to the desired area, hence enabling the participant to know better and be clear about the instructions.
Meeting Chat: The chat option enables users to share the information and chat during the remote support.
Screenshot: This helps to capture the specific event during the session to evaluate or analyze the situation.
The expert can send invitation to other teams or guest through βinvite participantsβ option during live session.
Expert can also add " Notes" during the session.
Recording: Another feature is the live recording option that records the session details and streaming in real time which can be easily accessible later through the βMy Sessionβ and "Historyβ tab for training and monitoring purposes.
The camera, audio or microphone option enables live listening of the conversation during the video session which helps in better communication between the experts, technicians and remote teams.β
Leave Meeting: By clicking on the βLeave Meetingβ button, expert can exit or leave the live remote session. He can again join the same session later by accessing it from "My Session" tab.
Zoom In Feature (AR Video)
The Zoom In feature allows participants to closely inspect objects or areas within the AR video stream during an expert session. This is especially useful for detailed guidance, troubleshooting, or visual verification in remote assistance scenarios.
When a participant activates zoom, a preview panel appears on the right side of the screen, displaying the magnified view. Users can adjust the zoom level using the + / - controls to focus on specific details without affecting the main video feed.
The zoomed view remains synchronized with the live video, enabling experts to guide field users more precisely. This feature enhances clarity and improves communication when working with small components, intricate assemblies, or hard-to-see areas.
Key capabilities:
Real-time video zoom without interrupting the session
Adjustable zoom levels for precise viewing
Side preview panel for focused inspection
Ideal for remote troubleshooting and AR-assisted workflows
Background Effects (During Video Session)
The Background Effects feature allows experts to control how their video background appears during a live session. This helps maintain privacy, improve visual clarity, and create a more professional meeting environment.
Accessing Background Effects
While inside an active video session:
Locate the bottom toolbar of the video interface.
Click on the Background Effects icon.
The Background Effects panel will open on the right side of the screen.
Available Background Options
Once the panel is opened, you can choose from the following options:
1. No Effect
Select None to keep your original background unchanged.
2. Blur Background
Apply a blur effect to hide your surroundings. Available levels include:
Light for minimal blur
Medium for balanced blur
Strong for maximum background concealment
3. Virtual Background
Replace your background with a custom or preset image. Options include:
Uploading a Custom Image
Selecting from preset backgrounds such as Office, Nature, Abstract, or City
Best Practices
Use blur or virtual backgrounds in professional or sensitive environments. A medium blur often provides a good balance between privacy and performance. Ensuring proper lighting will improve background detection and overall video quality.
Live Captions
The Live Captions feature in the Expert Console enhances communication by providing real-time transcription of the ongoing conversation during a video session. It ensures that participants can easily follow discussions, even in challenging audio conditions or multilingual environments.
Enable Live Captions
To activate captions during a session, click the βCCβ (Captions) icon available in the bottom toolbar. Once enabled, the Live Captions panel will appear on the right side of the screen.
Caption Panel
The panel displays a continuous stream of transcribed speech from all participants. Each caption is tagged with the participantβs name, allowing you to clearly identify who is speaking at any moment. The captions update dynamically as the conversation progresses.
Caption Settings
You can customize captions directly from the panel:
Status Toggle captions based on your preference:
On β Displays live captions
Off β Hides captions
Caption Language Choose the language for transcription:
English (IN)
Hindi (ΰ€Ήΰ€Ώΰ€ΰ€¦ΰ₯)
Japanese (ζ₯ζ¬θͺ)
Selecting the appropriate language improves transcription accuracy and readability.
Use Cases
Live captions are particularly useful for:
Understanding conversations in noisy environments
Supporting multilingual communication
Assisting hearing-impaired participants
Reviewing spoken instructions in text form
Notes
Background effects require camera access to function.
If the camera is disabled, you will be prompted to enable it.
Performance may vary depending on system capability and network conditions.
Caption accuracy depends on audio clarity and pronunciation
Background noise may affect transcription quality
Ensure stable internet connectivity for real-time updates
This feature helps create a more accessible and efficient collaboration experience within the Expert Console video sessions.
Using the Whiteboard
After opening the whiteboard, you can interact with a variety of tools available in the top toolbar:
Drawing Tools: Create freehand sketches or annotations directly on the canvas.
Shapes & Lines: Add structured elements such as rectangles, arrows, and connectors to organize your explanation.
Text Tool: Insert text anywhere on the board for labeling or instructions.
Selection Tool: Move, resize, or modify existing elements on the canvas.
Erase / Undo / Redo: Easily correct mistakes or refine your drawings.
Zoom Controls: Adjust the view for better precision or broader context.
Key Capabilities
The whiteboard is designed to support real-time collaboration:
Edit and update content dynamically during the session
Visually guide participants through workflows or troubleshooting steps
Enhance communication beyond voice and video
Maintain clarity when explaining complex instructions
The whiteboard remains active throughout the session unless closed, allowing continuous interaction and updates as needed.
ENDS
Last updated