03.
Remote Assistance Consumption of a Field Technician by using JioGlass
Embedded Files
The solution for Field Technicians revolves around JioGlass, a Mixed Reality Head Mounted Display (HMD). This innovative device allows technicians to access supportive materials while performing maintenance tasks, and it facilitates real-time guidance from experts situated remotely.
This setup involves pairing JioGlass, the XR headset, with a compatible smartphone serving as a controller for XR applications. The entire Remote Assistance solution is designed with voice command functionality, ensuring a hands-free experience for technicians, and enabling seamless job performance. Leveraging Mixed Reality technology, technicians can seamlessly interact with the real world while viewing the user interface on JioGlass, enhancing their overall work experience.
Limitations
Limitations
While having discussions with technicians at Jamnagar Refinery, it's evident that they typically handle around 3-4 pre-defined tasks daily, set almost a week in advance. However, unforeseen emergencies can lead to last-minute assignments. A significant portion of these tasks involves manual processes, necessitating technicians to carry stacks of paper documents and pens for reference during execution.
Also there are some other limitations in such sensitive areas which need to be considered while designing the solution.
Complexity Graph
Complexity Graph
One major challenge is introducing new technology to users who've never used anything similar while working in the plant. It's crucial that the UI doesn't distract them from their tasks and allows for a clear view of the real-world environment. The device's interface should be minimal, ensuring the area in front of them remains entirely uncluttered, enabling them to focus and perform their job efficiently.
Moodboard
Moodboard
Key insights from the References:
Based on FT's persona, steps with actions needs to be clear to reduce downtime.
Minimal designs that grab attention and give clear messages in short.
Use icons wherever possible to give instant alerts
Most important to less important in information in flows
Viewing area needs to utilize on a need basis
Ideation
Ideation
Main Canvas
Homepage Exploration
Home & Controller switcher
Call & Chat during job
View Documents during Call
Chat while performing job
Call & Chat during job
View Documents during Call
PDF Viewer with file listing
Voice command exploration
Possible labels after Trigger
Final JioGlass Designs with Prototype
Final JioGlass Designs with Prototype
Homepage:
Allocated jobs on the Homepage are on the right side and Menu options with breadcrumbs are on the left top. It is designed like this because the mental model of most of the users is seeing the card content on the right and the menu on the left.
The center area is purposely kept empty and most of the time it will be empty to see the real environment while performing a job so that there won't be any destruction to the Field Technician.
Blue text is the voice commands that FT (Filed Technician) needs to say to interact with the Product. E.g. FT can just say 'Start Job' to start the job or can say the number shown on the upcoming jobs to preview and start the job.
Checklist inside Job:
Once the FT starts the job, he will see the tasks with some supported files from library. To preview the files, he just needs to say 'View Files' to preview.
On the left top there is a Call button that FT can use during emergency/support to get help from an SME (Subject Matter Expert) who is sitting in the office at another location.
At the bottom area, If the UI shifts by any chance, there is a Recenter button to recenter the entire UI in your view.
Input Method is to change the interaction from Voice to Gaza mode during a noisy environment.
Chat:
Chat will be one-sided and only SME/WEB Users can send chat messages or share files which FT can refer to during the job.
PDF Previewer:
Once user opens any file attached to the checklist or from chat, the PDF file will open with the necessary controls. These controls will have Min/Max limitations with a disabled state.
FT can view the thumbnails of Next/Previous files as well so that he doesn't need to close and go back to the checklist to open the next file.
3D Previewer:
FT can also view 3D models/animations for better understanding. These will also have the necessary controls to interact with it.
User selection for Call:
Once user selects the call button on the top left by voice, a pre-call window will open to select the SME with necessary AV confirmation.
Call:
During the call FT will see the call feed on the left bottom to have clear view in center.
Once call starts, Call button change to End Call with same voice command. Also Timer with recording icon will display.
Call window will have some controls like View change between SME and Himself to check whether FTs feed is going proper or not.
Large/Small for window size adjustment and Minimize/Maximize window based on scenarios.
Notifications:
These are some of the popup and toast message samples with relevant icons with color.
Icon color will be based on message type. E.g. White icons will be informative, Red for Errors and Green for success messages.
Jamnagar Usability Plan & Implimentation
Jamnagar Usability Plan & Implimentation
Enterprise+RA+Usability+Plan.doc
Usability Report
Usability Report
Jamnagar Trial.xlsxLearnings
Learnings
There needs to be an offline mode in the system so that jobs can be performed seamlessly in low or no-network areas as well.
3 DoF environment was not very comfortable for all users. There needs to be an option to toggle between 3DoF/0DoF modes so that FT can switch based on their comfort.
Video recording need to have a capture mode so that FT can capture images while recording a video. This will also help while having calls with SME.
There needs to be Bluetooth support for earphones which will help in noisy environments.
FT should be able to attach images up to 10...limit need to be increased.
Fitment of hardware need to be proper as many FTs was feeling uncomfortable while using it. It was distracting their mind while performing a job.
There needs to be UI Adjustment option as for some FT's with glasses has problems with readability. There need to be an adjustment where FT can move the entire UI and set it as per their comfort.
Page updated
Google Sites
Report abuse