Surgery Assistant System
During surgery a lot of information is in need. Information needs to be displayed in a proper way. A tangible screen or button needs sterilization in the surgery room. It’s not possible for doctor to take off the glove for controlling. Thus we need gesture control for a more hygenic and convenient controll. Also when the surgery light need adjusting it's more convenient to control by gestures. By adding a tangible user interface in addition to graphical user interface, we developed a new method of providing feed forwards and feedbacks within the gesture control system.
UNIQUE PROPERTIES / PROJECT DESCRIPTION:
TPSurgery is an interactive surgery assist system that helps showing information of patient and adjusting surgery light with non-touch control. With the system the surgeon can adjust surgery light in 3 dimensions as well as scanning through the patient's information with gestures with the indications of both graphical user interface and tangible user interface. We carefully designed and did user test on the interaction usability to make the system more accessable for the user.
OPERATION / FLOW / INTERACTION:
The common use steps are as following:
1. Surgery begins. The system is powered and waiting for detection.
2. Doctor holds his hand to activate the system.
3. He uses the light adjustment mode to adjust the surgery light.
4. He stops adjusting and goes on surgery.
5. When he needs information, he activates the system again and switches it to information mapping mode.
6. He browses information.
7. He stops looking at the graphs and goes on surgery.
8. The surgery ends. The system is turned off.
We designed a tangible user interface in addition to the traditional graphic interface to help the user understand our system better. If the user does something wrong an adequate indication will come out to tell the user what is going wrong. For example, if the hand is out of the detection range of the sensor, the corresponding LED belt will become red. Also the graphical user interface will have proper feedforwards and feedbacks for all the operation from the user.
PROJECT DURATION AND LOCATION:
The project started in November 2015 finished in February 2016 in Eindhoven and was exhibited in Innovation for health at Rotterdam in February 2016.
FITS BEST INTO CATEGORY:
Scientific Instruments, Medical Devices and Research Equipment Design
PRODUCTION / REALIZATION TECHNOLOGY:
In our prototype the functions are archieved by the combination of the leapmotion, the arduino and the processing langauge. A few LED belts and two speakers are applied with the control of Arduino UNO. We hope in the future we can make everything in an intergrated circuit.
SPECIFICATIONS / TECHNICAL PROPERTIES:
Now the prototype is around 300mm*150mm*50mm. It's too big in a surgery room. So we hope to make it smaller (as shown in the images) as 130mm*80mm*30mm in the future.
surgery, assist system, gesture control, interaction
We used the gesture sensor to make a surgery assist system with the consideration of making the interaction social by applying the MPCA (mirrored perception cognition action) model and 5A questions (address, attending, action, alignment, accident) analysis. By adding a tangible user interface in addition to graphical user interface, we developed a new method of providing feedforwards and feedbacks within the gesture control system. We did 2 rounds of user test and recorded the video for analyzing. We found that with tangible user interface it's easier for the user to understand what's going on in the system than just graphical user interface in our system.
During the research process we need to analyze the performance of a complex sensor with data and how to improve its performance as a designer. Sensor is just part of the system. If the system doesn’t work well, it might be either the error of the sensor or the error of the user. As a designer we need to think it in a more systematic way when designing an interaction system with complex sensor.
TEAM MEMBERS (3) :
Jiachun Du, Tom van Rooij and Tong Wu
Image #1 : Qi Qi