Our team narrowed topics into two - a thimble (or possibly a ring) combined with a joystick and attaching a trackpad on the palm. To demonstrate our ideas clearly to professor, we made low-fidelity prototypes out of clay and brought them with us to the meeting.
The professor suggested that we should take a look at previous literature more carefully. He also gave us a list of related papers:
NailO
Kao, H. L. C., Dementyev, A., Paradiso, J. A., & Schmandt, C. (2015, April). NailO: fingernails as an input surface. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (pp. 3015-3018). ACM.
Ring touchpand
Ens, B., Byagowi, A., Han, T., Hincapié-Ramos, J. D., & Irani, P. (2016, October). Combining Ring Input with Hand Tracking for Precise, Natural Interaction with Spatial Analytic Interfaces. In Proceedings of the 2016 Symposium on Spatial User Interaction (pp. 99-102). ACM.
Open Palm Menu
Azai, T., Otsuki, M., Shibata, F., & Kimura, A. (2018, February). Open Palm Menu: A Virtual Menu Placed in Front of the Palm. In Proceedings of the 9th Augmented Human International Conference (p. 17). ACM.
PalmType
Wang, C. Y., Chu, W. C., Chiu, P. T., Hsiu, M. C., Chiang, Y. H., & Chen, M. Y. (2015, August). PalmType: Using palms as keyboards for smart glasses. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (pp. 153-160). ACM.
Finexus
Chen, K. Y., Patel, S. N., & Keller, S. (2016, May). Finexus: Tracking precise motions of multiple fingertips using magnetic sensing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 1504-1514). ACM.
First presentation
The first presentation was on 30th March, and DoYeon introduced our topic and future plans for the project. Download
Introducing HoloLens and why
One of 25 TIMES best inventions of 2015
Very accurate and precise compared to its competitors
Gestures (2 type: click and bloom) and voice input implemented thoroughly
Problems with existing input systems
Gaze: unstable
Pointing gesture: driving attention, arm fatigue
Voice input: obtrusive, cannot be used in shared events
Related works - solutions
Spatialize
Ring device utilizing pointing action
Pointing: obtrusive, interaction is unfamiliar
Ring-type device
Combining spatial information and gestures using trackpad
repetitive movement: exhausting
Topic candidates & Research question
Pointing interaction is not stable
Gesture interaction is obtrusive
Trackpad doesn’t match the interaction we want to implement
Expected outcomes
Working prototype
Evaluation report assessing performance<br.
Week 2 - Topic Candidates
We decided to focus on [HoloLens] and came up with ideas about the input system of the device.
Topic candidates
We suggested four candidates and got feedbacks from professor.
1. Combining thimble with a joystick
Inspired from IBM’s TrackPoint (the red one), we thought of putting a control sensor on a thimble-looking device so it isn’t too obtrusive but intuitive for the user to move the cursor.
2. Coming up with new gestures
We found out that there were only two types of gestures in using HoloLens, so we wanted to make and evaluate gestures.
This is probably not a good idea. There is a lot of gesture work out there already and most of the work for gesture interfaces is highly technical.
3. Implementing a trackpad
We thought that having a trackpad on the palm might be useful because the control interface is fixed and therefore makes it easier for the user to move the cursor.
There’s also lots of work on the hand/palm as an input surface. This is a potentially good topic, but you will need read about this area a bit first. Maybe start from this paper and see if other interesting papers cite it (or are cited by it). On body input can be a technically hard topic to work on.
4. Using smartphones (similar to #3)
We believe that people would have smartphones everywhere just like they do now for the next few years, and it would be nice if smartphones could be used as a trackpad.
Probably not that interesting. Some AR glasses already ship with trackpads. Many VR headsets (e.g. daydream, gear VR) also ship with small trackpads.
Week 1 - Topic Selection
In this week, we investigated AR input devices already available on the market for topic selection and share their opinions about what they are interested in.
Four interesting categories in AR input devices
Prior to the topic selection, we categorized the AR input devices currently available on the market and picked four interesting items.
Heena Kwag:
Improve reticle of current AR input method (e.g. HoloLens)
Minseop Kim:
A. Thumb-on form + twisted interaction (e.g. Finch)
B. Swipe or touch the panel in one hand with the other hand.
C. Use smartphone or smartwatch as a controller.
The common opinion was that it is better to be available in certain situations.
Literature reviews
GlassPass
Islam, M. D., Lee, D., Jahan, L. S., & Oakley, I. (2018, February). GlassPass: Tapping Gestures to Unlock Smart Glasses. In Proceedings of the 9th Augmented Human International Conference (p. 16). ACM.
Belt
Dobbelstein, D., Hock, P., & Rukzio, E. (2015, April). Belt: An unobtrusive touch input device for head-worn displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (pp. 2135-2138). ACM.
SmoothMoves
Esteves, A., Verweij, D., Suraiya, L., Islam, R., Lee, Y., & Oakley, I. (2017, October). SmoothMoves: Smooth Pursuits Head Movements for Augmented Reality. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (pp. 167-178). ACM.
WatchThru
Wenig, D., Schöning, J., Olwal, A., Oben, M., & Malaka, R. (2017, May). WatchThru: Expanding Smartwatch Displays with Mid-air Visuals and Wrist-worn Augmented Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 716-721). ACM.
