The Evolution of User Interface Design – Communications of the ACM

Thank you for reading this post, don't forget to subscribe!

User interface (UI) design is currently experiencing a transition from traditional graphical user interfaces (GUIs) to systems designed to recognize a person’s gestures and movements.

Hence, in this blog, we will discuss the possible implications of this groundbreaking transition in terms of user experience (UX) and the accessibility of modern interfaces. Likewise, we’ll explore how developers adapt to the technological shift to deliver innovative solutions while outlining the challenges of adopting gesture-based interactions.

Gesture-Based User Interfaces: An Introduction

Gesture-based interactions are quickly becoming a standard and the technology is widely considered the future of UI. Therefore, modern devices and applications must adapt to meet the needs of their users. On top of that, recent data shows that 82% of users prefer apps with gesture-based controls.

The algorithms built into touch screen devices, such as smartphones recognize a range of touch types, from scrolling to swiping. Because of this technology, users are now able to navigate applications with simple gestures like pinches or taps. A classic example of this is the navigation controls of Google Maps which require the user to pinch the screen to zoom in or out, and swipe/drag to move to a different location.

These controls have helped to elevate mobile games to a much higher level in a rather short space of time. Now, gesture-based interactions are having a significant impact on user interfaces as consumers are becoming accustomed to real-time, instant responses from software applications. The process of clicking through various screens to reach a specific location is quickly becoming a thing of the past.

How Gesture-Based Interactions Can Improve on GUIs

Gesture-based interactions are a much more natural and intuitive method of navigating a screen when we compare it to clicking through a linear path of screens and pages. We’re seeing an increasing number of apps with these features, as developers are deploying them with more complex user journeys in mind.

Swipes, pinches, taps, and rotational drags are logical movements that come naturally to a person and allow users to manipulate pages and content by using a set of simple gestures in a similar way to how they may manipulate real-world objects. Even young children will have no problem quickly learning the necessary actions due to this natural familiarity.

Research shows gestural interactions have a positive impact on user experience and can increase engagement. This UI improvement is a drastic one when compared to using a mouse in traditional desktop computing, especially in terms of delivering content quickly. Through accelerated user journeys with fewer obstacles and real-time responses, the user is more likely to enjoy using an application.

Enhancing user engagement is one of the key benefits of gesture-based interactions, allowing users to directly manipulate screen elements to quickly reach their goal. The direct nature of using gestures can create a better sense of connection when using an application, not only boosting user satisfaction but also increasing loyalty, ensuring the app has longevity.

How Applications are Evolving to be More Gesture-Based

To adapt to gesture-based user interfaces, developers tend to fall back on the six pillars of gesture-based interaction between the users and the app:

Simplicity: Gestures must be intuitive, first and foremost. Ideally, they should be immediately apparent, but if not, they have to be natural and easy to remember. Think of pinching, dragging, and tapping, and not convoluted, multi-gesture chains.

Accessibility: Users who may not have a full range of motion in their hands must always be considered and provided with alternative methods to interact with the interface.
Context: Developers should establish what tasks the user will perform and what type of devices and screen sizes they are likely to use. This will help to avoid unnecessary actions that might damage the UX.
Prompts: For some users, the correct gesture may not be obvious, so it is important to provide prompts (both text and visuals) and guidance to help new users engage with the app.

Test: Thorough testing is always needed to confirm that the app is usable and free of bugs that could impact the user experience. Testing across various platforms and screens is also critical to avoid apps being usable only on certain devices or operating systems.
Flexibility: The best gesture-based user interfaces give some leeway to the user, allowing them to interact with the app in their way. This could include being flexible in terms of swiping speeds and not being overly strict on where the user needs to touch the screen.

Challenges of Gesture-Based User Interfaces

Although the advantages of gesture-based interactions are clear, the technology does present several issues that need to be addressed before an application can be deployed. First, the correct gestures must be made obvious to the user to ensure the app’s learning curve is minimal. Many users will quickly uninstall an app if it is not immediately usable.

If the app requires some gestures that are not instantly apparent, then guidance must be provided to direct the user. This can include visual prompts, tutorial overlays, or simple text hints when a person first signs into the app.

Gesture-based apps also must be designed with environmental factors in mind, such as poor lighting, crowded spaces, or noise interference. This means gesture recognition algorithms need to consider anything that may present an obstacle. For example, a person may not be able to freely use their hand when using an application on a busy subway. Haptic feedback can be used to provide users with confirmation that they have successfully executed a gesture, avoiding any frustrations like swiping too many times.

The security of applications must also be assured. Many modern devices use biometric technology for authentication purposes, as well as gestures to grant quick access. Therefore, the protection and privacy of the user’s biometric data is a key consideration. Security is arguably the biggest concern when creating user interfaces, especially when you consider there are an average of 2,200 cybersecurity incidents per day.

The Future of User Interfaces

To be truly successful, gesture-based interaction algorithms need to be as accurate as possible, providing a reliable user experience and reducing false negatives and positives. Algorithms can be elevated with the help of machine learning, which can identify trends and behaviors that could suggest alternatives to the gestures currently being used.

Many apps will likely combine gestural interactions with voice commands (multimodal interactions), providing users with alternative interaction methods depending on their preferences. Voice commands can also solve potential accessibility issues.

Touchscreen devices are expected to become even more sophisticated, and demand for such devices will grow. From child-friendly tablets to advanced IoT devices, the need for gesture-based user interfaces will increase in the coming years, requiring innovations to mirror the latest consumer behaviors.

Conclusion

Gesture-based interactions are continuing to enhance user experiences and have become the cornerstone of UI design. These gestures come naturally to users and allow them to navigate interfaces quickly thanks to advanced algorithms that take into account user behaviors and mental models.

However, to be successful, a gesture-based user interface needs to have a high level of learnability and accuracy, especially if it’s meant for use in public spaces, while also addressing accessibility and security issues that could impact the viability of a new mobile application.

Alex Williams is a seasoned full-stack developer and the former owner of Hosting Data UK. After graduating from the University of London with a Masters Degree in IT, Alex worked as a developer, leading various projects for clients from all over the world for almost 10 years. Alex has recently switched to being an independent IT consultant and started his technical copywriting career.