Image processing systems gather and convey information using image sensors enabling a variety of IoT and mobile applications. IoT systems utilize image sensors to perform a multitude of various tasks that are important in all aspects of life such as detecting wildfires in forests, lifesaving medical imaging and reality headsets that use body tracking....

­Through the lens of their cameras, mobile devices can visually observe a user’s environment for detecting faces, understanding spatial scene geometry, and capturing images and videos. This has yielded a wide range of benefits, especially as image sensors have grown to support increasingly higher resolutions and frame rates. With such precision,...

Background Mobile vision systems would benefit from the ability to situationally sacrifice image resolution to save system energy when imaging detail is unnecessary. However, upon any resolution reconfiguration request, current system frameworks stop providing image frames to the application until the reconfiguration completes. Frame delivery is bottlenecked...

Background Advances in imaging and vision processing technologies have enabled countless devices, such as phones, headsets, cameras, and drones, to be commercial staples. As high-performance imaging needs grow, management of energy consumption becomes a concern. This has motivated a trend towards three-dimensional “stacked” integrated circuit...

Background Current spatial audio techniques for speaker systems are challenged by high cost, high computational intensity, and user mobility. In particular, crosstalk—when sound from a speaker unintentionally reaches an opposite ear—is a major performance-degrading factor. Some spatial audio speaker systems utilize beam-forming techniques...

Background By integrating visual stimuli with perceived tactile sensation, mixed-reality haptic devices provide a critical dimension to otherwise intangible virtual content. Much of the commercial and academic efforts in this domain have focused on delivering simulated interactions with rigid objects, often through the use of vibrotactile gloves, robotic...

Background Light estimation is a critical component for realistic rendering of virtual scenes. For mixed-reality, a merging of virtual and physical worlds, accurate light estimation is especially important; inconsistencies in shadow and highlight rendering between the two domains are particularly noticeable, diminishing the intended immersive experience...