Physically-Based Tactile Rendering: Simulating Haptics via Light-Material Interaction Models

Agarwal et al. (2025) use PBR to design tactile sensors, but what if we invert the problem? This idea proposes simulating tactile perception via PBR—using light-material interaction models to predict how a material’s surface would "feel" to a robot or human. By coupling optical simulation with material science models of friction, compliance, and roughness, you could train neural networks to map rendered images to tactile signals, creating a “virtual haptic renderer.” This could be invaluable for VR/AR, robotics, or remote material selection (e.g., online shopping), and blends optics, graphics, and haptics in a novel way.

References:

1. Vision-based tactile sensor design using physically based rendering. Arpit Agarwal, Achu Wilson, Tim Man, Edward H. Adelson, Ioannis Gkioulekas, Wenzhen Yuan (2025). Communications Engineer.