2023 - Australia - Evaluation framework for smartphone-based road roughness index estimation systems

Roughness is an important indicator of road deterioration and has a significant impact on road serviceability. Conventional instruments for roughness measurement, such as laser profilers, are expensive and require a complex set-up, which limits the surveying frequency and coverage. As an
alternative, embedded sensors in smartphones mounted in vehicles have been leveraged to measure roughness indirectly, and multiple smartphone-based roughness index estimation (sRIE) systems have become available recently. However, there lacks a framework to evaluate the performance of sRIE systems in a systematic and repeatable manner. This research proposed an evaluation framework to assess the performance of sRIE systems in practical settings. The framework consists of statistical measures that evaluate the consistency and accuracy of sRIE systems under various mountings, vehicle types, and survey speeds. Three popular sRIE systems were assessed using the framework to validate their validity and practicality. By standardising the performance metrics, this framework allows for performance benchmarking between sRIE systems and conventional instruments.