Numerous strategies have been explored to address environmental concerns stemming from heat-absorbing materials in the construction industry. One promising approach involves optimizing building materials for high reflectivity of incoming sunlight and enhanced thermal emissivity within atmospheric windows. Given that these radiative properties are closely linked to surface morphology characteristics, the superficial topography of building materials emerges as a critical factor in shaping their thermal and energy performance. To investigate this, an experimental and statistical study has been conducted to evaluate how surface components impact the radiative properties of building materials. Findings underscore the significant role of surface morphology as a secondary influence on radiative properties. Specifically, has been observed that large-scale components affect Mid-Infrared (MIR) absorbance, while surface roughness plays a key role in solar reflectance properties. Notably, increasing roughness consistently reduces Near-Infrared (NIR) and visible reflectance properties, by up to 17% and 8%, respectively, with no discernible impact in the UV region. In summary, this research demonstrates the feasibility of tailoring and optimizing surface properties to diminish energy consumption for cooling purposes and to mitigate the Urban Heat Island (UHI) effect.