Eighteen radiative transfer models in use for calculation of UV index are compared with respect to their results for more than 100 cloud-free atmospheres, which describe present, possible future and extreme conditions. The comparison includes six multiple-scattering spectral models, eight fast spectral models and four empirical models. Averages of the results of the six participating multiple-scattering spectral models are taken as a basis for assessment. The agreement among the multiple-scattering models is within ±0.5 UV index values for more than 80% of chosen atmospheric parameters. The fast spectral models have very different agreement, between ±1 and up to 12 UV index values. The results of the empirical models agree reasonably well with the reference models but only for the atmospheres for which they have been developed. The data to describe the atmospheric conditions, which are used for the comparison, together with the individual results of all participating models and model descriptions are available on the Internet: http://www.meteo.physik.uni-muenchen.de/strahlung/cost/.