This is the official repo of the paper： PSCR: Patches Sampling-based Contrastive Regression for AIGC Image Quality Assessment
@misc{yuan2023pscr,
title={PSCR: Patches Sampling-based Contrastive Regression for AIGC Image Quality Assessment},
author={Jiquan Yuan and Xinyan Cao and Linjing Cao and Jinlong Lin and Xixin Cao},
year={2023},
eprint={2312.05897},
archivePrefix={arXiv},
primaryClass={cs.CV}
}
Abstract: In recent years, Artificial Intelligence Generated Content (AIGC) has gained widespread attention beyond the computer science community. Due to various issues arising from continuous creation of AI-generated images (AIGI), AIGC image quality assessment (AIGCIQA), which aims to evaluate the quality of AIGIs from human perception perspectives, has emerged as a novel topic in the field of computer vision. However, most existing AIGCIQA methods directly regress predicted scores from a single generated image, overlooking the inherent differences among AIGIs and scores. Additionally, operations like resizing and cropping may cause global geometric distortions and information loss, thus limiting the performance of models. To address these issues, we propose a patches sampling-based contrastive regression (PSCR) framework. We suggest introducing a contrastive regression framework to leverage differences among various generated images for learning a better representation space. In this space, differences and score rankings among images can be measured by their relative scores. By selecting exemplar AIGIs as references, we also overcome the limitations of previous models that could not utilize reference images on the no-reference image databases. To avoid geometric distortions and information loss in image inputs, we further propose a patches sampling strategy. To demonstrate the effectiveness of our proposed PSCR framework, we conduct extensive experiments on three mainstream AIGCIQA databases including AGIQA-1K, AGIQA-3K and AIGCIQA2023. The results show significant improvements in model performance with the introduction of our proposed PSCR framework.
The pipeline of our proposed patches sampling-based contrastive regression framework.
In our original paper, dataset splitting methods are as follows:
(if you want to compare with the results in our original paper, please use the dataset splitting methods below.)
- AGIQA1K and AIGCIQA2023 (training:testing = 3:1)
- AGIQA3K (training:testing = 4:1)
Recently, we randomly split the dataset in a 4:1 ratio and conducted experiments. The dataset splitting methods and the experimental results are as follows:
(If you have also used the same dataset splitting method, please compare your results with ours below.)
- random dataset splitting methods
- results
The training log of our new experiments is here： NR-AIGCIQA, PSCR
For feature extraction from input images, we selected several backbone network models pre-trained on the ImageNet dataset, including:
If you have any question, please contact [email protected]