CHINAResearch
arXiv paper benchmarks 20 LLMs against China AI-generated content rules
Chenrui Cui, Hongye Fang, Lisha Song, Weichao Chen, Yue Zhu and Gang Xu posted Benchmarking LLM Compliance with China AI Generated Content Regulations to arXiv on September 17, 2026. The paper evaluates 20 notable LLMs on Chinese AIGC compliance and refusal using 2,303 questions across six dimensions, including 203 self-constructed constitutional questions, to map how models behave under China’s regulatory landscape.
Key points
- Authors evaluate compliance and refusal rates for 20 notable LLMs under China’s AI-generated content rules.arXiv
- The benchmark uses 2,303 questions spanning six dimensions, including 203 self-constructed constitutional questions.arXiv
- The paper focuses on Chinese-language content compliance risks that prior English-centric work underplayed.arXiv
- International models also showed high compliance on standard Chinese questions; differences stemmed mainly from dimensions tied to ideological alignment, the authors report.arXiv