An Empirical Investigation of the Impact of Artificial Intelligence on News Content Quality: A Comparison of Human-Generated, AI-Generated, and Human–Machine Collaborative Content
Keywords:
Artificial Intelligence, Journalism, Content Quality, News Production, Human-Machine Collaboration, Experimental StudyAbstract
This study conducts an empirical investigation into the impact of artificial intelligence on the quality of news content. Using a controlled experimental design, the quality of news content was compared across three different production modes: (1) content generated by human journalists, (2) content generated by AI systems, and (3) content generated through human–AI collaboration. A total of 120 news content pieces were produced across six topical domains—politics, economy, society, sports, science, and culture—and evaluated by 18 journalism experts and 240 ordinary readers based on the criteria of accuracy, objectivity, comprehensiveness, readability, appeal, and credibility. The results indicated that content produced through human–AI collaboration received the highest scores on most criteria. Human-generated content was superior in terms of appeal and credibility, while AI-generated content performed better in terms of informational accuracy and comprehensiveness. The findings of this study provide valuable insights into how artificial intelligence can be optimally leveraged in the news content production process, demonstrating that the human–machine collaborative approach can lead to higher-quality news content.
Downloads
References
Ashtiani, M. N., & Raahemi, B. (2023). News-based intelligent prediction of financial markets using text mining and machine learning: A systematic literature review. Expert Systems with Applications, 217, 119509. https://doi.org/10.1016/j.eswa.2023.119509
Beckett, C. (2019). New powers, new responsibilities: A global survey of journalism and artificial intelligence. London School of Economics and Political Science. https://blogs.lse.ac.uk/polis/2019/11/18/new-powers-new-responsibilities/
Broussard, M. (2018). Artificial unintelligence: How computers misunderstand the world. MIT Press. https://doi.org/10.7551/mitpress/11022.001.0001
Broussard, M., Diakopoulos, N., Guzman, A. L., Kaufman, R., Kirchner, L., & Lewis, S. C. (2019). Artificial intelligence and journalism. Journalism & Mass Communication Quarterly, 96(3), 673-695. https://doi.org/10.1177/1077699019859901
Chang, T. M., Hsu, M. F., & Lin, S. J. (2018). Integrated news mining technique and AI-based mechanism for corporate performance forecasting. Information Sciences, 424, 273-286. https://doi.org/10.1016/j.ins.2017.10.004
Chiang, T. H. C., Liao, C.-S., & Wang, W.-C. (2022). Impact of Artificial Intelligence News Source Credibility Identification System on Effectiveness of Media Literacy Education. Sustainability, 14(8), 4830. https://doi.org/10.3390/su14084830
Clerwall, C. (2014). Enter the robot journalist: Users' perceptions of automated content. Journalism Practice, 8(5), 519-531. https://doi.org/10.1080/17512786.2014.883116
Diakopoulos, N. (2019). Automating the news: How algorithms are rewriting the media. Harvard University Press. https://doi.org/10.4159/9780674239302
Graefe, A., Haim, M., Haarmann, B., & Brosius, H. B. (2018). Readers' perception of computer-generated news: Credibility, expertise, and readability. Journalism, 19(5), 595-610. https://doi.org/10.1177/1464884916641269
Hansen, M., Roca-Sales, M., Keegan, J. M., & King, G. (2017). Artificial intelligence: Practice and implications for journalism. Columbia University Academic Commons. https://academiccommons.columbia.edu/doi/10.7916/D8X92PRD
Kalateh Aghamohammadi, A., & Sharifi, S. M. (2022). Examining the place of artificial intelligence in human resources from the perspective of the role of artificial intelligence in eliminating jobs (Case study: News broadcasting). Journal of Media Futures Studies, 3(3), 36-64. https://www.researchgate.net/publication/378051141_Examining_the_Role_of_Artificial_Intelligence_in_Remodeling_Human_Resource_Function
Kalateh Aghamohammadi, A., & Sharifi, S. M. (2022). Investigating the Position of Artificial Intelligence in Human Resources from the Perspective of the Role of Artificial Intelligence in Eliminating Jobs (Case Study: News Anchoring). Media Futures Studies, 3(3), 36-64.
Kim, S.-K. (2024). Artificial Intelligence Blockchain Based Fake News Discrimination. IEEE Access, 12, 53838-53854. https://doi.org/10.1109/access.2024.3384338
Lewis, S. C., Guzman, A. L., & Schmidt, T. R. (2019). Automation, journalism, and human-machine communication: Rethinking roles and relationships of humans and machines in news. Digital journalism, 7(4), 409-427. https://doi.org/10.1080/21670811.2019.1577147
Marconi, F. (2020). Newsmakers: Artificial intelligence and the future of journalism. Columbia University Press. https://doi.org/10.7312/marc19136
Thurman, N., Dörr, K., & Kunert, J. (2017). When reporters get hands-on with robo-writing: Professionals consider automated journalism's capabilities and consequences. Digital journalism, 5(10), 1240-1259. https://doi.org/10.1080/21670811.2017.1289819
Wang, M. (2022). Artificial Intelligence-Driven Model for Production Innovation of Sports News Dissemination. Wireless Communications and Mobile Computing, 2022, 1-13. https://doi.org/10.1155/2022/6797243
Wölker, A., & Powell, T. E. (2021). Algorithms in the newsroom? News readers' perceived credibility and selection of automated journalism. Journalism, 22(1), 86-103. https://doi.org/10.1177/1464884918757072
Downloads
Published
Submitted
Revised
Accepted
Issue
Section
License
Copyright (c) 2025 محمد مهدی خیرجو, محمدرضا رسولی, اکبر نصراللهی (نویسنده)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
