URLs Can Facilitate Machine Learning Classification of News Stories Across Languages and Contexts

Authors

  • Ernesto de León PhD Student
  • Susan Vermeer Amsterdam School of Communication Research (ASCoR), University of Amsterdam, the Netherlands
  • Damian Trilling Amsterdam School of Communication Research (ASCoR), University of Amsterdam, the Netherlands

DOI:

https://doi.org/10.5117/CCR2023.2.4.DELE

Keywords:

political news, text classification, machine learning, distant classification, multilingual data

Abstract

Comparative scholars studying political news content at scale face the challenge of addressing multiple languages. While many train individual supervised machine learning classifiers for each language, this is a costly and time-consuming process. We propose that instead of relying on thematic labels generated by manual coding, researchers can use ‘distant’ labels created by cues in article URLs. Sections reflected in URLs (e.g., nytimes.com/politics/) can therefore help create training material for supervised machine learning classifiers. Using cues provided by news media organizations, such an approach allows for efficient political news identification at scale while facilitating implementation across languages. Using a dataset of approximately 870,000 URLs of news-related content from four countries (Italy, Germany, Netherlands, and Poland), we test this method by providing a comparison to ‘classical’ supervised machine learning and a multilingual BERT model, across four news topics. Our results suggest that the use of URL section cues to distantly annotate texts provides a cheap and easy-to- implement way of classifying large volumes of news texts that can save researchers many valuable resources without having to sacrifice quality.

Downloads

Published

2023-09-28

Issue

Section

Research Articles (regular issue)

How to Cite

de León, E., Vermeer, S., & Trilling, D. (2023). URLs Can Facilitate Machine Learning Classification of News Stories Across Languages and Contexts. Computational Communication Research, 5(2). https://doi.org/10.5117/CCR2023.2.4.DELE