Following the beaten track?

A sociology of knowledge perspective on information operations

Authors

1 Introduction

The manipulation of public opinion and discourse through information operations, including coordinated influence campaigns, has attracted much attention in recent years. In public debate, governmental security strategies, and scholarly discourse, foreign information operations have emerged as one of the most apparent threats to highly connected democracies (Farrell & Newman, 2021). Such antagonistic operations, generally deployed by one state against another, have been associated with the imperiled quality of democracy and increasingly radicalized political communication at the domestic level (Benkler et al., 2018; Bennett & Livingston, 2018). Such fears have been fueled by recent examples of foreign interference in (democratic) discourse, propagation of overtly false information, as well as a changing media landscape. Though these developments certainly merit study and scrutiny, more attention should be given to the wider societal context in which they take place. Inspired by Cinelli et al. (2019), we therefore hold information operations to be the intentional and targeted use of any information, directed by one state to another state, delivered through any vector, with the intent to disrupt or otherwise hinder the targeted state’s politics, society, and public discourse. The latter is the focus of this paper. Our orientation toward a substantive notion of discourse corresponds to the basic premise that those targeted by information operations are not blank slates to be inscribed without fail but are themselves entangled in ever-evolving yet solid webs of knowledge and discourse. If and how they will be affected by antagonistically deployed information is dependent on the targets’ learned heuristics and the stocks of knowledge that are prevalent in their respective societies.

Given the heterogeneous debate around informational threats to democracy, the comprehensive account of the phenomenon that we seek to provide has to include various strands of research. Apart from international relations and security studies, there is a particularly intense coterminous research activity in political communication. In this field, however, many empirical studies tend toward atomistic and individualistic conceptions of knowledge and information. Accordingly, research has emphasized the disruptive novelty or the alleged inaccuracy of particular pieces of information (fake or false stories) on a micro level, or proliferation patterns on a meso level (Allcott & Gentzkow, 2017; Vosoughi et al., 2018). Mechanisms and effects at the macro-level of public discourse have received comparatively less attention in the relevant literature (see Benkler et al., 2018 for a notable exception). This focus has changed only recently with several research articles examining this phenomenon at a societal level (Horowitz, 2021; Humprecht et al., 2020; Jungherr & Schroeder, 2021). In contrast, in international relations and security studies, the growing interest in information operations comes along with a strong emphasis on the macro level. Scholars in those fields have discussed the alleged effects on public trust in institutions or on common knowledge, often with little empirical evidence (Farrell & Schneier, 2018). While there are ways to reconcile both perspectives, for example, by studying societal processes of trust-building or knowledge generation, these steps have not yet been taken decisively or systematically.

To address this gap, this paper approaches information operations from a sociology of knowledge perspective, integrating extant literature from diverse fields of study with new empirical research. We assess the activities of RT (formerly Russia Today) in the context of the 2019 European elections. RT has been considered one of the cogs in the Russian state’s information operations apparatus by scholars and media observers alike (Elswah & Howard, 2020; Singer & Brooking, 2018). We apply a multi-method discourse analysis combining a quantitative machine-learning approach to the topical structuration of discourses (Roberts et al., 2019) with a qualitative analysis informed by the Sociology of Knowledge Approach to Discourse (Keller, 2005). For automated, time-sensitive pattern identification, we compare a corpus of news articles by RT with articles from two established news outlets of different types and quality in two countries: France and Germany. EP elections not only stand for an increase in relevant activity (EU vs DisInfo, 2021) but also provide a comparable context of political communication for various member states of the European Union (EU).

The remainder of this article proceeds as follows. After presenting the state of research on information operations, including disinformation campaigns, and the role of RT, we outline our theoretical approach and associated research hypotheses. A data and methods section follows in which we lay out our empirical research design. In Section 5, we present our findings, which are discussed in Section 6.

2 State of research

2.1 Political communication

Political communication research has been at the forefront of empirical research on the issue of disinformation, which is perceived as one essential element of information operations. International activities have mostly been this field’s subject, particularly concerning foreign (particularly Russian) interference in U.S. presidential elections. Allcott and Gentzkow’s influential study (2017) on the effects of so-called disinformation campaigns throughout the U.S. presidential election in 2016 scrutinized the consumption of disinformation based on pre-classified content, web-browsing data, and online survey data. The authors found that false stories in favor of Donald Trump were shared much more frequently than those in favor of Hillary Clinton. However, the findings suggest that the effects on users were very limited, as news consumption (including false news) was driven by selective exposure resulting in a mostly attitude-consistent effect (Allcott & Gentzkow, 2017; see also Allcott et al., 2019). In similar studies, other scholars found that selective exposure is a good explanatory factor for the consumption of false news (Guess et al., 2018) or the spread of disinformation via Twitter (Grinberg et al., 2019).

While much related work has concentrated on digital media, other scholars have studied the indirect effects that disinformation diffused via digital channels has on a general public debate mediatized in hybrid media systems (Chadwick, 2013), and thus included the role played by legacy media outlets. In particular, scholars problematized how legacy outlets might take up false stories or misleading narratives. Marwick and Lewis (2017) have explained such cross-media mechanisms of disinformation in general terms, while Jamieson (2018) posits that cross-media effects and disinformation could influence agenda-setting, priming, and framing during the U.S. presidential elections in 2016, enabling the influence that Russian information operations had in this particular case.

In contrast, other researchers highlighted the vital function that legacy media, particularly public service media organizations, can exert in countering disinformation, thereby contributing to what is known as public resilience to disinformation (Frischlich & Humprecht, 2021; Horowitz et al., 2021; Humprecht et al., 2020). These contemporary trends in research indicate a growing interest in the way various states, societies, and media systems address the phenomenon of disinformation campaigns at a societal level. They correspond to the demands voiced by leading scholars in the field (e.g., Jungherr & Schroeder, 2021) that to understand the effects of disinformation in the public sphere, it is necessary to “focus on the structural, not the novel” (Benkler et al., 2018, p. 384). Interestingly, such macro-level effects have been the prime concern of disinformation-related research in the fields of international relations and security studies.

2.2 International relations and security studies

Foreign information operations have gained great attention both in the political and scholarly discourse in recent years. The concept of information operations reaches wider than mere disinformation, which can, however, be one of its essential elements. While there are competing definitions of disinformation across subdisciplines, it is logical to reserve the term for pieces of information that are objectively untrue and spread with the intent to mislead. This view follows the narrow academic definition proposed by a high-level expert group for the EU: “All forms of false, inaccurate, or misleading information designed, presented and promoted to intentionally cause public harm or for profit” (European Commission, 2018, p. 11). Yet, common threat perceptions in international conflict have clearly exceeded such a narrow understanding and are equally concerned with disruptive information and stories, or so-called “false narratives,” which might include correct information but are nevertheless shared with bad intent. As our interest is in the international dimension of the phenomenon, we find long traditions both in political practice and academic research regarding international information operations (Macdonald, 2006; Rid, 2020). Following up on such strands, we conceive foreign information operations as the intentional and targeted use of any information, directed by one state to another state, delivered through any vector, with the intent to disrupt and otherwise hinder the targeted state’s politics, society, and public discourse (cf. Cinelli et al., 2019).

In recent years, IR scholars have increasingly drawn attention to the activities of malevolent foreign actors who are said to interfere strategically in the “information space” of a given society and manipulate public discourse – or even an election outcome (Omand, 2018). Researchers have mostly focused on the alleged activities of authoritarian regimes, which have presumably included information operations in their arsenal of hybrid warfare (Maréchal, 2017; Pomerantsev, 2014). In contrast, liberal democracies are perceived as finding themselves at a disadvantage in this asymmetric conflict constellation due to their normatively rooted abstention from restrictive measures in media control (Goldsmith & Russell, 2018; Shackelford et al., 2016). Against this background, not only realist accounts but also institutionalist scholars have argued that current information operations against democracies might provoke destabilizing tendencies within the targeted systems (Farrell & Newman, 2021).

While the severe concerns resonate well with the alarmist tone in public discourse, more critical and differentiated voices are questioning the assumption that there would be readily available tools for malevolent actors to significantly sway public opinion through information operations (Lanoszka, 2019; Rid, 2020). For both Rid (2020) and Lanoszka (2019), scenarios of foreign actors injecting neatly manipulated pieces of information and thereby diverting public discourse with immediate and sensitive effects seem highly unlikely. The recipients of disinformation are not “impressionable blank slates” (Lanoszka, 2019, p. 236) to which any novel piece of information will adhere equally well, nor are the propagators of disinformation clinical operators who avoid contamination from their work. As Rid (2020) says, “the stronger and more robust a body politic, the more resistant to disinformation it will be – and the more reluctant to deploy and optimize disinformation” (p. 11). From this perspective, the main function of information operations is seen in the creation of doubt, rather than actual persuasion (Gerrits, 2018; Rid 2020).

Regarding the predispositions of the target society, Lanoszka (2019) carved out the idea of a “second barrier” that successful information operations must penetrate. According to the author, this “second barrier relates to the pre-existing ideological commitments and mindsets of those individuals who may be exposed to disinformation” (Lanoszka, 2019, p. 228). From this perspective, Lanoszka fundamentally questions the strategic use and effects of information operations as “neither leaders nor average citizens are easily receptive to disinformation” (Lanoszka, 2019, p. 238). While we build on Lanoszka’s work, we question the theoretical foundations of these crucial resources for public resistance to foreign information operations. We maintain that conventional wisdom and pre-existing mindsets are not features expressed by individual actors but are instead dispositions obtained from social stocks of knowledge through processes of socialization. Before we introduce our sociology of knowledge-oriented approach to focus on the structural level of discourse and knowledge, we examine RT as our object of empirical inquiry and related research.

2.3 RT as a potential vector for information operations

RT was founded as Russia Today in 2005 as a more Russian-focused alternative to Western media, but it gradually changed from a news outlet to one of the branches of the Russian state’s information operations apparatus abroad (Singer & Brooking, 2018). Accordingly, recent scholarly work has focused on the role of RT as a propagator of conspiracy theories (Yablokov, 2015). This view is supported by Elswah and Howard’s (2020) study based on interviews with RT employees regarding the objectives and methods of RT. The authors identify RT’s interest in spreading conspiracy theories depicting Western states as flawed to generate controversy, thereby increasing Russia’s prominence. RT’s role in information operations has also been noted by journalistic integrity watchdogs. However, a lack of systematic research can partly be explained by the notorious difficulty to accurately “measure the channel’s success and influence” (Yablokov, 2015). The recent geopolitical situation, however, has put new public scrutiny on RT, leaving little doubt about institutionalized politics’ perception of RT as an agent of foreign information operations. Already in 2015, the EU installed its East StratCom Task Force with the explicit goal to counter Russian propaganda. 1 France has put restrictive measures on Russian outlets such as RT or Sputnik news with its 2018 law against false information (so-called “loi infox”). In Germany, the supervisory authority for the media sector banned RT’s German television channel in February 2022 as it did not operate under a proper license. Finally, after Russia started its war against Ukraine, in March 2022, the EU included a general ban on RT in its sanctions package against Russia (Regulation [EU] 2022/350). This ban was challenged by RT France in the European General Court, but it was upheld in the Court’s ruling on 27 July 2022 (case T-125/22).

Despite all evidence for malevolent activity and the political contention facing RT, it would not be appropriate to disqualify the entire news provision of RT as disinformation. Answering the question of whether a news outlet as such is propagandistic would require a thorough analysis of the veracity and presentation of its news output, which is not the goal of this paper. However, in the case of RT, we consider the existing literature to be convincing in establishing RT as a hybrid and dynamic news outlet that is inclined toward disseminating disruptive content. In what way RT provided a mix of proper news, aligned to the public discourse of the targeted society, and disruptive content, however, is a relevant question for this paper as is its corollary of how this practice might be key to understanding the way foreign information operations affect societies.

3 A sociology of knowledge perspective on information operations

To study the structural dimension of information operations, we propose a theoretical reorientation toward a sociology of knowledge perspective. Such a theoretical perspective helps avoid atomistic and individualistic misconceptions of information and knowledge prevalent in political sociology (see, e.g., Lupia & McCubbins, 1998) and political science more generally (for a critical discussion, see Dunn Cavelty, 2008; Schünemann, 2014, pp. 58-75, 2022).

Classic accounts in discourse theory and sociology of knowledge have made their basic assumption crystal clear that knowledge – and even the perception of reality – is socially constructed (Berger & Luckmann, 1991). It is materialized and processed in discourse and practice (Foucault, 2002). Thus, knowledge is not to be understood as the sum of single bits of information (nor disinformation). Knowledge is also not located at the individual level but at the level of society. As Scheler remarked, all knowledge is defined by a society and its structure (Scheler, 1960, p. 52). Knowledge is thus not a feature of the individual nor at their disposal. Individual actors obtain and appropriate knowledge through socialization in various community contexts (Berger & Luckmann, 1991, pp. 149 – 166). Against this backdrop, information as such has no meaning and thus would not exert any effects on a person, not to mention a social group or society as a whole. To take effect, it has to be interpreted based on social stocks of knowledge collectively built and preserved.

For information operations, we regard modern informational environments concerning the macro dimension of public discourse as complex, discursive formations. In contrast to many voices in the political and academic debate, we reject any understanding of information environments or public discourses as tabulae rasae wide open for discursive infiltration – even in liberal democracies. On the contrary, we expect the respective social stocks of knowledge to serve as effective filters of perception, providing a target society with a type of protective skin (akin to Lanoszka, 2019) discriminating against the foreign and the unknown (sometimes wrongly).

Thus, the theoretical reorientation introduced above leads us to expect that malevolent actors attempting to influence a foreign public necessarily adapt to the prevalent discourses in a targeted public, addressing elements of culturally specific stocks of knowledge. Instead of injecting unheard-of pieces of thought and information, we expect them to identify and attack preexistent discursive fault lines and vulnerabilities of a given society. Thus, we support a position expressed by French sociologist Jacques Ellul (1965) regarding the more general phenomenon of propaganda in the 1960s: “Propaganda must not only attach itself to what already exists in the individual, but also express the fundamental currents of the society it seeks to influence” (p. 38). Therefore, we would expect the agents of information operations to generally align their agenda and framing to the public discourse represented in the mainstream mass media. Only through this kind of strategic emulation would they be able to attract sufficient attention and outreach to serve as a news outlet more broadly and influence public opinion and discourse.

This expectation draws on structural features at the meso level, especially the privileged role played by various media actors that must not be neglected when studying macro-level discourse. First, social communication, especially what we understand as public discourse, is necessarily mediated (Couldry & Hepp, 2017). This structural condition provides media outlets with privileged positions of differing reach for channeling and filtering content and information, allowing them to co-determine what is addressed in the public arena, and at what time and at which intensity. Second, building upon this general rule, it is obvious that digitalization has transformed structures and mechanisms for the constitution of a public sphere, and thus public discourse, in several ways (Chadwick, 2013; Jungherr & Schroeder, 2021). We acknowledge these developments and concede that they have complicated the identification of public discourse as well as the reconstruction of its formative rules, but this does not revert our basic assumptions.

Objections to our theoretical position might also build on empirical insights showing that scandalous news expressed in a negative tonality are likely to attract more attention and be spread more widely than positive messages. While such generic behavioral rules are certainly compelling, they are not independent and thus compatible with a sociology of knowledge perspective. Early accounts of the theory have highlighted that these kinds of instincts cannot themselves be regarded as free from social construction (Mannheim, 1964, p. 365). Thus, similar to atomistic conceptions of knowledge, paradigms of instinctive reactions can provide half of an explanation at best (Anderson, 2021). While the informational soup might indeed be spiced universally to trigger individual instincts, we might still observe relevant variation concerning the substantial ingredients selected according to local tastes or customs.

Building on our social-constructivist theory, we expect foreign information operations to align with socio-culturally specific patterns of public discourse. As to the temporal variation, we expect RT to follow public discourse on divisive topics, rather than plant the seeds for a dominant topic (H1). Moreover, we hypothesize that RT addresses divisive issues that promise affective reactions (H2). We finally expect RT’s information operations to reflect alignment to prevalent interpretative schemes and knowledge elements within certain topics (H3). We expect all three hypotheses to hold in different national media systems, thus requiring a comparative research design.

Therefore, we can formulate the following hypotheses:

  • Hypothesis 1: RT news coverage follows the agenda of public discourse as represented by established news media.
  • Hypothesis 2: RT news coverage emphasizes divisive issues that promise affective reactions.
  • Hypothesis 3: RT’s framing aligns with prevalent interpretative schemes and knowledge elements in the respective national public discourse as represented by established news media.

4 Data and methods

This paper empirically tests the aforementioned hypotheses through an analysis of a composite corpus of news articles from Germany and France published between 23 February 2019 and 30 June 2019. 2 These dates comprise the run-up to and the aftermath of the 2019 European elections campaigns. Two main reasons support the selection of this period. First, election campaigns, including EP elections, have served as prime contexts for foreign actors to conduct large-scale information operations (European Parliament, 2019). Hence, we expect an increased activity of this sort during the selected period. As it is beyond the interest and scope of this paper to assess the veracity and factuality of each article published by RT to determine whether it is “disinformation,” RT is assumed at a more general level as a vehicle for Russian information operations in Western European countries. This is in correspondence both with academic literature and political assessments. Thus, we are not concerned with the amount of disinformation disseminated during our observation period, but rather the techniques employed by RT to position itself in public discourse. Second, we selected this research period because national elections in all member states occur at about the same time, providing a similar context of political communication across EU countries and thereby making our cases more comparable.

RT is a particularly useful case study due to its (former) presence in multiple countries and multilingual content. This audience reach allows for comparisons on a country- and language-level basis, which will help identify any potential country-specific features of disinformation campaigns. The two countries, France and Germany, were chosen because they appeared as the main targets of information operations attributed to Russia (EU vs DisInfo, 2021). RT versions have been available in both countries (until March 2022) and, according to respective reports, have served as important outlets for spreading disinformation. Finally, another advantage of our case selection is that by assessing information operations in non-Anglophone countries, we make a different and complementary contribution to the existing literature that has already covered the Anglosphere extensively.

To gather a relevant sample of mainstream news media to serve as a representation of the respective public discourse, we built corpora with news articles from one regular newspaper and one tabloid newspaper: Die Welt and Bild for Germany, and Le Figaro and FranceSoir for France, respectively. The articles used in the dataset were scraped from the German and French websites of RT, as well as from the FranceSoir website, while the articles from Die Welt, Bild (+ Bild am Sonntag) and Le Figaro were downloaded via the LexisNexis database. As mainstream news outlets cover a much broader range of issues than RT, which is mostly focused on political news, we used the outlet-assigned sections for filtering news articles that did not fit the orientation toward political news. 3 We also excluded articles below a length threshold of 180 words for all corpora as brief news items do not allow for substantial analysis. In addition to the text bodies, we utilized metadata in all subsets for the measurement of covariate effects such as source (the name of the outlet) and date (the exact date of the publication). Additionally, headlines were kept for qualitative topic evaluation and labeling. The subsets were curated and aligned to combine them into an integrated dataset per national case. Table 1 provides an overview of the number of articles included per outlet and case.

Concerning the resulting dataset, one could of course object that our selection is biased toward a right-wing conservative spectrum and does not fully represent the mainstream media discourse. Although we agree, this accent in our selection of outlets is deliberate as we would expect RT mostly to address readers in that spectrum. With this focus, we can detect meaningful variation regarding our research question rather than differences produced by the divergent ideological positions present in the general public discourse.

Table 1: Composition of corpora for both cases

Die Welt

3260

Le Figaro

3954

Bild

1195

France Soir

1252

RT Deutsch

2886

RT France

2123

We used the R programming language’s Quanteda textmining toolbox (Benoit et al., 2018) for preparing the text corpora. We removed stopwords and URLs and compounded frequent collocations (e.g., first and last names) before employing Structural Topic Modelling (STM) (Roberts et al., 2019). STM is a viable choice for our analysis, as it allows modeling covariate effects on topic distribution for both the various news outlets, as well as the timeline in which trends and/or clusters of topics emerge. Therefore, we utilized both the outlet and the day of publication as prevalence variables. To allow for non-linear effects on the topics, the day variable was splined as suggested by STM’s authors (Roberts et al., 2019). For reproducible and less initialization-sensitive models, we chose STM’s spectral initialization method (Roberts et al., 2016). Even though progress has been made in utilizing machine-translated documents for quantitative text analysis (Vries et al., 2018), we ran separate topic models for the French and German corpora to better account for the expected socio-cultural differences. 4 Finally, we utilized the STM package’s native regression functions to estimate the effects of our prevalence variables and account for the specific uncertainty introduced in model fitting (Roberts et al., 2019). The R package ggplot2 was used for visualizations (Wickham, 2010).

As suggested by STM’s authors (Roberts et al., 2019), we evaluated topic models (with k = 5 up to k = 25) based on key performance statistics (exclusivity, semantic coherence, residuals, held-out likelihood) and selected three models for France and Germany respectively. These statistics can be found in Appendix A. We labeled topics for all three models and evaluated consistency and validity based on an interpretative classification. To label the identified topics, we inspected the top terms and headlines of articles with high topic proportions (theta ≥ 0.7) per topic per case. We reevaluated the model and relabeled the topics over several rounds of reading and interpretation before settling on a model with 12 topics for the German and a model with 14 topics for the French case.

For the fine-grained qualitative analysis of topic-specific document samples, we chose the sociology of knowledge approach to discourse (Keller, 2005, 2013) as a theory-consistent methodological orientation. Via qualitative inquiry, we could identify recurrent interpretative schemes. Based on Keller’s fundamental typology, we focused our analysis on basic frames and narratives. Defined as specific structures of meaning-making, frames tell or invoke a story in that events are ordered along a supposed chronology, suggesting causal relations. For instance, some documents portray the political situation in the United Kingdom regarding Brexit implementation as chaos and paralysis caused by a misled referendum (e.g., Collomp, 2019). Other sources depict the success of the Brexit Party in EP elections as an embarrassment for people who would try to delegitimize the democratic vote in the referendum (e.g., “Le parti du Brexit“, 2019). These two examples demonstrate two competing frames. In contrast, the story of the Venezuelan interim president Guaidó allegedly having orchestrated a coup against the democratically elected Maduro government (as told e.g., in “Guaidós Putschversuch gescheitert”, 2019) would qualify as a narrative.

We filtered documents by picking the 10 documents with the highest topic proportions for each topic and outlet per case. Selected documents have been analyzed by close-reading and consecutive rounds of coding with an inductively developed codebook (Appendix D). A minimum of five documents per outlet and topic were analyzed until saturation was reached, up to a maximum of 10 documents. Codebook development and coding were exerted in the MAXQDA software environment.

5 Results

5.1 Topic modeling and quantitative analysis

We start our presentation of results with a comparison of the relative topic proportions across the three different outlets per case, which accounts for the differing number of articles between outlets. 5 Figure 1 shows this overview of the German case with its 12 topics. First, the figure reveals that topic proportions diverge between the outlets. There are only a few topics for which relative topic proportions are similar for all three outlets: the topics “Crime & Justice” and “Party Politics & Governmental Coalition.” Proportions are similar for “EU Politics & EP Elections” at least for RT Deutsch and the quality newspaper Die Welt (Welt), while the tabloid Bild produced less content on the topic. Economic and financial topics are mostly covered by Welt articles, while unsurprisingly, “Real Life Stories & Celebrity News” are a specialty of Bild, with the respective topic proportions unmatched by Welt or RT Deutsch. In comparison to the other outlets, RT Deutsch is preoccupied with international affairs. Typical international content produced four different topics covering political crises in Venezuela, Ukraine, and the Middle East as well as a major power play between the United States, China, and Russia.

Figure 1: Relative topic proportions by outlet in the German corpus. Topic proportions are normalized over the number of articles per outlet.

The overview of relative topic proportions for the French case based on the selected model with k = 14 topics can be found in Figure 2. We find more or less similar shares for the topics “Party Politics & Elections” and “Brexit & EP Elections” while relative topic proportions diverge for the other topics. This is again particularly true for at least four of the five topics that are related to international affairs and crises. The French tabloid-like paper FranceSoir is dominant in the “Crime & Justice” topic. Again, the quality newspaper shows a higher news production on economic and financial issues. Interestingly, while both topic models (on the French and German cases) show remarkable similarities at this categorical level, there is at least one country-specific topic related to the so-called yellow vest protests that shook the country. The figure shows high topic proportions for the tabloid as well as RT France. The “Scandals & Criminal Proceedings” topic also seems country-specific, especially regarding its second focus. Both topics (“Yellow Vests Protest Movement” and “Scandals & Criminal Proceedings”) are striking given the high relative topic proportions for RT France.

Figure 2: Relative topic proportions by outlet in the French corpus. Topic proportions are normalized over the number of articles per outlet.

At this abstract level of analysis, topical structuration and thus the basic categorical scheme appears to be similar for both national cases: France and Germany. Moreover, we find similar patterns of activity for RT outlets in both cases. This harmonious comparative picture is, however, somewhat troubled by the unique topics in the French case. For both topics, we see remarkable activity in RT France. The news production that produced the yellow vests topic is particularly grounded in the specific context of French politics and social movement protests throughout our research period. Considering temporal variation, metadata analysis allows for the time-sensitive analysis of the topical prevalence between the three outlets for each case. Figure 3 is a respective multiplot for the German case, and Figure 4 offers an overview of the French case. 6

For the German case, we observe that for most topics, RT Deutsch follows a similar trend line as given by at least one of the other outlets. The “Brexit & UK Politics” topic might show some deviance for RT Deutsch, but this is at a rather minor level of topic proportions. Again, as for the static overview, we see that RT Deutsch seems to play out its particularity with respect to international affairs issues, whereas the numbers for RT seem to be somewhat decoupled and far exceed the values of the other outlets. These findings are supported by the results of the regression found in Appendix C-I., which show a significant positive impact of the outlet RT on the majority of these topics even when controlled for the day. However, in these remarkable cases, similarities in trend lines are seen in comparison to the other outlets (see, e.g., the topics “International Affairs I” and “International Affairs II”).

For the French case, relative topic proportions over time reveal similar trend lines for RT France with at least one of the other outlets, often both of them. While in correspondence to what we have learned from the static view, RT operated at a different level of activity concerning international affairs-related issues, the gap between RT France and the other outlets is generally bigger for International Affairs I, II, and III, but less so for International Affairs IV and V. Compared to the German case, this observation shows a partly significant but lower impact for the outlet RT when controlled over time, which is supported by the regression results found in Appendix C-II. Additionally, for the two country-specific topics with higher topic probabilities for RT France, news production of the alleged propaganda outlet is not divergent from established news media but is instead aligned to the general trend line.

Results at this abstract level of analysis as depicted by Figures 1 – 4 allow for preliminary assessments concerning the first two of our hypotheses. We can make an affirmative assessment for Hypothesis 1: Generally, news production of RT outlets tends to follow the trend lines shown by mainstream news media topic coverage. Some remarkable exceptions are noted, however, regarding international affairs-related issues, especially for the German case study. In contrast, we find a mixed picture for Hypothesis 2. International affairs, while generally being standard topics on the news agenda, cannot be regarded as particularly divisive issues in public discourse and politics. However, RT outlets focus on international topics in their news production. Nevertheless, the two country-specific topics for the French case, in particular, the yellow vest movement, suggest that RT France identified a country-specific divisive issue to address and thereby provoke affective reactions, attempting to contribute to social unrest in this particular case.

5.2 Qualitative analysis

For our qualitative inquiry, we selected several topics for each case. Given our research period and the reasoning behind it, we elected to conduct an in-depth examination of the then-ongoing EP election campaign in each of the cases. For the German case, we investigated “EU Politics & EP Elections” plus “Brexit & UK Politics.” For the French case, we observed “Brexit & EP Elections” plus “Party Politics & Elections.” Moreover, we decided to analyze two out of the four and five topics related to international affairs. We based our selection on topic proportions and the significance of RT’s preoccupation as well as the comparability between the cases. We selected “International Affairs I: Political crisis in Venezuela” and “International Affairs II: Iran, North Korea, USA, China & Russia” for Germany as well as “International Affairs I: Political Crisis in Algeria and Venezuela” and “International Affairs III: China, Russia, USA, North Korea” for France. To shed light on another field of news coverage expected to include a high amount of affective content, we selected “Crime & Justice” for the German case and “Scandals & Criminal Proceedings” for the French case. Finally, given its peculiarity, we additionally selected the topic “Yellow Vests Protest Movement” for the French case. Visual synopses of within-case comparisons per topic are given in Appendix E.

5.2.1European politics and EP elections

The topical corpora related to European Politics and EP Elections show many similarities in both national cases. However, the within-case comparison also reveals some interesting differences. Many articles in both samples (“Brexit & UK Politics” for the German, and “Brexit & EP Elections” for the French case) deal with the then ongoing Brexit negotiations. In all outlets (in particular the mainstream media outlets), the political situation in the United Kingdom is repeatedly depicted as chaotic (“Brexit-Chaos,” e.g., Bolzen, 2019; “Brexit-Irrsinn,” e.g., Block, 2019), with the political system in paralysis (“la paralysie politique à Londres,” Collomp 2019). Articles reproduce the narrative of leading British politicians who are increasingly panicked by a no-deal Brexit scenario at the doorstep yet unable to find a political compromise allowing for a deal with Brussels. The German Bild, for instance, posed the rhetorical question: “How can the political tug-of-war about the British EU exit get any crazier?” 7 (Kleine et al., 2019).

Regarding intergovernmental negotiations on further extensions of the deadline for a deal, in major newspapers, the French government’s strict position is reported mostly in an affirmative manner (Collomp, 2019). The government’s clear stance is portrayed as a legitimate position toward domestic chaos in the UK. Common frames of the situation ascribe responsibility for the situation to the United Kingdom and its political elites. However, a closer look reveals a different framing for RT. In clear contrast to the mainstream media critically commenting on the Brexit decision, similar criticisms cannot be observed for RT articles. In contrast, RT authors criticize Remainers for not accepting but rather seeking to delegitimize the direct democratic decision. Opinion polls showing the Brexit Party ahead and its later victory in the election are reported with grains of satisfaction and irony, relying on its interpretation as a clear electoral confirmation of the referendum outcome (“Le parti du Brexit“, 2019).

Regarding the EP elections, articles in the German corpus overall show a greater issue-orientation, while the elections in France were dominated by domestic party politics, as they were the first national elections since the successful presidential campaign of Emmanuel Macron. With the transition of the French party system evolving further and the personal engagement of President Macron in the campaign, all outlets discussed the risk of the elections turning into a protest vote against the government. The framing in many RT France articles, however, is significant in the way they explicitly took up the frame of an “anti-Macron referendum” that had been established by right-wing extremists during the campaign. In this vein, after the slight victory of the right-wing Rassemblement National ahead of Macron’s list, an article stated: “Emmanuel Macron has turned this electoral challenge into a referendum on his political performance and the eventual defeat justifies the following assessment: the government finds itself weakened after these European elections” (”désaveu pour La République en marche”, 2019).

In the German corpus, however, numerous articles regard the pros and cons of EU integration and current EU policies. For Bild and Welt, we find both positive and critical assessments and perspectives illustrated by statements and quotes that reproduce common frames and narratives. These include the “EU as a peace project” or an “economic success story” on the one hand, and frames of an “emergent transfer union with little orientation toward financial stability,” so-called “faceless bureaucrats,” or the often-diagnosed democratic deficit on the other hand. Although such frames and narratives are also part of the discourse reproduced by RT, reported assessments are exclusively critical. Statements include frames that are typical for right-wing or left-wing Euroscepticism such as the narrative of a “European superstate undermining national sovereignty” or the allegedly “neoliberal” character of EU economic governance (e.g., Ungar, 2019).

5.2.2International affairs-related topics

The international affairs-related topics that are of key importance for RT content production the French and the German case reveal a similar orientation toward major crises on the international scene as well as geopolitical rivalry and conflict between major powers such as the United States, China, and Russia. We can observe more coverage and intensive discussion on the political turmoil in Algeria for the French case when compared to the German case. This comparatively high interest in the issue is mirrored by all three outlets under analysis, including RT. This preoccupation can be explained by the colonial history of Algeria, the close relations between both countries, and especially parallel protests being held across France about the situation in Algeria in the weeks under study.

Within-case comparisons between outlets for the respective subsamples show some of the clearest divergences in how the respective issues are discussed with no or only little overlap in crucial frames of the respective situations, especially for the reporting of the Venezuelan crisis, but also the Iranian crisis and major power rivalry. Starting with the Venezuelan crisis, this issue was extensively covered by German outlets in the spring of 2019. Bild and Welt articles portray the turmoil that was driven by opposition forces around self-proclaimed interim president Guaidó (“Hoffnungsträger,” ” Blutiger Machtkampf”, 2019) as a legitimate rebellion against the repressive regime of authoritarian leader Maduro (“dictator,” Käufer, 2019).

According to the prevalent narrative, President Maduro had committed electoral fraud to stay in office and then used excessive violence to smash democratic protests: “Maduro has once more shown that he is ready to literally walk over dead bodies if necessary for staying in power” (Käufer, 2019). Such interpretative schemes are countered by the discourse produced in RT articles. From this perspective, the actions taken by oppositional forces around Guaidó are regarded as part of an illegitimate coup against the democratically elected government of President Maduro: “Also the most recent coup attempt by the self-proclaimed ‘interim president’ of Venezuela, Juan Guaidó, against the elected President Nicolas Maduro failed” ( “Oppositionsführer Guaidó und López”, 2019). Moreover, in clear contrast to mainstream media, the protest movement is depicted as violent and steered from abroad. Accordingly, U.S. engagement is portrayed as an illegitimate foreign interference in Venezuelan domestic affairs ( “Guaidós Putschversuch gescheitert”, 2019).

In another subcorpus with documents dealing with international affairs from the German case, the articles in our sample mostly covered the conflict between the United States and Iran after U.S. President Trump had canceled the Iran nuclear deal initially approved by his predecessor in 2015. The issue was brought to the fore by a row of violent incidents, in particular the shooting of a U.S. drone by Iranian troops in June 2019. In contrast to RT, Bild and Welt articles put the incident in the context of the overall conflict. As to the general framing, the escalation of the conflict is attributed to the Iranian regime, at least in Bild articles (e.g., Schippmann & Bräuner, 2019). In both outlets, articles interpret the renunciation of a military counterstrike by the Trump administration as diplomatic behavior (e.g., WELT, 2019). In contrast, RT articles reported statements that depict this act as an admission of guilt. RT articles also repeatedly refer to sources that argue for a violation of the Iranian airspace by the U.S. drone: “US fiddle about the shooting of a 170 million dollar drone” (“US-Mauschelei um iranischen Abschuss”, 2019).

Shifting to those documents wherein major power rivalry is the explicit focus, including either the trade conflict between China and the United States or the conflict between Russia and the West (EU and the United States) following the Crimea annexation in 2014, a within-case comparison reveals a more clear divergence between RT and the mainstream outlets. For both crisis contexts, the mainstream outlets include balanced interpretations. Thus, for instance, China is depicted as an important partner in international trade relations for France and the EU, while at the same time its international outreach especially in the framework of its New Silk Road Initiative is seen as a potential threat and a commercial attack on Europe (e.g., “L’Union européenne se saisit de la 5G”, 2019). In their critical framing of the U.S. position and particular policies, especially the emphasis put on an autonomous policy definition by the European side in international trade policy but also foreign and security policy (“Europe Puissance”), several articles in French legacy media outlets take up core elements of socio-specific stocks of knowledge and interpretative schemes (e.g., “L’Otan a 70 ans”, 2019). While presenting some potentially compatible elements to French foreign policy discourse, namely the critical framing of U.S. dominance, this criticism appears much more outspoken and one-sided in RT outlets. Thus, the prevalent narrative in RT articles would be that the United States was responsible for the escalation of both crises. For instance, an RT Deutsch piece concerned the crisis with Iran: “US opt for escalation and block the road toward a diplomatic solution with a new wave of sanctions” (“USA setzen auf Eskalation“, 2019). In particular, Western sanctions against Russia (“anti-Russian sanctions”) are depicted as illegitimate elements of a US-led strategy for global dominance (e.g., “Poutine et Xi font front commun”, 2019). The Russian government is instead attested a diplomatic behavior, even toward the Ukrainian government after the election of President Zelensky in April 2019 (“Poutine salue la politique de détente“, 2019). The interpretation of Russian activities during the Ukrainian crisis is markedly different for RT. The annexation of the Crimea, which is depicted in legacy media outlets as a red line crossed by the Russians clearly violating international law, is portrayed in RT articles as a legitimate “re-incorporation” into the Russian state after a democratic referendum that had been won by the respective constituency (“A Moscou, Xi et Poutine célèbrent la lune de miel”, 2019).

5.2.3Crime & scandals, protests in France

Qualitative analysis of topics related to criminal offenses quite naturally produces variation between the national cases as the expected outcome. News coverage is incident-driven on a domestic scale and thus follows a particular national media logic with only few cross-border incidents to be reported. Thus, variation is not surprising here. However, the preoccupation of German media outlets in the sample with violent attacks purportedly committed by immigrants is an interesting finding. In this common framing of security incidents as a migration-related problem, RT is similar to the tabloid Bild which seems to be even more active and explicit in this regard (e.g., Keim, 2019; “Brutale Gruppenvergewaltigungen in Düsseldorf“, 2019). In contrast, comparable cases are not as prominently reported in the newspaper Welt.

The respective topic selected for the French case is instead oriented toward political scandals. In particular, a political affair about ex-security officer and deputy chief of staff Alexandre Benalla is of key importance. 8 The Benalla affairs were related to the issue of the yellow vest protest movement that has been additionally selected for qualitative analysis due to its peculiarity for the French case and the likelihood to attract emotional and affective reactions. Although coverage of the issue in RT is similar to what is provided by the quality newspaper Figaro with respect to extent and framing (namely highlighting the political character of the affair), we have a more mixed picture with respect to within-case comparison between the outlets. The framing of the protest events toward the violent engagement of police forces appears only in FranceSoir and on RT. A more positive or neutral framing of police forces and their engagement can be found in the Figaro articles and again also in FranceSoir articles. Even in the RT corpus, we find individual articles that emphasize the solidarity between normal protesters and the police. Therefore, in RT articles only, an opposition is carved out more clearly between the people including protesters and police on the one hand and the political establishment on the other (cf. Rives, 2019).

6 Discussion & conclusion

A combined view of quantitative and qualitative results allows us to conclude with the following assessments regarding our three hypotheses. First, as quantitative, static, and time-sensitive analyses have shown, the news production of RT was generally aligned to public discourse and followed the trend lines observed for mainstream news media (H1). However, we could also observe RT’s outstanding activity in a number of international affairs-related topics, including Brexit and EU Politics. These findings clearly stand out as exceptions due to their unusually high activity.

As suggested above, we have mixed support for hypothesis 2. RT news outlets were indeed active in covering divisive issues for national publics that were likely to produce affective reactions, such as criminal offenses and political scandals or, most notably for the French case, the yellow vest protest movements. Nevertheless, the RT outlets’ preoccupation with topics related to international affairs runs counter to this assumption as those topics cannot be seen as divisive issues and can be considered unlikely to have produced affective reactions in larger audiences.

Finally, given the dominance of international affairs related topics in the RT news corpora with articles that strongly differ from common framing in established mainstream newspapers, we cannot lend outright support to hypothesis 3. For these main fields of RT activity, we see how authors seek to introduce alternative interpretations and frames, such as alternative ways of meaning-making with respect to major international crises, great power rivalry and especially the opposition between the United States and Russia. While the latter is hardly surprising given the fact that RT outlets are state-sponsored media operating in foreign countries to improve or correct the image of Russia, this effect has become clearer through our analysis unearthing the unique dominance of these topics and their one-sided framing. One should note, however, that similar observations could not be made for the other topic-related corpora. Instead, for the other subcorpora of relevance for RT – crime and political scandals, the yellow vest protest movement and European politics – we can mostly observe a similarity in framing with at least one of the mainstream outlets (with the notable exception of Brexit-related news).

All in all, our findings show a diversified approach of strategic communication for RT news outlets. While RT outlets broadly orient their news coverage toward national public discourse, they aim to set a particular tone in a number of strategically selected topics. While the first observation is in line with our expectations based on the sociology of knowledge, the latter implies a strategic motivation behind their engagement that is less dependent on the domestic discursive contexts. However, this matches the strategic role that is ascribed to RT in previous research. Covering relevant topics and taking up common discursive patterns for most of them might be a prerequisite for entering a national news market and attracting audiences therein. Adjusting to the nationally structured stocks of knowledge would then be a precondition for presenting alternative meaning-making for selected topics of strategic importance. Thus, following the beaten track of public discourse might generally put media actors like RT in a position to gain the reach and “credibility” needed as a news outlet to spread alternative frames and narratives and counter the mainstream discourse. In our study, these alternative frames were particularly visible in the depiction of international affairs, supporting and legitimizing Russian foreign policy.

Our paper not only makes a theoretical contribution to the ongoing scholarly debates on information operations that could bridge the gap between macro-oriented problem definitions and micro- and meso-level-oriented empirical evidence. It also bridges the scholarly discussions in political communication and international relations by introducing a new interdisciplinary perspective. Thus, it contributes to a more differentiated assessment of foreign information operations that may otherwise trigger a “moral panic” about disinformation at large and its alleged effects on democracy (Jungherr & Schroeder, 2021). Moreover, with our empirical observations, we give novel insights from a comparative study of news streams in Germany and France and present a multi-method approach combining topic modeling with qualitative analysis. While we would assess the methodological combination positively as it produced interpretable and insightful results, we also want to point to the limitations when applying topic modeling in social science research and especially comparative analyses. Topics as bag of words models produced by STM need to be treated with a grain of caution regarding their interpretability, especially when it comes to comparative analysis between different corpora and national contexts. We addressed this problem by exerting qualitative analyses and evaluating our findings at various stages. However, further developments in methodological research are needed to make such combined approaches more robust and adapt them to the needs of comparative research. Another limitation is that our sample does not fully represent the mainstream media sphere in our selected countries. We focused our analysis on news outlets that we expected to represent a potential overlap with RT’s audience, which would allow the latter to gain traction within the national discourse.

With RT having been removed from the media market in Western European countries in reaction to the Russian war against Ukraine, our findings maintain a retrospective value. While possibilities for generalizations are always limited, they appear even more reduced in face of the brutality with which Russian geopolitical goals have come to light in the beginning of 2022. We would however argue that, given the diverse hybrid media environment we live in, the relative openness of democratic societies, and the expected increase in the intensity of international conflict, our study provides valuable insights that can be built upon both when studying ongoing information operations at the international scene and when reflecting upon the vulnerabilities and resilience mechanisms of democratic societies.

References

Allcott, H., & Gentzkow, M. (2017). Social Media and Fake News in the 2016 Election. Journal of Economic Perspectives, 31(2), 211 – 236. https://doi.org/10.1257/jep.31.2.211

Allcott, H., Gentzkow, M., & Yu, C. (2019). Trends in the diffusion of misinformation on social media. Research & Politics, 6(2), 1 – 8. https://doi.org/10.1177/2053168019848554

Anderson, C. W. (2021). Fake News is Not a Virus: On Platforms and Their Effects. Communication Theory, 31(1), 42 – 61. https://doi.org/10.1093/ct/qtaa008

Bennett, W. L., & Livingston, S. (2018). The disinformation order: Disruptive communication and the decline of democratic institutions. European Journal of Communication, 33(2), 122 – 139. https://doi.org/10.1177/0267323118760317

Benoit, K., Watanabe, K., Wang, H., Nulty, P., Obeng, A., Müller, S., & Matsuo, A. (2018). Quanteda: An R package for the quantitative analysis of textual data. Journal of Open Source Software, 3(30), 774. https://doi.org/10.21105/joss.00774

Benkler, Y., Faris, R., & Roberts, H. (2018). Network Propaganda: Manipulation, disinformation, and radicalization in American politics. Oxford University Press.

Berger, P. L., & Luckmann, T. (1991). The social construction of reality: A treatise in the sociology of knowledge. Penguin.

BILD. (2019, February 24). Blutiger Machtkampf an der Grenze zu Venezuela: Hoffnungsträger Guaido bringt erste Hilfslieferungen. BILD.

Block, T. (2019, March 23). Wie hält May den Brexit-Irrsinn aus? BILD. https://www.bild.de/politik/ausland/politik-ausland/unter-dauerbeschuss-wie-haelt-may-den-brexit-irrsinn-aus-60839238.bild.html

Bolzen, S. (2019, March 30). 50 Shades of No: Theresa Mays Deal scheitert ein weiteres Mal. WELT. https://www.welt.de/print/die_welt/article191076781/50-Shades-of-No-Theresa-Mays-Deal-scheitert-ein-weiteres-Mal.html

Cinelli, M., Conti, M., Finos, L., Grisolia, F., Kralj Novak, P., Peruzzi, A., Tesconi, M., Zollo, F., & Quattrociocchi, W. (2019). (Mis)Information Operations: An Integrated Perspective. Journal of Information Warfare, 18(2), 83 – 98.

Chadwick, A. (2013). The hybrid media system: Politics and power. Oxford University Press.

Collomp, F. (2019, May 27). L’Europe n’en a pas fini avec le Brexit. Le Figaro. https://www.lefigaro.fr/international/l-europe-n-en-a-pas-fini-avec-le-brexit-20190527

Couldry, N., & Hepp, A. (2017). The mediated construction of reality. Polity Press.

Dunn Cavelty, M. (2008). Cyber-security and threat politics: US efforts to secure the information age. Routledge.

Ellul, J. (1965). Propaganda. The Formation of Men’s Attitudes. Vintage Books.

Elswah, M., & Howard, P. N. (2020). “Anything that Causes Chaos”: The Organizational Behavior of Russia Today (RT). Journal of Communication, 70(5), 623 – 645. https://doi.org/10.1093/joc/jqaa027

European Commission. (2018). A multi-dimensional approach to disinformation: Report of the independent high level group on fake news and online disinformation. Publications Office of the European Union.

European Parliament. (2019). Foreign electoral interference and disinformation in national and European democratic processes. European Parliament resolution of 10 October 2019 on foreign electoral interference and disinformation in national and European democratic processes (2019/2810(RSP)).

EU vs DISINFORMATION (2021). Vilifying Germany; Wooing Germany. Retrieved from https://euvsdisinfo.eu/villifying-germany-wooing-germany/

Farrell, H., & Schneier, B. (2018). Common-Knowledge Attacks on Democracy. Berkman Klein Center Research Publication, 2018(7). https://doi.org/10.2139/ssrn.3273111

Farrell, H., & Newman, A. L. (2021). The Janus Face of the Liberal International Information Order: When Global Institutions Are Self-Undermining. International Organization, 75(2), 333–358. https://doi.org/10.1017/S0020818320000302

Foucault, M. (2002). Archaeology of knowledge. Routledge.

FranceSoir. (2019, April 3). L’Otan a 70 ans: entre “menace russe” et hausse des dépenses militaires en Europe. France Soir. https://www.francesoir.fr/politique-monde/otan-70-ans-la-menace-russe-hausse-depenses-militaires-europe

FranceSoir. (2019, June 26). L’Union européenne se saisit de la 5G.
France Soir. https://www.francesoir.fr/politique-monde/lunion-europeenne-se-saisit-de-la-5g

Frischlich, L., & Humprecht, E. (2021). Trust, Democratic Resilience, and the Infodemic. Policy Paper Series by the Israel Public Policy Institute: “Facing up to the Infodemic: Promoting a Fact- Based Public Discourse in Times of Crisis”. Heinrich Böll Stiftung.

Gerrits, A. W. M., (2018). Disinformation in International Relations: How Important Is It? Security and Human Rights 29(1 – 4), 3 – 23. https://doi.org/10.1163/18750230-02901007

Goldsmith, J., & Russell, S. (2018). Strengths Become Vulnerabilities: How a digital world disadvantages the United States in its international relations. Aegis Series Paper, 1806, 1 – 22.

Grinberg, N., Joseph, K., Friedland, L., Swire-Thompson, B., & Lazer, D. (2019). Fake news on Twitter during the 2016 US presidential election. Science, 363(6425), 374 – 378. https://doi.org/10.1126/science.aau2706

Guess, A., Nyhan, B., & Reifler, J. (2018). Selective Exposure to Misinformation: Evidence from the consumption of fake news during the 2016 US presidential campaign. European Research Council, 9(3), 1 – 14.

Horowitz, M., Cushion, S., Dragomir, M., Gutiérrez Manjón, S., & Pantti, M. (2021). A Framework for Assessing the Role of Public Service Media Organizations in Countering Disinformation. Digital Journalism, 10(5), 843 – 865. https://doi.org/10.1080/21670811.2021.1987948

Humprecht, E., Esser, F., & van Aelst, P. (2020). Resilience to Online Disinformation: A Framework for Cross-National Comparative Research. The International Journal of Press/Politics, 25(3), 493 – 516. https://doi.org/10.1177/1940161219900126

Jamieson, K. H. (2018). Cyberwar: How Russian hackers and trolls helped elect a president; what we don’t, can’t, and do know. Oxford University Press.

Jungherr, A., & Schroeder, R. (2021). Disinformation and the Structural Transformations of the Public Arena: Addressing the Actual Challenges to Democracy. Social Media + Society, 7(1), 205630512198892. https://doi.org/10.1177/2056305121988928

Käufer, T. (2019, February 24). Venezuela-Krise: Washingtons wütende Hilflosigkeit. WELT. https://www.welt.de/politik/ausland/article189332941/Venezuela-Krise-Washingtons-wuetende-Hilflosigkeit.html

Keim, K. (2019, May 8). Alen erstochen: Mutmaßlicher Täter hätte abgeschoben werden können. BILD. https://www.bild.de/bild-plus/regional/muenchen/muenchen-aktuell/alen-17-in-muenchen-erstochen-taeter-haette-abgeschoben-werden-koennen-61745708.bild.html

Keller, R. (2005). Analysing Discourse: an approach from the sociology of knowledge. Forum: Qualitative Social Research (FQS), 6(3), Art. 32.

Keller, R. (2013). Doing discourse research: An introduction for social scientists. SAGE Publications.

Kleine, R., Link, A., & Tiede, P. (2019, April 6). Staatsrechtler schlägt Alarm: Verhunzen die Brexit-Briten uns die Europa-Wahl?. BILD https://www.bild.de/bild-plus/politik/ausland/politik-ausland/staatsrechtler-schlaegt-alarm-verhunzen-die-brexit-briten-uns-die-europa-wahl-61071692,view=conversionToLogin.bild.html

Lanoszka, A. (2019). Disinformation in international politics. European Journal of International Security, 4(2), 227 – 248. https://doi.org/10.1017/eis.2019.6

Lupia, A., & McCubbins, M. D. (1998). The democratic dilemma. Can citizens learn what they need to know?. Cambridge University Press.

Macdonald, S. (2006). Propaganda and Information Warfare in the Twenty-First Century: Altered Images and Deception Operations. Routledge.

Mannheim, K. (1964). Wissenssoziologie. Auswahl aus dem Werk. Soziologische Texte, 28. Luchterhand.

Maréchal, N. (2017). Networked Authoritarianism and the Geopolitics of Information: Understanding Russian Internet Policy. Media and Communication, 5(1), 29 – 41. https://doi.org/10.17645/mac.v5i1.808

Marwick, A., & Lewis, R. (2017). Media Manipulation and Disinformation Online. Data & Society. https://datasociety.net/pubs/oh/DataAndSociety_MediaManipulationAndDisinformationOnline.pdf

Omand, D. (2018). The threats from modern digital subversion and sedition. Journal of Cyber Policy, 3(1), 5 – 23. https://doi.org/10.1080/23738871.2018.1448097

Pomerantsev, P. (2014). How Putin Is Reinventing Warfare. Foreign Policy. https://foreignpolicy.com/2014/05/05/how-putin-is-reinventing-warfare/

Rid, T. (2020). Active measures: The secret history of disinformation and political warfare. Profile Books.

Rives, F. (2019, February 24). Gilets jaunes et policiers, ennemis jurés… Vraiment ? (PHOTOS, VIDEOS). RT en Français. http://web.archive.org/web/20220307132727/https://francais.rt.com/france/59441-gilets-jaunes-policiers-ennemis-jures-vraiment

Roberts, M. E., Stewart, B. M., & Tingley, D. (2016). Navigating the Local Modes of Big Data: The Case of Topic Models. In R. M. Alvarez (Ed.), Computational Social Science: Discovery and Prediction, 51 – 97. Cambridge University Press. https://doi.org/10.1017/CBO9781316257340.004

Roberts, M. E., Stewart, B. M., & Tingley, D. (2019). stm: An R Package for Structural Topic Models. Journal of Statistical Software, 91(1), 1 – 40. https://doi.org/10.18637/jss.v091.i02

RT Deutsch. (2019, April 30). Venezuela: Guaidós Putschversuch gescheitert RT Deutsch. http://web.archive.org/web/20190503030755/https://deutsch.rt.com/international/87674-putschversuch-in-venezuela-gescheitert/

RT Deutsch. (2019, May 3). Venezuela: Was sind die beiden Oppositionsführer Guaidó und López wert? RT Deutsch. http://web.archive.org/web/20210115221426/https://de.rt.com/amerika/87774-venezuela-was-sind-die-beiden-oppositionsfuehrer-guaido-lopez-wert/

RT Deutsch. (2019, June 21). US-Mauschelei um iranischen Abschuss der 170-Millionen-Drohne. RT Deutsch.

RT Deutsch. (2019, June 25). Iran: USA setzen auf Eskalation und versperren mit neuer Sanktionswelle Weg für diplomatische Lösung. RT Deutsch. http://web.archive.org/web/20220308045810/https://de.rt.com/der-nahe-osten/89534-iran-usa-setzen-auf-eskalation-versperren-dialog/

RT Deutsch. (2019, June 26). Brutale Gruppenvergewaltigungen in Düsseldorf und ein Prozessbeginn in Freiburg. RT Deutsch. http://web.archive.org/web/20220308042554/https://de.rt.com/inland/89568-brutale-gruppenvergewaltigung-in-dusseldorf-prozessbeginn/

RT en Français. (2019, April 25). Vladivostok: Poutine salue la politique de détente entamée par Kim Jong-un dans la péninsule. RT en Français. http://web.archive.org/web/20220307131824/https://francais.rt.com/international/61372-sommet-vladivostok-vladimir-poutine-salue-politique-detente-entamee-kim-jong-un

RT en Français. (2019, May 26). Le parti du Brexit en tête des élections européennes au Royaume-Uni. RT en Français. http://web.archive.org/web/20190527073205/https://francais.rt.com/international/62477-parti-brexit-tete-elections-europeennes-royaume-uni

RT en Français. (2019, May 26). Européennes: désaveu pour La République en marche et ses alliés. RT en Français. https://francais.rt.com/france/62460-europeennes-victorieux-republique-marche-ses-allies-creent-surprise

RT en Français (2019, June 5). A Moscou, Xi et Poutine célèbrent la lune de miel des relations russo-chinoises. RT en Français. http://web.archive.org/web/20220307131134/https://francais.rt.com/international/62732-a-moscou-xi-poutine-celebrent-lune-miel-relations-russo-chinoises

RT en Français. (2019, June 7). Poutine et Xi font front commun contre la domination américaine. RT en Français. http://web.archive.org/web/20190608135242/https://francais.rt.com/international/62820-vladimir-poutine-xi-xinping-affichent-front-commun-domination-washington

Scheler, M. (1960). Probleme einer Soziologie des Wissens. In M. Scheler (Ed.), Die Wissensformen und die Gesellschaft (Vol. 8, p. 536). Francke. (Original work published 1926).

Schippmann, A., & Bräuner, V. (2019, May 8). Krise zwischen den USA und dem Iran: Warum die Eskalation der Mullahs eine Gefahr für uns ist. BILD. https://www.bild.de/bild-plus/politik/ausland/politik-ausland/iran-und-die-usa-wie-gefaehrlich-wird-dieser-konflikt-fuer-die-welt-61761740,view=conversionToLogin.bild.html

Schünemann, W. J. (2014). Subversive Souveräne: Vergleichende Diskursanalyse der gescheiterten Referenden im europäischen Verfassungsprozess. Theorie und Praxis der Diskursforschung. Springer VS.

Schünemann, W. J. (2022). A threat to democracies? An overview of theoretical approaches and empirical measurements for studying the effects of disinformation. In M. D. Cavelty & A. Wenger (Eds.), Cyber Security Politics: Socio-technological transformations and political fragmentation (pp. 32 – 47). Routledge.

Shackelford, S., Schneier, B., Sulmeyer, M., Boustead, A., Buchanan, B., Craig, A., Herr, T., & Malekos Smith, J. Zhanna. (2016). Making Democracy Harder to Hack: Should Elections Be Classified as ‘Critical Infrastructure?’. University of Michigan Journal of Law Reform, 50(3), 629 – 668. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2852461

Singer, P. W., & Brooking, E. T. (2018). LikeWar. The Weaponization of Social Media. Mariner.

Ungar, G. E. (2019, June 18). Nächste Runde der Eurokrise: Italien will mit Parallelwährung Würgegriff der Austerität entkommen. RT Deutsch. http://web.archive.org/web/20220308042117/https://de.rt.com/meinung/89280-naechste-runde-der-eurokrise-italien-will-mit-parallelwaehrung-wuergegriff-der-austeritat-entkommen/

Vosoughi, S., Roy, D., & Aral, S. (2018). The spread of true and false news online. Science, 359(6380), 1146 – 1151. https://doi.org/10.1126/science.aap9559

Vries, E. de, Schoonvelde, M., & Schumacher, G. (2018). No Longer Lost in Translation: Evidence that Google Translate Works for Comparative Bag-of-Words Text Applications. Political Analysis, 26(4), 417 – 430. https://doi.org/10.1017/pan.2018.26

WELT. (2019, June 17). Wollte Iran US-Drohnen vom Himmel holen? WELT. https://www.welt.de/print/welt_kompakt/print_politik/article195383545/Wollte-Iran-US-Drohnen-vom-Himmel-holen.html

Wickham, H. (2010). ggplot2: Elegant Graphics for Data Analysis (3rd ed.). Springer.

Yablokov, I. (2015). Conspiracy Theories as a Russian Public Diplomacy Tool: The Case of Russia Today (RT). Politics, 35(3-4), 301 – 315. https://doi.org/10.1111/1467-9256.12097

Date received: September 2021

Date accepted: August 2022

7 Appendix

7.1 Appendix A: Topic Modelling Statistics

Appendix A-I: Diagnostic Values of the Structural Topic Models for the German Case with k = 5 to k = 25

Appendix A-II: Diagnostic Values of the Structural Topic Models for the French Case with k = 5 to k = 25

7.2 Appendix B-I: Absolute Topic Proportions for the German Case

Figure 1: Absolute cumulative topic proportions by outlet in the German corpus

7.3 Appendix B-II: Absolute Topic Proportions for the French Case

Figure 2: Absolute cumulative topic proportions by outlet in the French corpus

7.4 Appendix C-I: Regression statistics of Topical Prevalence over outlet and day for the German Case

The regression utilizes the STM package’s estimateEffects() function. The variable ‘day’ is splined with the STM package’s splining function and 10 degrees of freedom. Reference for the ‘source’ (outlet) variable is the outlet “Die Welt”.

Topic 1 Financial & Business News

Term

estimate

std.error

t value

p.value

(Intercept)

0.110337

0.033907

3.254108

0.001143

**

stm::s(day)1

0.084919

0.064989

1.306668

0.191367

stm::s(day)2

0.022115

0.036948

0.598539

0.549499

stm::s(day)3

0.043501

0.047420

0.917344

0.358992

stm::s(day)4

0.067981

0.041288

1.646495

0.099705

.

stm::s(day)5

0.042909

0.047428

0.904718

0.365645

stm::s(day)6

0.033003

0.041092

0.803158

0.42191

stm::s(day)7

0.016003

0.045069

0.355066

0.72255

stm::s(day)8

0.052165

0.049987

1.043561

0.296723

stm::s(day)9

0.029901

0.050330

0.594087

0.552472

stm::s(day)10

0.054559

0.052085

1.047490

0.294908

sourceBild

0.009801

0.060823

0.161140

0.871987

sourceRT Deutsch

-0.008540

0.049455

-0.172692

0.862899

stm::s(day)1:sourceBild

-0.143853

0.117291

-1.226469

0.220062

stm::s(day)2:sourceBild

-0.038212

0.075637

-0.505200

0.613433

stm::s(day)3:sourceBild

-0.111734

0.086715

-1.288524

0.197605

stm::s(day)4:sourceBild

-0.064440

0.076261

-0.844995

0.398141

stm::s(day)5:sourceBild

-0.064107

0.081936

-0.782411

0.433998

stm::s(day)6:sourceBild

-0.116449

0.074892

-1.554889

0.120016

stm::s(day)7:sourceBild

-0.070524

0.082124

-0.858750

0.390507

stm::s(day)8:sourceBild

-0.106118

0.087633

-1.210930

0.225961

stm::s(day)9:sourceBild

-0.083841

0.091241

-0.918895

0.358181

stm::s(day)10:sourceBild

-0.089672

0.078814

-1.137758

0.255259

stm::s(day)1:sourceRT Deutsch

-0.179007

0.089572

-1.998471

0.045703

*

stm::s(day)2:sourceRT Deutsch

-0.047965

0.055020

-0.871777

0.383359

stm::s(day)3:sourceRT Deutsch

-0.085690

0.065864

-1.301004

0.193298

stm::s(day)4:sourceRT Deutsch

-0.134371

0.060474

-2.221949

0.026317

*

stm::s(day)5:sourceRT Deutsch

-0.036700

0.065039

-0.564272

0.572587

stm::s(day)6:sourceRT Deutsch

-0.113400

0.062959

-1.801192

0.071714

.

stm::s(day)7:sourceRT Deutsch

-0.043866

0.063972

-0.685707

0.492919

stm::s(day)8:sourceRT Deutsch

-0.114602

0.076473

-1.498600

0.134021

stm::s(day)9:sourceRT Deutsch

-0.074553

0.068331

-1.091062

0.275281

stm::s(day)10:sourceRT Deutsch

-0.100103

0.072480

-1.381101

0.16729

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 2 Real Life Stories & Celebrity News

Term

estimate

std.error

t value

p.value

(Intercept)

0.069055

0.025186

2.741789

0.006125

**

stm::s(day)1

-0.037192

0.046039

-0.807839

0.41921

stm::s(day)2

0.009097

0.030411

0.299144

0.764838

stm::s(day)3

-0.023143

0.033900

-0.682674

0.494835

stm::s(day)4

-0.008445

0.031255

-0.270210

0.787006

stm::s(day)5

0.018536

0.031486

0.588720

0.556067

stm::s(day)6

-0.015141

0.030421

-0.497705

0.618707

stm::s(day)7

-0.018095

0.032336

-0.559603

0.575768

stm::s(day)8

-0.000876

0.035116

-0.024954

0.980093

stm::s(day)9

-0.010414

0.038405

-0.271159

0.786277

stm::s(day)10

-0.002523

0.037398

-0.067470

0.94621

sourceBild

0.216275

0.054603

3.960854

7.5e-05

***

sourceRT Deutsch

-0.051384

0.035733

-1.437993

0.150479

stm::s(day)1:sourceBild

0.196982

0.105921

1.859717

0.062966

.

stm::s(day)2:sourceBild

0.015167

0.065319

0.232198

0.81639

stm::s(day)3:sourceBild

0.108926

0.083380

1.306375

0.191466

stm::s(day)4:sourceBild

0.070197

0.064849

1.082462

0.279083

stm::s(day)5:sourceBild

0.042249

0.078406

0.538852

0.590006

stm::s(day)6:sourceBild

0.114941

0.067636

1.699394

0.089287

.

stm::s(day)7:sourceBild

0.027837

0.076209

0.365264

0.714925

stm::s(day)8:sourceBild

0.107474

0.077489

1.386968

0.165494

stm::s(day)9:sourceBild

-0.011476

0.096754

-0.118608

0.90559

stm::s(day)10:sourceBild

0.084518

0.071919

1.175177

0.239962

stm::s(day)1:sourceRT Deutsch

0.067035

0.065214

1.027928

0.304018

stm::s(day)2:sourceRT Deutsch

0.011375

0.042051

0.270515

0.786772

stm::s(day)3:sourceRT Deutsch

0.043118

0.048903

0.881693

0.377972

stm::s(day)4:sourceRT Deutsch

0.027900

0.043949

0.634820

0.525566

stm::s(day)5:sourceRT Deutsch

0.007746

0.045611

0.169836

0.865143

stm::s(day)6:sourceRT Deutsch

0.043474

0.043944

0.989293

0.322553

stm::s(day)7:sourceRT Deutsch

0.038204

0.047044

0.812080

0.416772

stm::s(day)8:sourceRT Deutsch

0.028739

0.051223

0.561058

0.574775

stm::s(day)9:sourceRT Deutsch

0.033535

0.054083

0.620068

0.535232

stm::s(day)10:sourceRT Deutsch

0.045499

0.050079

0.908552

0.363616

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 3 International Affairs I: Political Crisis in Venezuela

Term

estimate

std.error

t value

p.value

(Intercept)

0.038347

0.023687

1.618950

0.105501

stm::s(day)1

0.000525

0.043837

0.011978

0.990443

stm::s(day)2

-0.006322

0.027965

-0.226077

0.821148

stm::s(day)3

-0.020452

0.033283

-0.614499

0.538905

stm::s(day)4

-0.008533

0.028168

-0.302917

0.761962

stm::s(day)5

0.008626

0.031140

0.277013

0.781778

stm::s(day)6

-0.026105

0.028851

-0.904799

0.365602

stm::s(day)7

-0.028080

0.030740

-0.913477

0.361022

stm::s(day)8

0.004333

0.035300

0.122734

0.902321

stm::s(day)9

-0.022058

0.035953

-0.613536

0.539541

stm::s(day)10

-0.020803

0.036056

-0.576946

0.563994

sourceBild

-0.003840

0.041135

-0.093349

0.925629

sourceRT Deutsch

0.158204

0.038000

4.163289

3.2e-05

***

stm::s(day)1:sourceBild

-0.022074

0.080264

-0.275020

0.783309

stm::s(day)2:sourceBild

-0.027904

0.050633

-0.551098

0.581583

stm::s(day)3:sourceBild

0.001679

0.058933

0.028495

0.977268

stm::s(day)4:sourceBild

-0.027339

0.051167

-0.534306

0.593146

stm::s(day)5:sourceBild

-0.025606

0.054467

-0.470115

0.638287

stm::s(day)6:sourceBild

-0.007512

0.051411

-0.146113

0.883836

stm::s(day)7:sourceBild

0.006125

0.054414

0.112572

0.910373

stm::s(day)8:sourceBild

-0.040951

0.061635

-0.664417

0.506444

stm::s(day)9:sourceBild

0.004801

0.063422

0.075694

0.939664

stm::s(day)10:sourceBild

-0.012479

0.052764

-0.236503

0.813049

stm::s(day)1:sourceRT Deutsch

-0.053021

0.072053

-0.735859

0.46184

stm::s(day)2:sourceRT Deutsch

-0.037885

0.049792

-0.760867

0.446761

stm::s(day)3:sourceRT Deutsch

-0.098085

0.052245

-1.877409

0.060502

.

stm::s(day)4:sourceRT Deutsch

-0.078913

0.046352

-1.702471

0.08871

.

stm::s(day)5:sourceRT Deutsch

-0.076423

0.048275

-1.583059

0.113451

stm::s(day)6:sourceRT Deutsch

-0.059177

0.050258

-1.177476

0.239044

stm::s(day)7:sourceRT Deutsch

-0.122688

0.047616

-2.576617

0.009997

**

stm::s(day)8:sourceRT Deutsch

-0.124747

0.058388

-2.136514

0.032671

*

stm::s(day)9:sourceRT Deutsch

-0.079500

0.055253

-1.438840

0.150239

stm::s(day)10:sourceRT Deutsch

-0.127815

0.057055

-2.240210

0.025107

*

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 4 International Affairs II: Iran, North Korea, USA, China & Russia

Term

estimate

std.error

t value

p.value

(Intercept)

0.047467

0.028811

1.647531

0.099492

.

stm::s(day)1

0.021759

0.052136

0.417344

0.676439

stm::s(day)2

-0.009185

0.035724

-0.257113

0.797099

stm::s(day)3

-0.029771

0.039718

-0.749553

0.453548

stm::s(day)4

0.002881

0.033303

0.086499

0.931072

stm::s(day)5

-0.012318

0.038639

-0.318791

0.749894

stm::s(day)6

0.025205

0.034788

0.724522

0.468769

stm::s(day)7

-0.028322

0.038751

-0.730878

0.464877

stm::s(day)8

0.037083

0.044248

0.838072

0.402018

stm::s(day)9

0.038732

0.046280

0.836912

0.40267

stm::s(day)10

-0.015109

0.044358

-0.340601

0.733414

sourceBild

-0.026322

0.048468

-0.543084

0.587088

sourceRT Deutsch

0.156277

0.046886

3.333112

0.000863

***

stm::s(day)1:sourceBild

-0.028012

0.096461

-0.290395

0.771522

stm::s(day)2:sourceBild

0.003854

0.063094

0.061076

0.9513

stm::s(day)3:sourceBild

0.016099

0.069932

0.230210

0.817935

stm::s(day)4:sourceBild

-0.014707

0.059976

-0.245215

0.806296

stm::s(day)5:sourceBild

-0.002794

0.065165

-0.042881

0.965798

stm::s(day)6:sourceBild

-0.027315

0.061889

-0.441357

0.658968

stm::s(day)7:sourceBild

0.011953

0.066682

0.179261

0.857738

stm::s(day)8:sourceBild

-0.039952

0.076141

-0.524712

0.5998

stm::s(day)9:sourceBild

-0.033800

0.076427

-0.442257

0.658316

stm::s(day)10:sourceBild

0.006729

0.063990

0.105159

0.916253

stm::s(day)1:sourceRT Deutsch

-0.123501

0.086545

-1.427015

0.153618

stm::s(day)2:sourceRT Deutsch

-0.033755

0.053703

-0.628551

0.529663

stm::s(day)3:sourceRT Deutsch

-0.112681

0.063637

-1.770690

0.076654

.

stm::s(day)4:sourceRT Deutsch

-0.072312

0.051431

-1.405979

0.159773

stm::s(day)5:sourceRT Deutsch

-0.064597

0.059770

-1.080763

0.279838

stm::s(day)6:sourceRT Deutsch

-0.092182

0.055083

-1.673520

0.094268

.

stm::s(day)7:sourceRT Deutsch

-0.074612

0.059892

-1.245785

0.212883

stm::s(day)8:sourceRT Deutsch

0.003604

0.071280

0.050567

0.959672

stm::s(day)9:sourceRT Deutsch

-0.029985

0.072539

-0.413358

0.679356

stm::s(day)10:sourceRT Deutsch

-0.027132

0.065601

-0.413589

0.679187

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 5 International Affairs III: Middle East, Libya & Pakistan

Term

estimate

std.error

t value

p.value

(Intercept)

0.045051

0.023167

1.944601

0.051861

stm::s(day)1

0.002655

0.043915

0.060455

0.951795

stm::s(day)2

-0.008202

0.026741

-0.306714

0.75907

stm::s(day)3

-0.000835

0.031837

-0.026234

0.979071

stm::s(day)4

-0.001673

0.028159

-0.059413

0.952625

stm::s(day)5

-0.003425

0.030439

-0.112510

0.910422

stm::s(day)6

0.000453

0.028604

0.015851

0.987354

stm::s(day)7

-0.033578

0.029191

-1.150308

0.250055

stm::s(day)8

-0.000175

0.034016

-0.005142

0.995898

stm::s(day)9

-0.031252

0.033858

-0.923021

0.356027

stm::s(day)10

0.002863

0.036597

0.078224

0.937652

sourceBild

0.004593

0.039853

0.115236

0.908262

sourceRT Deutsch

0.055001

0.035452

1.551448

0.120838

stm::s(day)1:sourceBild

-0.042575

0.078400

-0.543045

0.587115

stm::s(day)2:sourceBild

-0.013024

0.050485

-0.257978

0.796431

stm::s(day)3:sourceBild

-0.016573

0.056999

-0.290762

0.771242

stm::s(day)4:sourceBild

-0.002148

0.049207

-0.043647

0.965187

stm::s(day)5:sourceBild

0.013738

0.054366

0.252698

0.800509

stm::s(day)6:sourceBild

-0.026294

0.049839

-0.527577

0.597809

stm::s(day)7:sourceBild

-0.008320

0.052010

-0.159962

0.872915

stm::s(day)8:sourceBild

-0.020643

0.060846

-0.339258

0.734425

stm::s(day)9:sourceBild

0.015535

0.061346

0.253232

0.800096

stm::s(day)10:sourceBild

-0.029481

0.053135

-0.554832

0.579027

stm::s(day)1:sourceRT Deutsch

0.032275

0.068768

0.469333

0.638846

stm::s(day)2:sourceRT Deutsch

-0.007731

0.039111

-0.197655

0.843321

stm::s(day)3:sourceRT Deutsch

0.028026

0.051584

0.543316

0.586929

stm::s(day)4:sourceRT Deutsch

0.013269

0.041880

0.316828

0.751383

stm::s(day)5:sourceRT Deutsch

0.022415

0.049770

0.450374

0.652454

stm::s(day)6:sourceRT Deutsch

0.004987

0.043130

0.115624

0.907954

stm::s(day)7:sourceRT Deutsch

0.017980

0.047832

0.375908

0.706996

stm::s(day)8:sourceRT Deutsch

-0.019030

0.054336

-0.350223

0.726181

stm::s(day)9:sourceRT Deutsch

0.003628

0.053579

0.067720

0.946011

stm::s(day)10:sourceRT Deutsch

0.004052

0.055419

0.073110

0.941721

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 6 Brexit & UK Politics

Term

estimate

std.error

t value

p.value

(Intercept)

0.034462

0.021315

1.616781

0.105969

stm::s(day)1

-0.001473

0.040179

-0.036660

0.970757

stm::s(day)2

0.000722

0.026863

0.026860

0.978572

stm::s(day)3

0.042457

0.029722

1.428481

0.153196

stm::s(day)4

0.000436

0.025293

0.017236

0.986249

stm::s(day)5

-0.017030

0.028261

-0.602591

0.546799

stm::s(day)6

-0.002687

0.026482

-0.101461

0.919188

stm::s(day)7

0.006671

0.028808

0.231570

0.816879

stm::s(day)8

-0.015779

0.031653

-0.498512

0.618138

stm::s(day)9

0.001496

0.033100

0.045206

0.963944

stm::s(day)10

-0.018477

0.033833

-0.546120

0.585

sourceBild

-0.013337

0.036632

-0.364066

0.715819

sourceRT Deutsch

0.064090

0.034096

1.879717

0.060186

.

stm::s(day)1:sourceBild

-0.009617

0.072502

-0.132643

0.89448

stm::s(day)2:sourceBild

-0.003169

0.048761

-0.064994

0.948181

stm::s(day)3:sourceBild

-0.038551

0.053008

-0.727273

0.467082

stm::s(day)4:sourceBild

-0.004306

0.046830

-0.091943

0.926745

stm::s(day)5:sourceBild

-0.001997

0.049130

-0.040643

0.967582

stm::s(day)6:sourceBild

0.002109

0.047549

0.044359

0.964619

stm::s(day)7:sourceBild

-0.022255

0.049507

-0.449523

0.653067

stm::s(day)8:sourceBild

0.002883

0.056689

0.050863

0.959436

stm::s(day)9:sourceBild

-0.016279

0.056316

-0.289072

0.772534

stm::s(day)10:sourceBild

0.009546

0.049548

0.192659

0.847232

stm::s(day)1:sourceRT Deutsch

-0.052384

0.062873

-0.833164

0.404779

stm::s(day)2:sourceRT Deutsch

0.006100

0.039681

0.153738

0.87782

stm::s(day)3:sourceRT Deutsch

-0.064930

0.046930

-1.383542

0.166541

stm::s(day)4:sourceRT Deutsch

0.041863

0.042057

0.995385

0.319582

stm::s(day)5:sourceRT Deutsch

-0.047844

0.044068

-1.085697

0.277649

stm::s(day)6:sourceRT Deutsch

-0.006869

0.043045

-0.159573

0.873222

stm::s(day)7:sourceRT Deutsch

-0.024519

0.045037

-0.544415

0.586173

stm::s(day)8:sourceRT Deutsch

-0.045606

0.049004

-0.930656

0.352062

stm::s(day)9:sourceRT Deutsch

-0.026152

0.050304

-0.519884

0.60316

stm::s(day)10:sourceRT Deutsch

-0.002767

0.049877

-0.055476

0.955761

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 7 International Affairs IV: Ukraine & Israel

Term

estimate

std.error

t value

p.value

(Intercept)

0.037360

0.024619

1.517548

0.129172

stm::s(day)1

0.001868

0.047313

0.039484

0.968506

stm::s(day)2

0.000921

0.029658

0.031053

0.975228

stm::s(day)3

0.006718

0.034350

0.195561

0.84496

stm::s(day)4

0.015464

0.030538

0.506376

0.612608

stm::s(day)5

0.017394

0.033543

0.518550

0.604091

stm::s(day)6

0.009460

0.031192

0.303291

0.761677

stm::s(day)7

0.001821

0.034791

0.052335

0.958263

stm::s(day)8

0.007733

0.037996

0.203529

0.838727

stm::s(day)9

0.030388

0.040954

0.742010

0.458105

stm::s(day)10

0.023172

0.039581

0.585429

0.558277

sourceBild

-0.021665

0.041499

-0.522054

0.601648

sourceRT Deutsch

0.033567

0.038635

0.868819

0.384974

stm::s(day)1:sourceBild

-0.000607

0.082781

-0.007328

0.994153

stm::s(day)2:sourceBild

-0.022591

0.053530

-0.422028

0.673017

stm::s(day)3:sourceBild

-0.007465

0.060556

-0.123267

0.901899

stm::s(day)4:sourceBild

-0.022210

0.052532

-0.422800

0.672453

stm::s(day)5:sourceBild

-0.014847

0.057885

-0.256487

0.797582

stm::s(day)6:sourceBild

-0.007198

0.054302

-0.132555

0.894549

stm::s(day)7:sourceBild

-0.010182

0.057068

-0.178427

0.858393

stm::s(day)8:sourceBild

-0.017965

0.063469

-0.283047

0.777149

stm::s(day)9:sourceBild

-0.030537

0.065813

-0.464004

0.642659

stm::s(day)10:sourceBild

-0.034935

0.056293

-0.620596

0.534885

stm::s(day)1:sourceRT Deutsch

0.053286

0.077221

0.690039

0.490191

stm::s(day)2:sourceRT Deutsch

-0.058994

0.044728

-1.318957

0.187225

stm::s(day)3:sourceRT Deutsch

0.070809

0.056404

1.255389

0.209378

stm::s(day)4:sourceRT Deutsch

0.021129

0.046765

0.451806

0.651422

stm::s(day)5:sourceRT Deutsch

0.029382

0.050189

0.585437

0.558272

stm::s(day)6:sourceRT Deutsch

0.012732

0.048880

0.260478

0.794502

stm::s(day)7:sourceRT Deutsch

0.025272

0.049879

0.506666

0.612404

stm::s(day)8:sourceRT Deutsch

0.047523

0.059172

0.803132

0.421925

stm::s(day)9:sourceRT Deutsch

0.024267

0.060307

0.402384

0.687413

stm::s(day)10:sourceRT Deutsch

-0.023786

0.058502

-0.406592

0.68432

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 8 Crime & Justice

Term

estimate

std.error

t value

p.value

(Intercept)

0.128184

0.034581

3.706804

0.000211

***

stm::s(day)1

-0.030827

0.065614

-0.469830

0.63849

stm::s(day)2

-0.027163

0.039639

-0.685274

0.493193

stm::s(day)3

-0.012744

0.047234

-0.269812

0.787312

stm::s(day)4

-0.027060

0.042119

-0.642461

0.520594

stm::s(day)5

-0.043572

0.044246

-0.984760

0.324775

stm::s(day)6

-0.038162

0.042450

-0.899000

0.368682

stm::s(day)7

-0.029849

0.043503

-0.686133

0.492651

stm::s(day)8

-0.046572

0.049208

-0.946430

0.34396

stm::s(day)9

-0.001172

0.051822

-0.022622

0.981953

stm::s(day)10

0.014232

0.050921

0.279487

0.779879

sourceBild

-0.017781

0.061647

-0.288426

0.773029

sourceRT Deutsch

-0.064234

0.047553

-1.350804

0.1768

stm::s(day)1:sourceBild

0.111662

0.119991

0.930592

0.352096

stm::s(day)2:sourceBild

-0.022659

0.081527

-0.277928

0.781075

stm::s(day)3:sourceBild

0.078153

0.086520

0.903290

0.366402

stm::s(day)4:sourceBild

0.005443

0.078617

0.069232

0.944807

stm::s(day)5:sourceBild

0.054577

0.082252

0.663531

0.507011

stm::s(day)6:sourceBild

0.011747

0.074050

0.158642

0.873955

stm::s(day)7:sourceBild

0.106696

0.084257

1.266316

0.20544

stm::s(day)8:sourceBild

0.015557

0.090411

0.172076

0.863383

stm::s(day)9:sourceBild

0.121314

0.095902

1.264972

0.205922

stm::s(day)10:sourceBild

-0.017380

0.082581

-0.210461

0.833314

stm::s(day)1:sourceRT Deutsch

0.079732

0.092376

0.863127

0.388096

stm::s(day)2:sourceRT Deutsch

0.099277

0.055242

1.797132

0.072356

.

stm::s(day)3:sourceRT Deutsch

0.087151

0.068026

1.281143

0.200184

stm::s(day)4:sourceRT Deutsch

0.072970

0.058827

1.240418

0.214861

stm::s(day)5:sourceRT Deutsch

0.078502

0.063857

1.229355

0.218978

stm::s(day)6:sourceRT Deutsch

0.121862

0.056933

2.140433

0.032353

*

stm::s(day)7:sourceRT Deutsch

0.074695

0.063019

1.185269

0.23595

stm::s(day)8:sourceRT Deutsch

0.104863

0.069466

1.509545

0.131203

stm::s(day)9:sourceRT Deutsch

0.051995

0.074581

0.697157

0.485727

stm::s(day)10:sourceRT Deutsch

0.037685

0.070386

0.535406

0.592386

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 9 EU Politics & EP Elections

Term

estimate

std.error

t value

p.value

(Intercept)

0.061390

0.024362

2.519958

0.011758

*

stm::s(day)1

0.039234

0.047738

0.821866

0.41118

stm::s(day)2

0.010576

0.032455

0.325879

0.744525

stm::s(day)3

0.022054

0.035210

0.626337

0.531113

stm::s(day)4

0.035827

0.030690

1.167387

0.243092

stm::s(day)5

-0.006198

0.033099

-0.187268

0.851455

stm::s(day)6

0.061524

0.030806

1.997169

0.045844

*

stm::s(day)7

0.030020

0.031854

0.942417

0.34601

stm::s(day)8

0.018663

0.038770

0.481388

0.630255

stm::s(day)9

-0.001438

0.041194

-0.034901

0.97216

stm::s(day)10

-0.017121

0.035323

-0.484714

0.627893

sourceBild

-0.046291

0.038595

-1.199397

0.230412

sourceRT Deutsch

-0.023195

0.033129

-0.700134

0.483866

stm::s(day)1:sourceBild

-0.051014

0.078400

-0.650693

0.515265

stm::s(day)2:sourceBild

0.020716

0.052771

0.392561

0.694655

stm::s(day)3:sourceBild

-0.025507

0.057296

-0.445176

0.656206

stm::s(day)4:sourceBild

-0.027484

0.050040

-0.549248

0.582852

stm::s(day)5:sourceBild

0.019883

0.053304

0.373015

0.709148

stm::s(day)6:sourceBild

-0.030309

0.051938

-0.583560

0.559534

stm::s(day)7:sourceBild

0.011153

0.053662

0.207842

0.835358

stm::s(day)8:sourceBild

-0.038443

0.062511

-0.614977

0.538589

stm::s(day)9:sourceBild

0.018426

0.063124

0.291911

0.770363

stm::s(day)10:sourceBild

0.033478

0.051754

0.646869

0.517737

stm::s(day)1:sourceRT Deutsch

-0.014127

0.064187

-0.220097

0.825801

stm::s(day)2:sourceRT Deutsch

0.005201

0.040658

0.127923

0.898214

stm::s(day)3:sourceRT Deutsch

0.025578

0.047667

0.536594

0.591564

stm::s(day)4:sourceRT Deutsch

-0.026151

0.040276

-0.649290

0.516171

stm::s(day)5:sourceRT Deutsch

0.040941

0.045792

0.894070

0.371314

stm::s(day)6:sourceRT Deutsch

-0.047285

0.041191

-1.147948

0.251027

stm::s(day)7:sourceRT Deutsch

0.026508

0.043968

0.602885

0.546604

stm::s(day)8:sourceRT Deutsch

-0.012523

0.053850

-0.232555

0.816114

stm::s(day)9:sourceRT Deutsch

0.021684

0.056045

0.386907

0.698836

stm::s(day)10:sourceRT Deutsch

0.089731

0.048910

1.834637

0.0666

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 10 Economy, Big Tech & Mobility

Term

estimate

std.error

t value

p.value

(Intercept)

0.176841

0.033004

5.358121

0

***

stm::s(day)1

0.006916

0.062558

0.110548

0.911978

stm::s(day)2

-0.003793

0.041341

-0.091756

0.926894

stm::s(day)3

-0.000165

0.050050

-0.003298

0.997369

stm::s(day)4

-0.020311

0.039833

-0.509907

0.610132

stm::s(day)5

-0.008126

0.044348

-0.183236

0.854618

stm::s(day)6

0.014020

0.040689

0.344564

0.730432

stm::s(day)7

-0.038036

0.044259

-0.859384

0.390157

stm::s(day)8

-0.003449

0.050041

-0.068916

0.945058

stm::s(day)9

-0.014574

0.054859

-0.265669

0.790501

stm::s(day)10

-0.023287

0.051514

-0.452058

0.65124

sourceBild

-0.068730

0.059948

-1.146493

0.251629

sourceRT Deutsch

-0.114066

0.047354

-2.408770

0.016031

*

stm::s(day)1:sourceBild

-0.108519

0.119748

-0.906234

0.364842

stm::s(day)2:sourceBild

0.119875

0.075670

1.584185

0.113195

stm::s(day)3:sourceBild

-0.092717

0.086169

-1.076000

0.281963

stm::s(day)4:sourceBild

0.039897

0.072137

0.553071

0.580231

stm::s(day)5:sourceBild

-0.064298

0.078544

-0.818631

0.413024

stm::s(day)6:sourceBild

-0.035486

0.077515

-0.457789

0.647118

stm::s(day)7:sourceBild

-0.012824

0.078759

-0.162830

0.870657

stm::s(day)8:sourceBild

-0.006683

0.089679

-0.074520

0.940599

stm::s(day)9:sourceBild

-0.036535

0.088703

-0.411878

0.680441

stm::s(day)10:sourceBild

-0.033436

0.079106

-0.422667

0.67255

stm::s(day)1:sourceRT Deutsch

-0.020566

0.091833

-0.223950

0.822802

stm::s(day)2:sourceRT Deutsch

0.031596

0.056715

0.557108

0.577471

stm::s(day)3:sourceRT Deutsch

-0.005390

0.068238

-0.078992

0.937041

stm::s(day)4:sourceRT Deutsch

0.037267

0.056444

0.660243

0.509119

stm::s(day)5:sourceRT Deutsch

-0.025082

0.062378

-0.402105

0.687618

stm::s(day)6:sourceRT Deutsch

0.003765

0.057167

0.065863

0.947489

stm::s(day)7:sourceRT Deutsch

-0.000743

0.062579

-0.011880

0.990521

stm::s(day)8:sourceRT Deutsch

0.020095

0.068020

0.295431

0.767673

stm::s(day)9:sourceRT Deutsch

-0.019929

0.075617

-0.263553

0.792131

stm::s(day)10:sourceRT Deutsch

0.025088

0.067091

0.373933

0.708465

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 11 Education, Schooling & Jobs

Term

estimate

std.error

t value

p.value

(Intercept)

0.184467

0.034456

5.353687

0

***

stm::s(day)1

-0.089044

0.062042

-1.435225

0.151266

stm::s(day)2

-0.003222

0.038732

-0.083187

0.933705

stm::s(day)3

-0.049326

0.044553

-1.107132

0.268273

stm::s(day)4

-0.040372

0.039865

-1.012700

0.311237

stm::s(day)5

-0.043106

0.042036

-1.025454

0.305183

stm::s(day)6

-0.037319

0.041063

-0.908814

0.363478

stm::s(day)7

-0.078774

0.043050

-1.829838

0.067315

stm::s(day)8

-0.014346

0.045852

-0.312881

0.75438

stm::s(day)9

-0.094758

0.049643

-1.908808

0.056326

stm::s(day)10

0.009482

0.048454

0.195682

0.844864

sourceBild

-0.007955

0.061091

-0.130217

0.896399

sourceRT Deutsch

-0.140207

0.043248

-3.241973

0.001192

**

stm::s(day)1:sourceBild

0.100509

0.118532

0.847944

0.396497

stm::s(day)2:sourceBild

-0.047018

0.068677

-0.684623

0.493604

stm::s(day)3:sourceBild

0.100357

0.086720

1.157247

0.247209

stm::s(day)4:sourceBild

0.020550

0.073022

0.281420

0.778396

stm::s(day)5:sourceBild

0.070730

0.076241

0.927724

0.353582

stm::s(day)6:sourceBild

0.061941

0.075728

0.817945

0.413415

stm::s(day)7:sourceBild

0.047013

0.077849

0.603903

0.545927

stm::s(day)8:sourceBild

0.034100

0.086886

0.392468

0.694724

stm::s(day)9:sourceBild

0.050981

0.087380

0.583441

0.559615

stm::s(day)10:sourceBild

0.019208

0.078636

0.244261

0.807036

stm::s(day)1:sourceRT Deutsch

0.140497

0.079319

1.771295

0.076553

stm::s(day)2:sourceRT Deutsch

0.013442

0.051568

0.260675

0.794351

stm::s(day)3:sourceRT Deutsch

0.068174

0.059299

1.149659

0.250322

stm::s(day)4:sourceRT Deutsch

0.053117

0.053598

0.991025

0.321706

stm::s(day)5:sourceRT Deutsch

0.054324

0.055798

0.973588

0.330294

stm::s(day)6:sourceRT Deutsch

0.064346

0.053481

1.203156

0.228955

stm::s(day)7:sourceRT Deutsch

0.080394

0.055034

1.460793

0.144115

stm::s(day)8:sourceRT Deutsch

0.033754

0.062121

0.543350

0.586905

stm::s(day)9:sourceRT Deutsch

0.090808

0.066438

1.366809

0.171727

stm::s(day)10:sourceRT Deutsch

0.002081

0.063556

0.032748

0.973877

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 12 Party Politics & Governmental Coalition

Term

estimate

std.error

t value

p.value

(Intercept)

0.067344

0.030575

2.202612

0.027653

*

stm::s(day)1

-0.001222

0.058961

-0.020733

0.983459

stm::s(day)2

0.015399

0.036587

0.420892

0.673846

stm::s(day)3

0.020978

0.044812

0.468127

0.639708

stm::s(day)4

-0.015781

0.037431

-0.421602

0.673328

stm::s(day)5

0.046076

0.042670

1.079823

0.280257

stm::s(day)6

-0.024739

0.039206

-0.631007

0.528055

stm::s(day)7

0.200353

0.044050

4.548271

5e-06

***

stm::s(day)8

-0.039513

0.045688

-0.864846

0.387152

stm::s(day)9

0.074790

0.049739

1.503644

0.132716

stm::s(day)10

-0.007030

0.046216

-0.152112

0.879103

sourceBild

-0.024474

0.050434

-0.485268

0.627501

sourceRT Deutsch

-0.065519

0.042710

-1.534049

0.125061

stm::s(day)1:sourceBild

-0.001660

0.102287

-0.016226

0.987054

stm::s(day)2:sourceBild

0.014548

0.070220

0.207171

0.835882

stm::s(day)3:sourceBild

-0.013138

0.075665

-0.173633

0.862158

stm::s(day)4:sourceBild

0.024803

0.067430

0.367829

0.713011

stm::s(day)5:sourceBild

-0.027485

0.070675

-0.388888

0.69737

stm::s(day)6:sourceBild

0.059139

0.067823

0.871960

0.383259

stm::s(day)7:sourceBild

-0.086583

0.073188

-1.183023

0.236838

stm::s(day)8:sourceBild

0.109317

0.083816

1.304256

0.192187

stm::s(day)9:sourceBild

0.002098

0.083874

0.025015

0.980044

stm::s(day)10:sourceBild

0.063500

0.072240

0.879018

0.37942

stm::s(day)1:sourceRT Deutsch

0.071481

0.082022

0.871492

0.383514

stm::s(day)2:sourceRT Deutsch

0.017122

0.051727

0.330999

0.740655

stm::s(day)3:sourceRT Deutsch

0.044824

0.060574

0.739992

0.459328

stm::s(day)4:sourceRT Deutsch

0.043505

0.052819

0.823670

0.410154

stm::s(day)5:sourceRT Deutsch

0.017423

0.057485

0.303088

0.761832

stm::s(day)6:sourceRT Deutsch

0.067862

0.053573

1.266710

0.205299

stm::s(day)7:sourceRT Deutsch

0.004048

0.060673

0.066722

0.946805

stm::s(day)8:sourceRT Deutsch

0.078175

0.066906

1.168429

0.242672

stm::s(day)9:sourceRT Deutsch

0.004060

0.068675

0.059112

0.952865

stm::s(day)10:sourceRT Deutsch

0.078143

0.066606

1.173218

0.240746

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

7.5 Appendix C-II: Regression statistics of Topical Prevalence over outlet and day for the French Case

The regression utilizes the STM package’s estimateEffects() function. The variable ‘day’ is splined with the STM package’s splining function and 10 degrees of freedom. Reference for the ‘source’ (outlet) variable is the outlet “Le Figaro”.

Topic 1 Brexit & EP Elections

Term

estimate

std.error

t value

p.value

(Intercept)

0.003146

0.040066

0.078532

0.937407

stm::s(day)1

0.057202

0.078417

0.729465

0.465741

stm::s(day)2

0.006780

0.054790

0.123740

0.901525

stm::s(day)3

0.022699

0.058962

0.384981

0.700263

stm::s(day)4

0.031059

0.053367

0.581993

0.560589

stm::s(day)5

0.004809

0.056826

0.084635

0.932554

stm::s(day)6

0.010134

0.051428

0.197046

0.843797

stm::s(day)7

0.288673

0.054216

5.324485

0

***

stm::s(day)8

-0.210293

0.059127

-3.556611

0.000378

***

stm::s(day)9

0.145922

0.063040

2.314747

0.020654

*

stm::s(day)10

-0.023668

0.056112

-0.421796

0.673186

sourceLe Figaro

0.042422

0.048659

0.871816

0.383337

sourceRT France

0.030206

0.052478

0.575584

0.564914

stm::s(day)1:sourceLe Figaro

-0.078027

0.093091

-0.838185

0.401954

stm::s(day)2:sourceLe Figaro

0.080534

0.062626

1.285964

0.198496

stm::s(day)3:sourceLe Figaro

-0.010310

0.069089

-0.149226

0.881379

stm::s(day)4:sourceLe Figaro

0.012646

0.063311

0.199747

0.841684

stm::s(day)5:sourceLe Figaro

-0.018752

0.067175

-0.279149

0.780139

stm::s(day)6:sourceLe Figaro

0.042720

0.061394

0.695842

0.48655

stm::s(day)7:sourceLe Figaro

-0.138359

0.065489

-2.112697

0.034661

*

stm::s(day)8:sourceLe Figaro

0.126138

0.070059

1.800471

0.071828

.

stm::s(day)9:sourceLe Figaro

-0.055573

0.078029

-0.712207

0.47636

stm::s(day)10:sourceLe Figaro

0.006886

0.067899

0.101420

0.91922

stm::s(day)1:sourceRT France

-0.044276

0.102253

-0.433000

0.665027

stm::s(day)2:sourceRT France

0.011881

0.068198

0.174218

0.861699

stm::s(day)3:sourceRT France

0.020443

0.075842

0.269552

0.787512

stm::s(day)4:sourceRT France

-0.031093

0.068977

-0.450782

0.65216

stm::s(day)5:sourceRT France

-0.016963

0.073398

-0.231105

0.81724

stm::s(day)6:sourceRT France

0.047577

0.068554

0.694015

0.487695

stm::s(day)7:sourceRT France

-0.190847

0.071603

-2.665366

0.007707

**

stm::s(day)8:sourceRT France

0.144415

0.077637

1.860127

0.062908

stm::s(day)9:sourceRT France

-0.101318

0.080481

-1.258897

0.208108

stm::s(day)10:sourceRT France

0.029017

0.076262

0.380488

0.703594

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 2 International Affairs I: Political Crises in Algeria and Venezuela

Term

estimate

std.error

t value

p.value

(Intercept)

-0.001311

0.033518

-0.039100

0.968812

stm::s(day)1

0.028202

0.065021

0.433745

0.664486

stm::s(day)2

0.020742

0.045507

0.455804

0.648544

stm::s(day)3

-0.000837

0.048611

-0.017209

0.986271

stm::s(day)4

0.013312

0.043438

0.306455

0.759267

stm::s(day)5

0.009839

0.045939

0.214170

0.83042

stm::s(day)6

-0.000134

0.042915

-0.003123

0.997508

stm::s(day)7

0.011806

0.042648

0.276823

0.781924

stm::s(day)8

0.000172

0.047553

0.003614

0.997117

stm::s(day)9

0.008928

0.050446

0.176975

0.859533

stm::s(day)10

0.012839

0.046533

0.275902

0.782631

sourceLe Figaro

0.077639

0.041586

1.866927

0.061952

sourceRT France

0.134104

0.050654

2.647465

0.008127

**

stm::s(day)1:sourceLe Figaro

-0.004041

0.079250

-0.050988

0.959336

stm::s(day)2:sourceLe Figaro

-0.071769

0.055097

-1.302582

0.192759

stm::s(day)3:sourceLe Figaro

-0.003776

0.058625

-0.064418

0.948639

stm::s(day)4:sourceLe Figaro

-0.039270

0.052189

-0.752446

0.451807

stm::s(day)5:sourceLe Figaro

-0.060061

0.056063

-1.071320

0.284061

stm::s(day)6:sourceLe Figaro

-0.035753

0.050925

-0.702070

0.482658

stm::s(day)7:sourceLe Figaro

-0.068251

0.053615

-1.272993

0.203061

stm::s(day)8:sourceLe Figaro

-0.054370

0.058487

-0.929614

0.352602

stm::s(day)9:sourceLe Figaro

-0.045775

0.062004

-0.738262

0.460379

stm::s(day)10:sourceLe Figaro

-0.073775

0.057935

-1.273414

0.202912

stm::s(day)1:sourceRT France

0.003821

0.093776

0.040750

0.967496

stm::s(day)2:sourceRT France

-0.048928

0.063512

-0.770366

0.441108

stm::s(day)3:sourceRT France

-0.013697

0.073829

-0.185529

0.852819

stm::s(day)4:sourceRT France

-0.064129

0.060450

-1.060862

0.288788

stm::s(day)5:sourceRT France

-0.051158

0.068271

-0.749338

0.453678

stm::s(day)6:sourceRT France

-0.105931

0.058988

-1.795813

0.072566

stm::s(day)7:sourceRT France

-0.087866

0.063450

-1.384793

0.166158

stm::s(day)8:sourceRT France

-0.073969

0.068814

-1.074910

0.28245

stm::s(day)9:sourceRT France

-0.074013

0.073182

-1.011344

0.311885

stm::s(day)10:sourceRT France

-0.127565

0.066460

-1.919419

0.05497

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 3 Literature

Term

estimate

std.error

t value

p.value

(Intercept)

0.113826

0.049718

2.289428

0.022083

*

stm::s(day)1

-0.069662

0.088017

-0.791459

0.428702

stm::s(day)2

-0.034758

0.060830

-0.571394

0.56775

stm::s(day)3

-0.044907

0.067368

-0.666590

0.505055

stm::s(day)4

-0.049815

0.058054

-0.858085

0.390874

stm::s(day)5

-0.026537

0.065299

-0.406397

0.684463

stm::s(day)6

-0.061619

0.060993

-1.010265

0.312402

stm::s(day)7

-0.027827

0.059457

-0.468017

0.639786

stm::s(day)8

-0.029735

0.067934

-0.437712

0.661608

stm::s(day)9

-0.039799

0.069861

-0.569697

0.568901

stm::s(day)10

-0.029100

0.064568

-0.450694

0.652223

sourceLe Figaro

0.024222

0.056101

0.431752

0.665934

sourceRT France

-0.079251

0.058588

-1.352698

0.176194

stm::s(day)1:sourceLe Figaro

0.098302

0.101460

0.968872

0.332641

stm::s(day)2:sourceLe Figaro

0.042092

0.066936

0.628842

0.529472

stm::s(day)3:sourceLe Figaro

0.038881

0.079163

0.491155

0.623331

stm::s(day)4:sourceLe Figaro

0.052581

0.063726

0.825113

0.409334

stm::s(day)5:sourceLe Figaro

0.034824

0.075274

0.462625

0.643647

stm::s(day)6:sourceLe Figaro

0.085256

0.070449

1.210192

0.226244

stm::s(day)7:sourceLe Figaro

-0.005532

0.066575

-0.083087

0.933785

stm::s(day)8:sourceLe Figaro

0.050748

0.077507

0.654754

0.512647

stm::s(day)9:sourceLe Figaro

0.043569

0.079350

0.549067

0.582976

stm::s(day)10:sourceLe Figaro

0.153696

0.076164

2.017961

0.043632

*

stm::s(day)1:sourceRT France

0.112195

0.108054

1.038326

0.299153

stm::s(day)2:sourceRT France

0.069463

0.072048

0.964129

0.335013

stm::s(day)3:sourceRT France

0.061353

0.080054

0.766390

0.443469

stm::s(day)4:sourceRT France

0.080287

0.069319

1.158222

0.246811

stm::s(day)5:sourceRT France

0.053617

0.074978

0.715110

0.474564

stm::s(day)6:sourceRT France

0.091000

0.075522

1.204949

0.228262

stm::s(day)7:sourceRT France

0.042462

0.071085

0.597340

0.550299

stm::s(day)8:sourceRT France

0.060139

0.083204

0.722783

0.469836

stm::s(day)9:sourceRT France

0.081867

0.085136

0.961609

0.336278

stm::s(day)10:sourceRT France

0.058429

0.078924

0.740326

0.459126

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 4 Financial & Business News

Term

estimate

std.error

t value

p.value

(Intercept)

0.034765

0.048402

0.718255

0.472623

stm::s(day)1

0.041494

0.089297

0.464675

0.642178

stm::s(day)2

-0.028355

0.064429

-0.440103

0.659876

stm::s(day)3

0.011659

0.069141

0.168630

0.866092

stm::s(day)4

-0.008532

0.062890

-0.135658

0.892095

stm::s(day)5

0.007049

0.065309

0.107926

0.914058

stm::s(day)6

-0.013530

0.060454

-0.223803

0.822917

stm::s(day)7

-0.002745

0.061198

-0.044857

0.964222

stm::s(day)8

0.023359

0.069071

0.338181

0.735236

stm::s(day)9

-0.004568

0.072045

-0.063403

0.949447

stm::s(day)10

-0.014399

0.065223

-0.220769

0.825278

sourceLe Figaro

0.096529

0.059927

1.610777

0.107272

sourceRT France

-0.006821

0.060242

-0.113229

0.909852

stm::s(day)1:sourceLe Figaro

0.020122

0.107715

0.186810

0.851815

stm::s(day)2:sourceLe Figaro

0.047629

0.078055

0.610198

0.541749

stm::s(day)3:sourceLe Figaro

-0.017510

0.080774

-0.216777

0.828388

stm::s(day)4:sourceLe Figaro

0.084068

0.076800

1.094645

0.273708

stm::s(day)5:sourceLe Figaro

-0.039182

0.077973

-0.502504

0.615328

stm::s(day)6:sourceLe Figaro

0.088677

0.073590

1.205018

0.228236

stm::s(day)7:sourceLe Figaro

-0.053510

0.075231

-0.711269

0.47694

stm::s(day)8:sourceLe Figaro

0.086856

0.083585

1.039133

0.298777

stm::s(day)9:sourceLe Figaro

-0.022698

0.091348

-0.248473

0.803776

stm::s(day)10:sourceLe Figaro

0.002845

0.085324

0.033344

0.973401

stm::s(day)1:sourceRT France

-0.046613

0.112895

-0.412888

0.679701

stm::s(day)2:sourceRT France

0.006309

0.078596

0.080273

0.936022

stm::s(day)3:sourceRT France

-0.021171

0.085617

-0.247276

0.804701

stm::s(day)4:sourceRT France

0.018306

0.076146

0.240403

0.810024

stm::s(day)5:sourceRT France

-0.030389

0.080574

-0.377154

0.70607

stm::s(day)6:sourceRT France

0.009674

0.075015

0.128960

0.897393

stm::s(day)7:sourceRT France

0.011171

0.078591

0.142146

0.886968

stm::s(day)8:sourceRT France

-0.032072

0.085877

-0.373463

0.708815

stm::s(day)9:sourceRT France

0.007464

0.091051

0.081976

0.934668

stm::s(day)10:sourceRT France

0.010774

0.083796

0.128570

0.897702

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 5 Crime & Justice

Term

estimate

std.error

t value

p.value

(Intercept)

0.145209

0.051860

2.800030

0.005123

**

stm::s(day)1

0.134915

0.094351

1.429930

0.15278

stm::s(day)2

-0.048339

0.072470

-0.667017

0.504783

stm::s(day)3

0.107122

0.076373

1.402618

0.160773

stm::s(day)4

-0.047056

0.058905

-0.798856

0.4244

stm::s(day)5

0.015777

0.064609

0.244190

0.80709

stm::s(day)6

0.022874

0.063523

0.360088

0.718791

stm::s(day)7

-0.019131

0.062783

-0.304708

0.760598

stm::s(day)8

0.151339

0.077726

1.947088

0.051563

stm::s(day)9

0.071935

0.072934

0.986300

0.324019

stm::s(day)10

0.280687

0.071602

3.920094

8.9e-05

***

sourceLe Figaro

-0.111900

0.057989

-1.929695

0.053683

sourceRT France

-0.105350

0.057334

-1.837481

0.06618

stm::s(day)1:sourceLe Figaro

-0.131610

0.106025

-1.241313

0.21453

stm::s(day)2:sourceLe Figaro

0.049934

0.078295

0.637765

0.523647

stm::s(day)3:sourceLe Figaro

-0.102540

0.083226

-1.232068

0.217963

stm::s(day)4:sourceLe Figaro

0.040998

0.065262

0.628201

0.529892

stm::s(day)5:sourceLe Figaro

0.003992

0.073383

0.054398

0.956619

stm::s(day)6:sourceLe Figaro

-0.032574

0.069069

-0.471613

0.637217

stm::s(day)7:sourceLe Figaro

0.021528

0.071855

0.299600

0.764491

stm::s(day)8:sourceLe Figaro

-0.133717

0.085011

-1.572941

0.115776

stm::s(day)9:sourceLe Figaro

-0.076225

0.083593

-0.911865

0.36187

stm::s(day)10:sourceLe Figaro

-0.229831

0.082319

-2.791943

0.005253

**

stm::s(day)1:sourceRT France

-0.041365

0.105276

-0.392917

0.694393

stm::s(day)2:sourceRT France

0.108675

0.082801

1.312479

0.1894

stm::s(day)3:sourceRT France

-0.026828

0.084679

-0.316822

0.751388

stm::s(day)4:sourceRT France

0.048793

0.068638

0.710869

0.477188

stm::s(day)5:sourceRT France

0.062266

0.073692

0.844941

0.398171

stm::s(day)6:sourceRT France

-0.042714

0.072390

-0.590051

0.555175

stm::s(day)7:sourceRT France

0.121918

0.075881

1.606697

0.108164

stm::s(day)8:sourceRT France

-0.127332

0.087092

-1.462050

0.143771

stm::s(day)9:sourceRT France

0.003468

0.090980

0.038123

0.969591

stm::s(day)10:sourceRT France

-0.190080

0.080733

-2.354415

0.018578

*

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 6 International Affairs II: Iran & Middle East

Term

estimate

std.error

t value

p.value

(Intercept)

0.005676

0.032174

0.176421

0.859968

stm::s(day)1

0.010375

0.062559

0.165839

0.868288

stm::s(day)2

0.004592

0.045614

0.100667

0.919818

stm::s(day)3

0.011023

0.047270

0.233182

0.815627

stm::s(day)4

0.018529

0.043132

0.429574

0.667518

stm::s(day)5

0.000347

0.043538

0.007965

0.993645

stm::s(day)6

0.031358

0.041452

0.756503

0.449372

stm::s(day)7

0.000313

0.040942

0.007635

0.993909

stm::s(day)8

0.018740

0.047197

0.397058

0.691337

stm::s(day)9

0.061329

0.049443

1.240397

0.214869

stm::s(day)10

-0.019587

0.044137

-0.443772

0.657221

sourceLe Figaro

0.014215

0.037912

0.374947

0.707711

sourceRT France

0.073429

0.046330

1.584901

0.113032

stm::s(day)1:sourceLe Figaro

0.008935

0.072492

0.123262

0.901903

stm::s(day)2:sourceLe Figaro

-0.018483

0.051371

-0.359802

0.719006

stm::s(day)3:sourceLe Figaro

0.029702

0.055004

0.539989

0.589221

stm::s(day)4:sourceLe Figaro

-0.034931

0.049303

-0.708498

0.478659

stm::s(day)5:sourceLe Figaro

0.010894

0.051045

0.213419

0.831006

stm::s(day)6:sourceLe Figaro

-0.018565

0.048234

-0.384886

0.700333

stm::s(day)7:sourceLe Figaro

-0.013666

0.049098

-0.278349

0.780752

stm::s(day)8:sourceLe Figaro

0.008788

0.057182

0.153685

0.877862

stm::s(day)9:sourceLe Figaro

0.005654

0.060603

0.093294

0.925673

stm::s(day)10:sourceLe Figaro

-0.007576

0.054515

-0.138964

0.889483

stm::s(day)1:sourceRT France

0.006395

0.085057

0.075187

0.940068

stm::s(day)2:sourceRT France

-0.078524

0.065438

-1.199983

0.230185

stm::s(day)3:sourceRT France

-0.005908

0.067018

-0.088157

0.929754

stm::s(day)4:sourceRT France

-0.045006

0.060126

-0.748527

0.454167

stm::s(day)5:sourceRT France

-0.002818

0.061700

-0.045681

0.963566

stm::s(day)6:sourceRT France

0.007122

0.062379

0.114174

0.909103

stm::s(day)7:sourceRT France

-0.027597

0.057732

-0.478016

0.632653

stm::s(day)8:sourceRT France

0.025442

0.074016

0.343735

0.731055

stm::s(day)9:sourceRT France

-0.003879

0.069443

-0.055863

0.955453

stm::s(day)10:sourceRT France

-0.035858

0.066258

-0.541191

0.588393

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 7 International Affairs III: China, Russia, USA, North Korea

Term

estimate

std.error

t value

p.value

(Intercept)

0.011585

0.035825

0.323374

0.746422

stm::s(day)1

0.018958

0.068208

0.277943

0.781064

stm::s(day)2

-0.013993

0.047027

-0.297548

0.766056

stm::s(day)3

0.023330

0.052826

0.441631

0.65877

stm::s(day)4

0.000320

0.045201

0.007078

0.994353

stm::s(day)5

0.002012

0.049841

0.040364

0.967804

stm::s(day)6

0.012874

0.044529

0.289121

0.772497

stm::s(day)7

-0.009551

0.045144

-0.211576

0.832444

stm::s(day)8

0.019814

0.050644

0.391245

0.695628

stm::s(day)9

-0.018786

0.054218

-0.346490

0.728984

stm::s(day)10

0.057805

0.050919

1.135228

0.256317

sourceLe Figaro

0.081523

0.043531

1.872779

0.061139

sourceRT France

0.065047

0.048318

1.346204

0.178279

stm::s(day)1:sourceLe Figaro

-0.021257

0.081699

-0.260183

0.79473

stm::s(day)2:sourceLe Figaro

-0.069358

0.053067

-1.307001

0.191254

stm::s(day)3:sourceLe Figaro

-0.046861

0.062307

-0.752099

0.452016

stm::s(day)4:sourceLe Figaro

-0.058908

0.052027

-1.132253

0.257565

stm::s(day)5:sourceLe Figaro

-0.051402

0.059246

-0.867603

0.38564

stm::s(day)6:sourceLe Figaro

-0.038584

0.053615

-0.719650

0.471763

stm::s(day)7:sourceLe Figaro

-0.040909

0.054660

-0.748416

0.454233

stm::s(day)8:sourceLe Figaro

-0.047329

0.062392

-0.758574

0.448132

stm::s(day)9:sourceLe Figaro

-0.042294

0.064635

-0.654350

0.512907

stm::s(day)10:sourceLe Figaro

-0.035605

0.062012

-0.574165

0.565874

stm::s(day)1:sourceRT France

0.044397

0.092333

0.480841

0.630644

stm::s(day)2:sourceRT France

-0.065135

0.062284

-1.045784

0.295695

stm::s(day)3:sourceRT France

0.004240

0.071027

0.059695

0.9524

stm::s(day)4:sourceRT France

-0.031146

0.061588

-0.505723

0.613066

stm::s(day)5:sourceRT France

0.058684

0.065752

0.892507

0.372151

stm::s(day)6:sourceRT France

-0.041409

0.060006

-0.690093

0.490157

stm::s(day)7:sourceRT France

0.014371

0.064794

0.221802

0.824475

stm::s(day)8:sourceRT France

0.013990

0.067873

0.206125

0.836699

stm::s(day)9:sourceRT France

0.033395

0.072412

0.461188

0.644678

stm::s(day)10:sourceRT France

0.006396

0.069680

0.091794

0.926864

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 8 Yellow Vests Protest Movement

Term

estimate

std.error

t value

p.value

(Intercept)

0.255615

0.052407

4.877532

1e-06

***

stm::s(day)1

-0.301118

0.099568

-3.024236

0.002501

**

stm::s(day)2

0.142667

0.067318

2.119302

0.034099

*

stm::s(day)3

-0.103915

0.077903

-1.333898

0.182279

stm::s(day)4

-0.208894

0.061478

-3.397860

0.000683

***

stm::s(day)5

-0.017393

0.070027

-0.248376

0.80385

stm::s(day)6

-0.208846

0.062260

-3.354436

0.000799

***

stm::s(day)7

-0.171367

0.062695

-2.733359

0.006284

**

stm::s(day)8

-0.197365

0.068810

-2.868245

0.004139

**

stm::s(day)9

-0.182647

0.066625

-2.741407

0.006133

**

stm::s(day)10

-0.188219

0.070646

-2.664248

0.007733

**

sourceLe Figaro

-0.209287

0.055047

-3.801939

0.000145

***

sourceRT France

-0.071501

0.057115

-1.251876

0.210655

stm::s(day)1:sourceLe Figaro

0.245579

0.106799

2.299450

0.021507

*

stm::s(day)2:sourceLe Figaro

-0.123791

0.073904

-1.675011

0.093975

stm::s(day)3:sourceLe Figaro

0.094968

0.081763

1.161498

0.245477

stm::s(day)4:sourceLe Figaro

0.153136

0.065661

2.332221

0.019716

*

stm::s(day)5:sourceLe Figaro

0.018704

0.075491

0.247758

0.804328

stm::s(day)6:sourceLe Figaro

0.167934

0.065623

2.559073

0.010515

*

stm::s(day)7:sourceLe Figaro

0.138869

0.068603

2.024244

0.042981

*

stm::s(day)8:sourceLe Figaro

0.166854

0.073976

2.255511

0.024131

*

stm::s(day)9:sourceLe Figaro

0.141585

0.075972

1.863634

0.062413

stm::s(day)10:sourceLe Figaro

0.154340

0.076514

2.017145

0.043717

*

stm::s(day)1:sourceRT France

0.148976

0.113558

1.311897

0.189596

stm::s(day)2:sourceRT France

0.008979

0.083733

0.107238

0.914603

stm::s(day)3:sourceRT France

0.031137

0.090695

0.343317

0.73137

stm::s(day)4:sourceRT France

0.148537

0.073015

2.034345

0.041953

*

stm::s(day)5:sourceRT France

-0.021429

0.078813

-0.271899

0.785707

stm::s(day)6:sourceRT France

0.149691

0.073337

2.041139

0.041273

*

stm::s(day)7:sourceRT France

0.071380

0.073267

0.974246

0.329967

stm::s(day)8:sourceRT France

0.113268

0.084772

1.336155

0.18154

stm::s(day)9:sourceRT France

0.082517

0.083959

0.982825

0.325726

stm::s(day)10:sourceRT France

0.127160

0.078549

1.618869

0.105519

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 9 Party Politics & Elections

Term

estimate

std.error

t value

p.value

(Intercept)

0.136102

0.060294

2.257299

0.024019

*

stm::s(day)1

-0.098015

0.113510

-0.863493

0.387895

stm::s(day)2

-0.016534

0.079450

-0.208104

0.835154

stm::s(day)3

-0.039749

0.091254

-0.435585

0.663151

stm::s(day)4

0.028119

0.072915

0.385643

0.699773

stm::s(day)5

-0.060289

0.084853

-0.710504

0.477414

stm::s(day)6

0.030601

0.073058

0.418865

0.675327

stm::s(day)7

0.036948

0.079375

0.465491

0.641594

stm::s(day)8

-0.080479

0.088101

-0.913488

0.361016

stm::s(day)9

-0.064290

0.088775

-0.724190

0.468972

stm::s(day)10

-0.085136

0.084531

-1.007166

0.313888

sourceLe Figaro

-0.026770

0.068810

-0.389043

0.697256

sourceRT France

-0.097665

0.073615

-1.326702

0.184649

stm::s(day)1:sourceLe Figaro

0.129265

0.128723

1.004211

0.31531

stm::s(day)2:sourceLe Figaro

0.013109

0.088810

0.147605

0.882658

stm::s(day)3:sourceLe Figaro

0.080757

0.100006

0.807519

0.419394

stm::s(day)4:sourceLe Figaro

-0.017157

0.087223

-0.196703

0.844066

stm::s(day)5:sourceLe Figaro

0.086472

0.093927

0.920628

0.357275

stm::s(day)6:sourceLe Figaro

-0.008191

0.084071

-0.097429

0.922388

stm::s(day)7:sourceLe Figaro

0.145740

0.092665

1.572769

0.115816

stm::s(day)8:sourceLe Figaro

0.045047

0.101221

0.445032

0.65631

stm::s(day)9:sourceLe Figaro

0.156488

0.106604

1.467932

0.142166

stm::s(day)10:sourceLe Figaro

0.042670

0.099525

0.428741

0.668124

stm::s(day)1:sourceRT France

0.136198

0.141805

0.960461

0.336855

stm::s(day)2:sourceRT France

0.011046

0.097262

0.113569

0.909583

stm::s(day)3:sourceRT France

0.066777

0.109043

0.612386

0.540302

stm::s(day)4:sourceRT France

0.021537

0.091804

0.234596

0.814529

stm::s(day)5:sourceRT France

0.040873

0.102716

0.397919

0.690701

stm::s(day)6:sourceRT France

0.097190

0.092181

1.054343

0.291761

stm::s(day)7:sourceRT France

0.030302

0.097189

0.311787

0.755211

stm::s(day)8:sourceRT France

0.098157

0.107668

0.911672

0.361972

stm::s(day)9:sourceRT France

0.109990

0.107306

1.025008

0.305393

stm::s(day)10:sourceRT France

0.107102

0.105316

1.016958

0.309207

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 10 International Affairs IV: Libya, Mali, Syria, international Jihad

Term

estimate

std.error

t value

p.value

(Intercept)

-0.004318

0.028114

-0.153587

0.87794

stm::s(day)1

0.093983

0.058447

1.608024

0.107873

stm::s(day)2

-0.014380

0.039895

-0.360456

0.718516

stm::s(day)3

0.071033

0.043445

1.635032

0.102086

stm::s(day)4

0.014148

0.037169

0.380644

0.703478

stm::s(day)5

0.034381

0.039857

0.862615

0.388378

stm::s(day)6

0.044656

0.036644

1.218645

0.223018

stm::s(day)7

0.011419

0.037713

0.302787

0.762061

stm::s(day)8

0.068590

0.043725

1.568683

0.116765

stm::s(day)9

0.012192

0.046005

0.265007

0.791012

stm::s(day)10

0.055522

0.041670

1.332435

0.182759

sourceLe Figaro

0.077371

0.034889

2.217656

0.026609

*

sourceRT France

0.076533

0.041347

1.850984

0.064212

stm::s(day)1:sourceLe Figaro

-0.132861

0.067714

-1.962104

0.049788

*

stm::s(day)2:sourceLe Figaro

-0.019313

0.047270

-0.408566

0.68287

stm::s(day)3:sourceLe Figaro

-0.093294

0.051876

-1.798411

0.072153

stm::s(day)4:sourceLe Figaro

-0.023690

0.042898

-0.552251

0.580794

stm::s(day)5:sourceLe Figaro

-0.065698

0.051016

-1.287785

0.197862

stm::s(day)6:sourceLe Figaro

-0.061763

0.043278

-1.427140

0.153582

stm::s(day)7:sourceLe Figaro

-0.074673

0.046706

-1.598767

0.109916

stm::s(day)8:sourceLe Figaro

-0.097262

0.051377

-1.893099

0.058384

stm::s(day)9:sourceLe Figaro

-0.051894

0.056259

-0.922417

0.356342

stm::s(day)10:sourceLe Figaro

-0.083067

0.050091

-1.658341

0.097292

stm::s(day)1:sourceRT France

-0.139403

0.080189

-1.738440

0.082175

stm::s(day)2:sourceRT France

-0.025831

0.050545

-0.511039

0.609339

stm::s(day)3:sourceRT France

-0.092670

0.061125

-1.516065

0.129546

stm::s(day)4:sourceRT France

-0.010977

0.049654

-0.221078

0.825038

stm::s(day)5:sourceRT France

-0.066358

0.056819

-1.167886

0.242891

stm::s(day)6:sourceRT France

-0.050047

0.049288

-1.015402

0.309948

stm::s(day)7:sourceRT France

-0.070469

0.055489

-1.269952

0.204142

stm::s(day)8:sourceRT France

-0.068901

0.058683

-1.174117

0.240386

stm::s(day)9:sourceRT France

-0.075918

0.064988

-1.168191

0.242768

stm::s(day)10:sourceRT France

-0.042514

0.060000

-0.708564

0.478618

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 11 Economy, Taxation & Social Security

Term

estimate

std.error

t value

p.value

(Intercept)

0.136652

0.055212

2.475060

0.013344

*

stm::s(day)1

0.040211

0.098549

0.408030

0.683264

stm::s(day)2

-0.075455

0.076960

-0.980433

0.326905

stm::s(day)3

-0.030378

0.076311

-0.398084

0.69058

stm::s(day)4

-0.022130

0.072606

-0.304794

0.760532

stm::s(day)5

0.013327

0.072662

0.183404

0.854487

stm::s(day)6

-0.078071

0.069752

-1.119264

0.263065

stm::s(day)7

-0.063156

0.069380

-0.910285

0.362702

stm::s(day)8

0.027947

0.077080

0.362571

0.716936

stm::s(day)9

-0.010028

0.082471

-0.121593

0.903225

stm::s(day)10

-0.030113

0.071281

-0.422447

0.672711

sourceLe Figaro

0.016345

0.067729

0.241329

0.809307

sourceRT France

-0.074862

0.068546

-1.092150

0.274803

stm::s(day)1:sourceLe Figaro

-0.069223

0.115744

-0.598076

0.549808

stm::s(day)2:sourceLe Figaro

0.112191

0.088149

1.272735

0.203153

stm::s(day)3:sourceLe Figaro

0.020169

0.088647

0.227523

0.820023

stm::s(day)4:sourceLe Figaro

0.040081

0.087237

0.459455

0.645921

stm::s(day)5:sourceLe Figaro

0.054992

0.087153

0.630983

0.528071

stm::s(day)6:sourceLe Figaro

0.039821

0.083531

0.476714

0.63358

stm::s(day)7:sourceLe Figaro

0.062774

0.083826

0.748864

0.453963

stm::s(day)8:sourceLe Figaro

-0.014781

0.094030

-0.157192

0.875098

stm::s(day)9:sourceLe Figaro

0.047319

0.101815

0.464749

0.642125

stm::s(day)10:sourceLe Figaro

-0.029225

0.089469

-0.326649

0.743943

stm::s(day)1:sourceRT France

-0.100470

0.124189

-0.809012

0.418535

stm::s(day)2:sourceRT France

0.071934

0.091939

0.782414

0.433997

stm::s(day)3:sourceRT France

0.001404

0.094719

0.014822

0.988175

stm::s(day)4:sourceRT France

0.035513

0.089967

0.394734

0.693051

stm::s(day)5:sourceRT France

-0.043177

0.089347

-0.483246

0.628936

stm::s(day)6:sourceRT France

0.052287

0.085341

0.612683

0.540105

stm::s(day)7:sourceRT France

0.072831

0.087311

0.834149

0.404224

stm::s(day)8:sourceRT France

-0.029573

0.098229

-0.301065

0.763374

stm::s(day)9:sourceRT France

0.022924

0.100372

0.228389

0.819351

stm::s(day)10:sourceRT France

0.018515

0.094343

0.196256

0.844415

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 12 Scandals & Criminal Proceedings

Term

estimate

std.error

t value

p.value

(Intercept)

0.097749

0.041171

2.374204

0.017613

*

stm::s(day)1

0.069294

0.079407

0.872646

0.382885

stm::s(day)2

0.034790

0.061226

0.568217

0.569905

stm::s(day)3

0.026090

0.065935

0.395691

0.692345

stm::s(day)4

0.115125

0.055628

2.069552

0.038529

*

stm::s(day)5

-0.040552

0.059058

-0.686644

0.492329

stm::s(day)6

0.147849

0.054783

2.698803

0.006975

**

stm::s(day)7

-0.038491

0.055445

-0.694220

0.487567

stm::s(day)8

0.098111

0.062570

1.568014

0.116921

stm::s(day)9

0.086045

0.067734

1.270338

0.204005

stm::s(day)10

-0.035423

0.056090

-0.631545

0.527704

sourceLe Figaro

-0.067313

0.048299

-1.393682

0.163456

sourceRT France

0.055230

0.060431

0.913933

0.360783

stm::s(day)1:sourceLe Figaro

-0.041768

0.091803

-0.454971

0.649143

stm::s(day)2:sourceLe Figaro

-0.017053

0.066722

-0.255578

0.798284

stm::s(day)3:sourceLe Figaro

-0.007118

0.073883

-0.096335

0.923257

stm::s(day)4:sourceLe Figaro

-0.101853

0.062081

-1.640646

0.100914

stm::s(day)5:sourceLe Figaro

0.039685

0.067723

0.585999

0.557894

stm::s(day)6:sourceLe Figaro

-0.121999

0.061019

-1.999354

0.045607

*

stm::s(day)7:sourceLe Figaro

0.018643

0.065847

0.283118

0.777094

stm::s(day)8:sourceLe Figaro

-0.057176

0.073376

-0.779223

0.435874

stm::s(day)9:sourceLe Figaro

-0.102031

0.079090

-1.290063

0.19707

stm::s(day)10:sourceLe Figaro

0.108433

0.071684

1.512650

0.130412

stm::s(day)1:sourceRT France

-0.067422

0.113684

-0.593064

0.553157

stm::s(day)2:sourceRT France

-0.076060

0.081182

-0.936912

0.348835

stm::s(day)3:sourceRT France

-0.058154

0.092058

-0.631717

0.527592

stm::s(day)4:sourceRT France

-0.102531

0.075895

-1.350951

0.176753

stm::s(day)5:sourceRT France

-0.013604

0.084105

-0.161753

0.871505

stm::s(day)6:sourceRT France

-0.141820

0.069315

-2.046032

0.040789

*

stm::s(day)7:sourceRT France

-0.006189

0.076725

-0.080661

0.935714

stm::s(day)8:sourceRT France

-0.053618

0.084911

-0.631466

0.527756

stm::s(day)9:sourceRT France

-0.115915

0.091758

-1.263263

0.206535

stm::s(day)10:sourceRT France

0.033972

0.081201

0.418364

0.675693

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 13 International Affairs V: Israel & Palestine, Military Operations

Term

estimate

std.error

t value

p.value

(Intercept)

0.025763

0.025637

1.004928

0.314965

stm::s(day)1

-0.007247

0.047354

-0.153033

0.878376

stm::s(day)2

-0.021801

0.034047

-0.640314

0.521989

stm::s(day)3

0.008164

0.033732

0.242011

0.808779

stm::s(day)4

-0.012858

0.032551

-0.394992

0.69286

stm::s(day)5

-0.015671

0.032577

-0.481036

0.630506

stm::s(day)6

0.061059

0.033225

1.837750

0.06614

stm::s(day)7

-0.025171

0.033555

-0.750144

0.453192

stm::s(day)8

0.085615

0.036378

2.353476

0.018625

*

stm::s(day)9

-0.065825

0.037173

-1.770773

0.07664

stm::s(day)10

0.021197

0.035254

0.601286

0.547668

sourceLe Figaro

-0.004826

0.030688

-0.157252

0.875051

sourceRT France

-0.008922

0.031586

-0.282472

0.77759

stm::s(day)1:sourceLe Figaro

-0.005046

0.055071

-0.091635

0.92699

stm::s(day)2:sourceLe Figaro

0.003126

0.039337

0.079480

0.936653

stm::s(day)3:sourceLe Figaro

-0.004876

0.040635

-0.119985

0.904499

stm::s(day)4:sourceLe Figaro

0.006276

0.037026

0.169506

0.865403

stm::s(day)5:sourceLe Figaro

0.010770

0.038709

0.278223

0.780849

stm::s(day)6:sourceLe Figaro

-0.062303

0.038494

-1.618519

0.105594

stm::s(day)7:sourceLe Figaro

0.022573

0.039403

0.572883

0.566742

stm::s(day)8:sourceLe Figaro

-0.035158

0.043275

-0.812444

0.416563

stm::s(day)9:sourceLe Figaro

0.021527

0.042923

0.501525

0.616017

stm::s(day)10:sourceLe Figaro

0.007894

0.041854

0.188603

0.850409

stm::s(day)1:sourceRT France

0.018715

0.059364

0.315253

0.752578

stm::s(day)2:sourceRT France

-0.003381

0.040478

-0.083525

0.933436

stm::s(day)3:sourceRT France

0.031656

0.044226

0.715778

0.474151

stm::s(day)4:sourceRT France

-0.002137

0.039666

-0.053870

0.957041

stm::s(day)5:sourceRT France

0.027075

0.042468

0.637545

0.52379

stm::s(day)6:sourceRT France

-0.028345

0.038121

-0.743566

0.457163

stm::s(day)7:sourceRT France

0.020169

0.044012

0.458259

0.64678

stm::s(day)8:sourceRT France

-0.023679

0.042391

-0.558585

0.576462

stm::s(day)9:sourceRT France

0.039938

0.048232

0.828045

0.407672

stm::s(day)10:sourceRT France

0.016216

0.042209

0.384193

0.700847

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Topic 14 Notre Dame Fire & Terrorist attacks

Term

estimate

std.error

t value

p.value

(Intercept)

0.038690

0.027753

1.394100

0.16333

stm::s(day)1

-0.017055

0.059322

-0.287507

0.773732

stm::s(day)2

0.044921

0.045492

0.987453

0.323453

stm::s(day)3

-0.059296

0.043125

-1.374980

0.16918

stm::s(day)4

0.128680

0.039981

3.218487

0.001294

**

stm::s(day)5

0.074565

0.040808

1.827226

0.067707

stm::s(day)6

0.000684

0.038167

0.017932

0.985694

stm::s(day)7

0.009195

0.038587

0.238298

0.811657

stm::s(day)8

0.025979

0.045487

0.571130

0.567929

stm::s(day)9

0.000408

0.046504

0.008777

0.992997

stm::s(day)10

-0.001507

0.040893

-0.036858

0.9706

sourceLe Figaro

-0.009163

0.032989

-0.277772

0.781196

sourceRT France

0.010516

0.036983

0.284342

0.776156

stm::s(day)1:sourceLe Figaro

-0.020472

0.065211

-0.313926

0.753586

stm::s(day)2:sourceLe Figaro

-0.029794

0.050245

-0.592976

0.553216

stm::s(day)3:sourceLe Figaro

0.020007

0.048381

0.413541

0.679223

stm::s(day)4:sourceLe Figaro

-0.114556

0.045106

-2.539718

0.011115

*

stm::s(day)5:sourceLe Figaro

-0.026974

0.047918

-0.562909

0.573514

stm::s(day)6:sourceLe Figaro

-0.045049

0.044239

-1.018310

0.308564

stm::s(day)7:sourceLe Figaro

-0.015434

0.045265

-0.340977

0.733131

stm::s(day)8:sourceLe Figaro

-0.047622

0.053377

-0.892183

0.372324

stm::s(day)9:sourceLe Figaro

-0.020637

0.053345

-0.386852

0.698877

stm::s(day)10:sourceLe Figaro

-0.018396

0.049011

-0.375349

0.707412

stm::s(day)1:sourceRT France

-0.032349

0.079301

-0.407933

0.683335

stm::s(day)2:sourceRT France

0.009015

0.056330

0.160035

0.872858

stm::s(day)3:sourceRT France

-0.001182

0.057828

-0.020436

0.983696

stm::s(day)4:sourceRT France

-0.065523

0.050712

-1.292041

0.196384

stm::s(day)5:sourceRT France

0.002781

0.053266

0.052213

0.95836

stm::s(day)6:sourceRT France

-0.044520

0.049343

-0.902242

0.366958

stm::s(day)7:sourceRT France

-0.002279

0.051669

-0.044112

0.964816

stm::s(day)8:sourceRT France

-0.048053

0.057301

-0.838603

0.40172

stm::s(day)9:sourceRT France

-0.010341

0.056915

-0.181685

0.855835

stm::s(day)10:sourceRT France

-0.011552

0.052193

-0.221340

0.824834

Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

7.6 Appendix D: Codebook

The regression utilizes the STM package’s estimateEffects() function. The variable ‘day’ is splined with the STM package’s splining function and 10 degrees of freedom. Reference for the ‘source’ (outlet) variable is the outlet “Le Figaro”.

Topic

Sub-Topic

Memo

Germany

DE03: International Affairs 1: Political Crisis in Venezuela

DE03-01: self-proclaimed interim president Guaidó

With this code, sequences are coded (statements or quotes) in which Juan Guaidó is depicted in a neutral or positive manner as self-proclaimed interim president of Venezuela or as agent of hope.

Germany

DE03: International Affairs 1: Political Crisis in Venezuela

DE03-02: Illegitimate government / dictator Maduro in Venezuela

With this code, sequences (statements or quotes) are coded in which the Venezuelan government, the President is depicted as illegitimate dictator(ship).

Germany

DE03: International Affairs 1: Political Crisis in Venezuela

DE03-04: Governmental repression / army against protesters

With this code, sequences (statements or quotes) are coded in which the Venezuelan government is depicted as oppressing the people and using military forces against peaceful protesters.

Germany

DE03: International Affairs 1: Political Crisis in Venezuela

DE03-05: Radical President Bolsonaro

With this code, sequences (statements or quotes) with which Bolsonaro is depicted as radical or an agent of polarization are coded.

Germany

DE03: International Affairs 1: Political Crisis in Venezuela

DE03-07: US military intervention as ultima ratio

With this code, sequences (statements or quotes) are coded in which a US military intervention is said to be an option, though as the ultima ratio.

Germany

DE03: International Affairs 1: Political Crisis in Venezuela

DE03-08: Legitimate interim leader Guaidó (external legitimacy)

With this code, sequences (statements or quotes) are coded that point to the external legitimacy of interim president Guaidó given the acknowledgement by leading Western countries.

Germany

DE03: International Affairs 1: Political Crisis in Venezuela

DE03-09: Legitimate Venezuelan President Maduro

With this code, sequences (statements or quotes) are coded in which President Maduro is depicted as legitimate governmental leader of Venezuela. Allegations of election fraud are thus rejected.

Germany

DE03: International Affairs 1: Political Crisis in Venezuela

DE03-11: Guaidó's coup

With this code, sequences (statements or quotes) are coded with which Guaidó's actions are depicted as an illegitimate coup of a legitimate government lead by President Maduro.

Germany

DE03: International Affairs 1: Political Crisis in Venezuela

DE03-12: Violent protesters

With this code, sequences (statements or quotes) are coded in which protesters against the Maduro regime are depicted as violent protesters.

Germany

DE04: International Affairs II: Iran, North Korea, USA, China & Russia

DE04-01: Iranian escalation of international conflict

With this code, sequences are coded in which Iran is depicted as responsible for the escalation of the international conflict.

Germany

DE04: International Affairs II: Iran, North Korea, USA, China & Russia

DE04-03: Support of terrorism by Iran

Wit this code, sequences (statement or quotes) are coded by which Iran is objected to support terrorism.

Germany

DE04: International Affairs II: Iran, North Korea, USA, China & Russia

DE04-05: Diplomatic behavior by US

With this code, sequences are coded in which the US government is said to act in a diplomatic manner with respect to international crises.

Germany

DE04: International Affairs II: Iran, North Korea, USA, China & Russia

DE04-06: Fiasco Summit North Korea

Wit this code, sequences are coded (statements or quotes) that assess the US-North Korean Summit as failure, 'fiasco'.

Germany

DE04: International Affairs II: Iran, North Korea, USA, China & Russia

DE04-10: Iranian air space violated

With this code, sequences (statements or quotes) are coded that with respect to the incident of a US drone hit by Iranian troops say that the vessel was hit in Iranian air space.

Germany

DE08: Crime & Justice

DE08-19: Criminal offences by immigrants

With this code, we classify stories that explicitly report the foreign origin of criminal offenders in the respective stories. This is in line with a special classification of migrant criminality (NAFRIs in Germany).

Germany

DE08: Crime & Justice

DE08-20: Pedophilia

With this code, sequences are classified tat report about pedophilia and pedophilia related crime.

Germany

DE09: EU Politics & EP Elections

DE09-01: Bureaucracy critique EU

With this code, sequences (statements or quotes) are coded in which EU bureaucracy is criticized for slowing down political and/or economic activity.

Germany

DE09: EU Politics & EP Elections

DE09-02: Right-wing populism as a threat for Europe

With this code, sequences (statements or quotes) are coded in which the strength of right-wing populist movements throughout the Union is depicted as a threat for Europe.

Germany

DE09: EU Politics & EP Elections

DE09-03: Disinformation campaigns as a threat

With this code, sequences (statements or quotes) are coded that point to the danger of foreign disinformation campaigns (especially exerted by Russian agents).

Germany

DE09: EU Politics & EP Elections

DE09-04: Migration Critique EU

With this code, sequences (statements or quotes) are coded that depict the EU as malfunctioning with respect to the migration crisis.

Germany

DE09: EU Politics & EP Elections

DE09-05: Domination by large member countries

With this code, sequences (statements or quotes) are coded that deal with the alleged dominance of the bigger EU member countries.

Germany

DE09: EU Politics & EP Elections

DE09-06: Weak EP

With this code, sequences (statements or quotes) are coded that depict the EP as a relatively weak institution.

Germany

DE09: EU Politics & EP Elections

DE09-07: Democracy Critique

With this code, sequences (statements or quotes) are coded wherein critique of EU democracy deficit is expressed.

Germany

DE09: EU Politics & EP Elections

DE09-08: Economic Argument

With this code, sequences (statements or quotes) are coded wherein speakers argue for the economic advantages of EU membership.

Germany

DE09: EU Politics & EP Elections

DE09-09: Peace Argument

With this code, sequences (statements or quotes) are coded wherein speakers argue for European peace that could be secured over decades due to European integration.

Germany

DE09: EU Politics & EP Elections

DE09-10: Citizen rights and consumer protection

With this code, sequences (statements or quotes) are coded wherein speakers argue for the protection of citizen rights and improved consumer protection through European integration and EU governance.

Germany

DE09: EU Politics & EP Elections

DE09-11: Critique of Neoliberalism (NeoC)

With this code, sequences (statements or quotes) are coded in which the EU is criticized for its neoliberal economic order and policies.

Germany

DE09: EU Politics & EP Elections

DE09-12: Sovereignty Argument (SovA)

With this code, sequences (statements or quotes) are coded in which speakers demand to uphold national sovereignty against further EU integration.

Germany

DE09: EU Politics & EP Elections

DE09-13: Critique of the EU Democratic Deficit

With this code, sequences (statements or quotes) are coded wherein a critique of the democratic deficit of the EU and multi-level governance architecture is expressed.

Germany

DE09: EU Politics & EP Elections

DE09-14: One-sided news by mainstream media

With this code, sequences (statements or quotes) are coded in which the one-sided news and assessments made or produced by mainstream media is criticized.

Germany

DE09: EU Politics & EP Elections

DE09-15: Economic Critique (EcoC)

With this code, sequences (statements or quotes) are coded in which the EU's economic and financial order and policies are criticized from stability-oriented perspective.

Germany

DE09: EU Politics & EP Elections

DE09-16: Rule of Law Eastern Europe

With this code, sequences (statements or quotes) are coded in which speakers criticize Eastern European governments for the development of rule of law in their countries.

Germany

DE09: EU Politics & EP Elections

DE09-16: Security Argument (SecA)

With this code, sequences (statements or quotes) are coded in which speakers point to the improvements with respect to internal security due to EU integration and policies.

Germany

DE09: EU Politics & EP Elections

DE09-17: Foreign-Policy related Critique (FPC)

With this code, sequences (statements or quotes) are coded in which speakers express criticism with respect to incoherent and malfunctioning EU foreign and security policies.

France

FR01: Brexit & EP Elections

FR01-01: Panic and chaos in UK - Brexit

With this code, sequences (statements or quotes) are coded in which speakers interpret the state of UK politics with respect to Brexit as chaos, paralysis, panic.

France

FR01: Brexit & EP Elections

FR01-02: Attempts to delegitimize the Brexit vote

With this code, sequences (statements or quotes) are coded in which speakers express concerns about certain forces that would try to delegitimize the Brexit vote and strive for a second referendum.

France

FR02: International Affairs I: Political Crises in Algeria and Venezuela

FR02-01: Legal transition in Algeria

With this code, sequences are coded (statements or quotes) with which the crisis in Algeria is depicted as legal transition.

France

FR02: International Affairs I: Political Crises in Algeria and Venezuela

FR02-02: Algerian coup

With this code, sequences (statements or quotes) are coded that depict the Algerian crisis as coup.

France

FR02: International Affairs I: Political Crises in Algeria and Venezuela

FR02-03: Bouteflika disabled

With this code, sequences are coded (statements or quotes) that depict Algerian President Bouteflika as disabled.

France

FR07: International Affairs III: China, Russia, USA, North Korea

FR07-08: Trade war started by the US

With this code, we classify statements by which the US is explicitly made responsible for starting the trade conflict/war with China.

France

FR07: International Affairs III: China, Russia, USA, North Korea

FR07-09: US escalation and dominance

With this code, sequences are coded in which we find the frame of US escalation of international conflict (including trade sanctions) and US dominance of the global order.

France

FR07: International Affairs III: China, Russia, USA, North Korea

FR07-11: China's commercial attack on Europe

With this code, sequences are coded that include frames by which China's trade policy is regarded as a threat for Europe.

France

FR07: International Affairs III: China, Russia, USA, North Korea

FR07-12: Trade partner China

With this code, sequences are coded in which China appears as a trade partner and is depicted as such in a neutral or positive manner.

France

FR07: International Affairs III: China, Russia, USA, North Korea

FR07-13: Trump dangerous for global order

With this code, sequences are coded in which US President Trump is depicted as dangerous actor and a threat to international threat.

France

FR07: International Affairs III: China, Russia, USA, North Korea

FR07-14: Europe Puissance -

With this code, sequences are coded in which the typically French ambition of Europe Puissance with respect to foreign policy and the international order gets visible, while its chances are assessed negatively here.

France

FR07: International Affairs III: China, Russia, USA, North Korea

FR07-15: Fight for technological leadership

With this code, sequences are classified in which the US-Chinese trade conflict is depicted as a fight for technological leadership.

France

FR07: International Affairs III: China, Russia, USA, North Korea

FR07-16: Diplomatic behavior by Russia

With this code, we classify statements (quotes or not) in which the position of the Russian government towards international crises and conflicts is assessed diplomatic.

France

FR07: International Affairs III: China, Russia, USA, North Korea

FR07-17: Re-incorporation of the Crimea

With this code, sequences are coded (stated or cited) by which the outcome of the Ukrainian crisis with respect to the peninsula of Crimea is assessed as re-incorporation instead of annexation.

France

FR07: International Affairs III: China, Russia, USA, North Korea

FR07-18: Anti-Russian sanctions

With this code, sequences are classified that state or cite a critical assessment on Western sanctions against Russia as anti-Russian.

France

FR08: Yellow Vests Protest Movement

FR08-01: Police forces positive or neutral

With this code, sequences (statements or quotes) are coded in which police forces and their engagement to fight protesters' violence is assessed neutral or positive.

France

FR08: Yellow Vests Protest Movement

FR08-02: Police violence

With this code, sequences (statements or quotes) are coded in which speakers criticize violence exerted by police forces.

France

FR08: Yellow Vests Protest Movement

FR08-03: Yellow Vest protests as a threat for the government

With this code, sequences (statements or quotes) are coded in which the yellow vest movement is interpreted as a major threat for the current government.

France

FR08: Yellow Vests Protest Movement

FR08-03: Yellow vests infiltrated by radical forces

With this code, sequences (statements or quotes) are coded in which the yellow vests movement is depicted as being infiltrated by radical forces.

France

FR08: Yellow Vests Protest Movement

FR08-05: Failure of agencies

With this code, sequences (statements or quotes) are coded in which governmental security assessments is said to have failed.

France

FR08: Yellow Vests Protest Movement

FR08-06: Solidarity between police forces and protesters

With this code, sequences (statements or quotes) are coded in which acts of solidarity between protesters and police forces are reported.

France

FR09: Party Politics & Elections

FR09-01: EU elections not a catastrophe for Macron

With this code, sequences (statements or quotes) are coded in which speakers interpret the state of UK politics as chaos, paralysis, panic.

France

FR09: Party Politics & Elections

FR09-02: risk of EU elections being perceived as anti Macron

This code is assigned to statements that point to the risk that the European elections are perceived as a referendum anti-Macron.

France

FR09: Party Politics & Elections

FR09-03: EU elections as referendum anti-Macron

With this code, sequences (statements or quotes) are coded that depict the EU elections as referendum anti-Macron.

France

FR09: Party Politics & Elections

FR09-01: EU elections humiliation for the conservative right

With this code, sequences (statements or quotes) are coded that assess the defeat of the conservative right in the EU elections as existential and a humiliation.

France

FR12: Scandals & Criminal Proceedings

FR12-01: Political character/impact of Benalla case

With this code, sequences (statements or quotes) are coded that somehow deal with the alleged political character/impact of the Benalla case.

7.7 Appendix E: Code-Matrix-Browser

DE03: International Affairs 1: Political Crisis in Venezuela

DE04: International Affairs II: Iran, North Korea, USA, China & Russia

DE06: Brexit & UK Politics

DE08: Crime & Justice

DE09: EU Politics & EP Elections

FR01: Brexit & EP Elections

FR02: International Affairs I: Political Crises in Algeria and Venezuela

FR07: International Affairs III: China, Russia, USA, North Korea

FR08: Yellow Vests Protest Movement

FR09: Party Politics & Elections

FR12: Scandals & Criminal Proceedings

7.8 Appendix F: Original Quotes

“Wie verrückt kann das Tauziehen um den britischen EU-Austritt noch werden?”

“Emmanuel Macron a fait de cette échéance électorale un référendum sur sa politique et la défaite subie implique le constat suivant: la politique gouvernementale se trouve affaiblie après ces élections européennes.”

“[] Maduro hat wieder einmal gezeigt, dass er bereit ist, über Leichen zu gehen, wenn dies für seinen Machterhalt notwendig ist.”

“Also the most recent coup attempt by the self-proclaimed ‘interim president’ of Venezuela, Juan Guaidó, against the elected President Nicolas Maduro failed”

“USA setzen auf Eskalation und versperren mit neuer Sanktionswelle Weg für diplomatische Lösung”


1 The organization’s motto “Question even more” can be perceived as a direct response to RT’s slogan “Question more.”

2 We decided on a period marked by an assumed start date of the election campaign about three months before the first day of election week and closed about one month after the last day of election week.

3 This tagging of news content is not necessarily complete nor accurate. This holds particularly true for the German tabloid BILD, for which many celebrity news were assigned to the politics section and produced peculiarities in the analysis (see below).

4 While human- and machine-translated text corpora yield comparable results for the same documents (see Vries et al., 2018), it remains unclear how such an approach would fare for two systematically different sets of documents. Furthermore, using the original texts is preferable to machine-translated documents in the qualitative analysis for which any distortions of the original variation at the discursive, and not just the linguistic, level must be avoided.

5 An overview of the absolute topic proportions can be found in Appendix B.

6 Note that for both the French and the German case, not all regression results are statistically significant, as reported in Appendix C. This outcome can be explained by the partially low absolute topic proportions for certain outlets (see Appendix B) and disparate overall document numbers (see Table 1) leading to low significance for topics with low prevalence in certain outlets.

7 All quotes from corpus articles have been translated into English by the authors. They can be found in original language in appendix F.

8 Actually a row of judicial and political cases involving Alexandre Benalla, the – at that times – security officer and deputy chief of staff of the French President Macron that had been revealed in 2018.

keywords

information operations

disinformation

sociology of knowledge

discourse analysis

topic modeling

Figure 3: Overview of estimated topic proportions by day and outlet in the German corpus, with 95% confidence intervals shown in gray. For the smoothing, the “day” variable was splined with 10 degrees of freedom.

Figure 4: Overview of estimated Topic proportions by day and outlet in the French corpus, with 95% confidence intervals shown in gray. For the smoothing, the “day” variable was splined with 10 degrees of freedom.

Metrics

Metrics Loading ...

Downloads

Published

31-12-2022

Issue

Section

Research Papers