<?xml version="1.0" encoding="utf-8" standalone="yes" ?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>Papadopoulos Stefanos-Iordanis | MeVer</title>
    <link>https://mever.gr/author/papadopoulos-stefanos-iordanis/</link>
      <atom:link href="https://mever.gr/author/papadopoulos-stefanos-iordanis/index.xml" rel="self" type="application/rss+xml" />
    <description>Papadopoulos Stefanos-Iordanis</description>
    <generator>Wowchemy (https://wowchemy.com)</generator><language>en-us</language><lastBuildDate>Wed, 03 Jul 2024 00:00:00 +0000</lastBuildDate>
    <image>
      <url>https://mever.gr/author/papadopoulos-stefanos-iordanis/avatar_hu_d1111e2f8bb90e0e.jpg</url>
      <title>Papadopoulos Stefanos-Iordanis</title>
      <link>https://mever.gr/author/papadopoulos-stefanos-iordanis/</link>
    </image>
    
    <item>
      <title>Filtering external evidence for realistic training and evaluation of Automated Fact-Checking</title>
      <link>https://mever.gr/post/filtering-external-evidence-for-realistic-automated-fact-checking/</link>
      <pubDate>Wed, 03 Jul 2024 00:00:00 +0000</pubDate>
      <guid>https://mever.gr/post/filtering-external-evidence-for-realistic-automated-fact-checking/</guid>
      <description>&lt;p&gt;In this post, we explain the basics behind our paper &lt;a href=&#34;https://dl.acm.org/doi/abs/10.1145/3643491.3660278&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;Credible, Unreliable or Leaked?: Evidence verification for enhanced automated fact-checking&lt;/a&gt; by Zacharias Chrysidis, Stefanos-Iordanis Papadopoulos, Symeon Papadopoulos and Panagiotis C. Petrantonakis, which has been presented at ICMR’s 3rd ACM International Workshop on Multimedia AI against Disinformation.&lt;/p&gt;
&lt;h2 id=&#34;automated-fact-checking-afc&#34;&gt;Automated Fact-Checking (AFC)&lt;/h2&gt;
&lt;p&gt;The Information Age, especially after the explosion of online platforms and social media, has led to a surge in new forms of mis- and disinformation, making it increasingly difficult for people to trust what they see and read online. To combat this, many fact-checking organizations, including &lt;a href=&#34;https://www.snopes.com/&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;Snopes&lt;/a&gt;, &lt;a href=&#34;https://www.politifact.com/&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;PolitiFact&lt;/a&gt; as well as &lt;a href=&#34;https://www.reuters.com/fact-check/&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;Reuters&lt;/a&gt; and &lt;a href=&#34;https://factcheck.afp.com/&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;AFP&lt;/a&gt; fact-checks, have emerged, dedicated to verifying claims in news articles and social media posts. Nevertheless, the manual process of fact-checking is time-consuming and can&amp;rsquo;t always keep pace with the rapid spread of mis- and disinformation. This is where the field of Automated Fact-Checking (AFC) comes in. In recent years, researchers have been trying to leverage advances in deep learning, large language models, computer vision, and multimodal learning to develop tools to assist the work of professional fact-checkers. AFC systems aim to automate key parts of the fact-checking process, such as detecting check-worthy claims, retrieving relevant evidence from the web, and cross-examining them against the claim (&lt;a href=&#34;https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00454/109469/A-Survey-on-Automated-Fact-Checking&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;Guo, et al., 2022&lt;/a&gt;). Since fact-checking rarely relies solely on examining internal contradictions in claims, AFC systems often require the retrieval of external information from the web, knowledge databases, or performing inverse image searches to support or refute a claim, as shown below.&lt;/p&gt;
&lt;p&gt;















&lt;figure  &gt;
  &lt;div class=&#34;d-flex justify-content-center&#34;&gt;
    &lt;div class=&#34;w-100&#34; &gt;&lt;img src=&#34;https://mever.gr/media/evidence-retrieval-example.png&#34; alt=&#34;evidence_retrieval_example&#34; loading=&#34;lazy&#34; data-zoomable /&gt;&lt;/div&gt;
  &lt;/div&gt;&lt;/figure&gt;

&lt;em&gt;An example of a claim, evidence collection and retrieval. Claim and verdict source: &lt;a href=&#34;https://www.snopes.com/fact-check/electric-bus-fire-kenya/&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;Snopes&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;
&lt;h2 id=&#34;challenges-of-training-automated-fact-checking-afc-systems&#34;&gt;Challenges of training Automated Fact-Checking (AFC) systems&lt;/h2&gt;
&lt;p&gt;Nevertheless, in order to develop and train AFC systems that can be applied to real-world cases, the collected evidence should follow certain criteria, such as “[the evidence in datasets] must be (1) sufficient to refute the claim and (2) not leaked from existing fact-checking articles” as defined by &lt;a href=&#34;https://aclanthology.org/2022.emnlp-main.397/&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;Glockner et al., 2022&lt;/a&gt;. The problem of leaked evidence in AFC systems arises when information from previously fact-checked articles is used during training. This can lead the model to overly rely on high-quality information curated by professional fact-checkers, making it less effective at handling new and emerging misinformation that has not yet been fact-checked –which is supposedly the task at hand. Additionally, the external information retrieved by the model must be credible to avoid feeding it with unreliable and false data. For example, as shown in the banner of this article, the retrieved evidence “Did President Obama Ban Muslims from Entering the United States in 2011?” is sourced from Snopes, thus, using the full article would allow leaked information into the AFC system. Conversely, feeding “MORE HYPOCRISY: Obama Banned all Iraqi Refugees for 6 Months in 2011 – Liberals SAID NOTHING” into the AFC system would introduce unreliable and false information. These problems are under-researched but crucial for achieving realistic and effective fact-checking.&lt;/p&gt;
&lt;h2 id=&#34;credible-unreliable-or-leaked-credule-dataset-assisting-the-detection-of-leaked-and-unreliable-evidence&#34;&gt;“CREDible, Unreliable, or LEaked” (CREDULE) dataset assisting the detection of leaked and unreliable evidence&lt;/h2&gt;
&lt;p&gt;To address these challenges, we developed the “CREDible, Unreliable, or LEaked” (CREDULE) dataset by modifying, merging, and extending previous datasets such as &lt;a href=&#34;https://www.copenlu.com/publication/2019_emnlp_augenstein/&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;MultiFC&lt;/a&gt;, &lt;a href=&#34;https://www.kaggle.com/datasets/rmisra/politifact-fact-check-dataset&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;PolitiFact&lt;/a&gt;, &lt;a href=&#34;https://github.com/neemakot/Health-Fact-Checking&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;PUBHEALTH&lt;/a&gt;, &lt;a href=&#34;https://github.com/MELALab/nela-gt&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;NELA-GT&lt;/a&gt;, &lt;a href=&#34;https://github.com/several27/FakeNewsCorpus&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;Fake News Corpus&lt;/a&gt;, and &lt;a href=&#34;https://www.kaggle.com/datasets/mrisdal/fake-news&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;Getting Real About Fake News&lt;/a&gt;. The CREDULE dataset consists of 91,632 samples from 2016 to 2022, equally distributed across three classes: “Credible,” “Unreliable,” and “Fact-checked” (Leaked). Our criteria ensure balanced distributions not only across these classes but also across years, title length, and topics. The dataset includes both short texts (titles) and long texts (full articles), along with meta-data such as date, domain, URL, topic, and credibility scores. The credibility and bias scores were collected from the &lt;a href=&#34;https://mediabiasfactcheck.com/&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;Media Bias / Fact Check&lt;/a&gt; organization.&lt;/p&gt;
&lt;p&gt;After creating the CREDULE dataset, we developed the EVidence VERification Network (EVVER-Net), a neural network designed to detect leaked (fact-checked) and unreliable evidence during the evidence retrieval process. EVVER-Net can be integrated into an AFC pipeline to ensure that only credible and non-leaked information is used during training. The model leverages the power of large pre-trained Transformer-based text encoders, such as DeBERTa, CLIP, and T5 for short texts, and Long T5 and Longformer for long texts. It also integrates information from credibility and bias scores. EVVER-Net demonstrated impressive performance, achieving up to 89.0% accuracy without credibility scores and 94.4% with credibility scores.&lt;/p&gt;
&lt;h2 id=&#34;examining-the-evidence-of-widely-used-afc-datasets&#34;&gt;Examining the evidence of widely used AFC datasets&lt;/h2&gt;
&lt;p&gt;Finally, we applied the EVVER-Net model to the evidence provided by several widely used AFC datasets, including &lt;a href=&#34;https://github.com/Tariq60/LIAR-PLUS&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;LIAR-Plus&lt;/a&gt;, &lt;a href=&#34;https://github.com/VT-NLP/Mocheg&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;MOCHEG&lt;/a&gt;, &lt;a href=&#34;https://github.com/Shreyashm16/Factify&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;FACTIFY&lt;/a&gt;, &lt;a href=&#34;https://github.com/g-luo/news_clippings&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;NewsCLIPpings&lt;/a&gt;, and &lt;a href=&#34;https://github.com/stevejpapad/image-text-verification&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;VERITE&lt;/a&gt;. EVVER-Net identified up to 98.5% of items in LIAR-Plus, 95.0% in the “Refute” class of FACTIFY, and 83.6% in MOCHEG as leaked evidence. For instance, in the FACTIFY dataset, the claim &amp;ldquo;Microsoft bought Sony for 121 billion&amp;rdquo; was accompanied by the evidence: &amp;ldquo;A satire article claiming that Microsoft has bought Sony for 130 billion has gone viral […] the original article in a Spanish website was intended to be a prank. [&amp;hellip;]&amp;rdquo; which is sourced from a previously fact-checked article and directly provides the model with the answer curated by a professional fact-checker. This limits the model&amp;rsquo;s ability to detect and verify new claims that have not yet been fact-checked.&lt;/p&gt;
&lt;p&gt;On the other hand, the NewsCLIPpings dataset had the lowest rate of leaked evidence at 14.1%, followed by &lt;a href=&#34;https://mever.gr/post/overcoming-unimodal-bias-in-multimodal-misinformation-detection/&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;our own VERITE&lt;/a&gt; at 35.3%. For instance, a claim from VERITE: “An image shows a large crowd gathered on the Rio de Janeiro seafront to celebrate a Mass delivered by Pope Francis in 2013” is accompanied by evidence “Pope Francis wraps up Brazil trip with Mass for 3 million”, which is sourced by CBS News and is correctly identified as credible by EVVER-Net. Another claim, “A photograph captured by NASA’s Mars Curiosity Rover on May 7, 2022, showed an artificial portal nearby.” is accompanied by evidence “Does This NASA Photo Show a &amp;lsquo;Portal&amp;rsquo; and &amp;lsquo;Wall&amp;rsquo; on Mars?” sourced by  Snopes. The title by itself does not provide any leaked information into the model, but if the full article were to be fed into the model during training, it would reinforce the problem of leaked evidence.&lt;/p&gt;
&lt;p&gt;While NewsCLIPpings and VERITE display significant improvements over other datasets in the field, there is still room for enhancement, as 20% of the evidence in these datasets was estimated to be non-credible. By utilizing EVVER-Net or similar architectures, the credibility of the evidence in NewsCLIPpings and VERITE could be further improved, helping to avoid the issues of unreliable and leaked evidence and overall, building and evaluating AFC pipelines in a more realistic manner.&lt;/p&gt;
&lt;h2 id=&#34;references&#34;&gt;References&lt;/h2&gt;
&lt;p&gt;Guo, Z., Schlichtkrull, M., &amp;amp; Vlachos, A. (2022). A survey on automated fact-checking. Transactions of the Association for Computational Linguistics, 10, 178-206.&lt;/p&gt;
&lt;p&gt;Glockner, M., Hou, Y., &amp;amp; Gurevych, I. (2022, December). Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for Misinformation. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (pp. 5916-5936).&lt;/p&gt;
</description>
    </item>
    
    <item>
      <title>Papadopoulos Stefanos-Iordanis</title>
      <link>https://mever.gr/author/papadopoulos-stefanos-iordanis/</link>
      <pubDate>Wed, 03 Jul 2024 00:00:00 +0000</pubDate>
      <guid>https://mever.gr/author/papadopoulos-stefanos-iordanis/</guid>
      <description>&lt;p&gt;Stefanos-Iordanis Papadopoulos is a Research Associate at the Information Technologies Institute (ITI) of the Centre for Research &amp;amp; Technology Hellas (CERTH). As a member of the technical team, he has been involved in several EU-funded projects. His main research interests lie in the areas of multimodal deep learning, focusing on multimedia verification and retrieval, such as automated multimodal misinformation detection and fact-checking&lt;/p&gt;
</description>
    </item>
    
    <item>
      <title>Overcoming Unimodal Bias in Multimodal Misinformation Detection</title>
      <link>https://mever.gr/post/overcoming-unimodal-bias-in-multimodal-misinformation-detection/</link>
      <pubDate>Wed, 10 Jan 2024 00:00:00 +0000</pubDate>
      <guid>https://mever.gr/post/overcoming-unimodal-bias-in-multimodal-misinformation-detection/</guid>
      <description>&lt;p&gt;In this post, we explain the basics behind our paper  &lt;a href=&#34;https://link.springer.com/article/10.1007/s13735-023-00312-6&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;“VERITE: a robust benchmark for multimodal misinformation detection accounting for unimodal bias”&lt;/a&gt;, by Stefanos-Iordanis Papadopoulos, Christos Koutlis, Symeon Papadopoulos and Panagiotis C. Petrantonakis, which has been published in the International Journal of Multimedia Information Retrieval (IJMIR).&lt;/p&gt;
&lt;p&gt;Given the rampant spread of misinformation, the role of fact-checkers becomes increasingly important and their task more challenging given the sheer volume of content generated and shared daily across social media platforms. Studies reveal that multimedia content, with its visual appeal, tends to capture attention more effectively and enjoys broader dissemination compared to plain text (&lt;a href=&#34;https://journals.sagepub.com/doi/full/10.1177/0022243719881113&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;Li &amp;amp; Xie, 2019&lt;/a&gt;) and the inclusion of images can notably amplify the persuasiveness of false statements (&lt;a href=&#34;https://link.springer.com/article/10.3758/s13423-012-0292-0&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;Newman et al., 2012&lt;/a&gt;). It is for that reason that Multimodal Misinformation (MM) is very concerning. MM involves false or misleading information disseminated through diverse “modalities” of communication, including text, images, audio, and video. Scenarios often unfold where an image is removed from its authentic context, or its accompanying caption distorts critical elements, such as the event, date, location, or the identity of the depicted person. For instance, in the above figure (a) we observe an image where the grounds of a musical festival are covered in garbage, accompanied by the claim that it was taken in June 2022 “after Greta Thunberg’s environmentalist speech”. However, the image &lt;a href=&#34;https://www.snopes.com/fact-check/glastonbury-greta-thunberg/&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;was removed from its authentic context&lt;/a&gt;, since it was actually taken in 2015, not 2022.&lt;/p&gt;
&lt;p&gt;In response, researchers have been developing a range of AI-based methods for detecting MM in recent years. Typically, AI-based approaches for MM detection require two things: 1) a sufficiently large training dataset, and 2) deep learning model(s) capable of analyzing and recognizing patterns across both visual and textual modalities. Yet, the process of collecting and annotating a large dataset is cumbersome, time-consuming, and resource-intensive. To circumvent this problem, researchers have been experimenting with the creation of algorithmically created or “synthetic” misinformation. This synthetic data aims to mimic, to a certain extent, the characteristics of real-world misinformation, facilitating the training of deep learning models. Subsequently, to assess the models&amp;rsquo; performance and their ability to generalize to authentic instances of misinformation, researchers evaluate them using annotated datasets featuring real-world examples of MM (&lt;a href=&#34;https://dl.acm.org/doi/fullHtml/10.1145/3592572.3592842&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;Papadopoulos et al., 2023&lt;/a&gt;).&lt;/p&gt;
&lt;p&gt;In our recent &lt;a href=&#34;https://link.springer.com/article/10.1007/s13735-023-00312-6&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;research paper&lt;/a&gt;, we uncovered the existence of unimodal bias within widely used evaluation benchmarks for MM detection, specifically &lt;a href=&#34;https://github.com/MKLab-ITI/image-verification-corpus&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;VMU Twitter&lt;/a&gt; (MediaEval2016)  and &lt;a href=&#34;https://github.com/shivangi-aneja/COSMOS&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;COSMOS&lt;/a&gt;. The term “unimodal bias” denotes the phenomenon where a model relying solely on one modality (text-only or image-only) appears to outperform its multimodal counterpart in what is supposedly a multimodal task. This observation raised a few critical questions: what are the underlying reasons for unimodal bias? Can we reliably assess progress in the field of MM detection with these datasets? If not, how can we create a new evaluation benchmark that effectively addresses the challenge of unimodal bias?&lt;/p&gt;
&lt;p&gt;First and foremost, we posit that a key contributor to unimodal bias is what we term “asymmetric multimodal misinformation” (Asymmetric-MM). We introduce the term Asymmetric-MM to emphasize cases where a single “dominant” modality plays a pivotal role in disseminating misinformation, while other modalities exert minimal or no influence. Illustratively, in the above figure (c) a claim about “deceased people turning up to vote” is accompanied by an image that is thematically related to the claim, which primarily serves a cosmetic purpose. By concentrating on the dominant modality, a robust text-only detector would effectively identify misinformation, making the contribution of the other modality negligible in the detection process.&lt;/p&gt;
&lt;p&gt;Furthermore, we introduce the concept of “modality balancing” as a proactive measure to counteract unimodal bias. In this framework, all images and captions are included twice during the evaluation process – once in their truthful pair and once in their misleading pair. The underlying rationale is to necessitate that a model consistently considers both modalities and their interrelation when discerning between truthfulness and misinformation. By adopting this approach, we aim to prevent text-only and image-only detectors from achieving seemingly high accuracy solely by focusing on one modality.&lt;/p&gt;
&lt;p&gt;















&lt;figure  &gt;
  &lt;div class=&#34;d-flex justify-content-center&#34;&gt;
    &lt;div class=&#34;w-100&#34; &gt;&lt;img src=&#34;https://mever.gr/media/verite_collection_process.png&#34; alt=&#34;verite_collection_process&#34; loading=&#34;lazy&#34; data-zoomable /&gt;&lt;/div&gt;
  &lt;/div&gt;&lt;/figure&gt;

&lt;em&gt;Data collection, filtering and refinement process for creating VERITE. Figure by Stefanos-Iordanis Papadopoulos&lt;/em&gt;&lt;/p&gt;
&lt;p&gt;By leveraging modality balancing, excluding Asymmetric-MM and establishing rigorous criteria, we curated data from reputable fact-checking sources, namely snopes.com and reuters.com/fact-check, and created the VERITE benchmark, which stands for “VERification of Image-TExt pairs”. The above figure illustrates the data collection process for creating VERITE. Starting from articles centered around “Miscaptioned Images” and adhering to a set of inclusion criteria, we identified the authentic claim related to the image (depicted by continuous blue lines) and juxtaposed it with the false “miscaptioned” caption (MC) (illustrated by intermittent red lines). Subsequently, we formulated a query associated with the truthful claim to retrieve a related but out-of-context (OOC) image (depicted by dotted yellow lines). Thus, VERITE consists of three categories: Truthful, Out-of-context, and Miscaptioned image-caption pairs and can be used both for multiclass and binary classification tasks. We collected 260 articles from Snopes and 78 from Reuters that met our criteria resulting in 338 Truthful, 338 Miscaptioned and 324 Out-of-Context pairs.&lt;/p&gt;
&lt;p&gt;We undertook a comprehensive comparative analysis based on a Transformer-based architecture trained on various established training datasets as well as a novel method of our own for algorithmically created training data. Our findings demonstrate that VERITE successfully mitigates unimodal bias, making it a robust evaluation benchmark and more reliable as a means of assessing progress in the field of MM detection. Our proposed method, which is a state-of-the-art deep learning method, reached up to 72.7% accuracy for “out-of-context” pairs, 63.9% for “miscaptioned images” and 52.1% overall accuracy for the multiclass classification task. This leaves ample room for further experimentation and improvement for the task of MM detection and we have provided a series of different routes that future research could explore. VERITE is publicly available on &lt;a href=&#34;https://zenodo.org/records/10474450&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;zenodo&lt;/a&gt; and &lt;a href=&#34;https://github.com/stevejpapad/image-text-verification&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;github&lt;/a&gt;.&lt;/p&gt;
&lt;h2 id=&#34;references&#34;&gt;References&lt;/h2&gt;
&lt;p&gt;[1] Li Y, Xie Y (2020) Is a picture worth a thousand words? an empirical study of image content and social media engagement. J Mark Res 57(1):1–19.&lt;/p&gt;
&lt;p&gt;[2] Newman EJ, Garry M, Bernstein DM et al (2012) Nonprobative photographs (or words) inflate truthiness. Psychon Bull Rev 19:969–974.&lt;/p&gt;
&lt;p&gt;[3] Papadopoulos, S. I., Koutlis, C., Papadopoulos, S., &amp;amp; Petrantonakis, P. (2023, June). Synthetic Misinformers: Generating and Combating Multimodal Misinformation. In Proceedings of the 2nd ACM International Workshop on Multimedia AI against Disinformation (pp. 36-44).&lt;/p&gt;
</description>
    </item>
    
  </channel>
</rss>
