<?xml version="1.0" encoding="utf-8" standalone="yes" ?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>Baltsou Georgia | MeVer</title>
    <link>https://mever.gr/author/baltsou-georgia/</link>
      <atom:link href="https://mever.gr/author/baltsou-georgia/index.xml" rel="self" type="application/rss+xml" />
    <description>Baltsou Georgia</description>
    <generator>Wowchemy (https://wowchemy.com)</generator><language>en-us</language><lastBuildDate>Fri, 31 May 2024 00:00:00 +0000</lastBuildDate>
    <image>
      <url>https://mever.gr/author/baltsou-georgia/avatar_hu_95a33587c07572ed.jpg</url>
      <title>Baltsou Georgia</title>
      <link>https://mever.gr/author/baltsou-georgia/</link>
    </image>
    
    <item>
      <title>Baltsou Georgia</title>
      <link>https://mever.gr/author/baltsou-georgia/</link>
      <pubDate>Fri, 31 May 2024 00:00:00 +0000</pubDate>
      <guid>https://mever.gr/author/baltsou-georgia/</guid>
      <description>&lt;p&gt;Georgia Baltsou works as a Postdoctoral Research Fellow at the Information Technologies Institute (ITI) of the Centre for Research &amp;amp; Technology Hellas (CERTH). She is involved in EU-funded projects in the field of artificial intelligence. Her main research interests lie in the areas of network science and artificial intelligence. Community detection in graphs, causality of community participation and image generative models constitute her key areas of interest.&lt;/p&gt;
</description>
    </item>
    
    <item>
      <title>SDFD: Building a Versatile Synthetic Face Image Dataset with Diverse Attributes</title>
      <link>https://mever.gr/post/sdfd_building-a-versatile-synthetic-face-image-dataset-with-diverse-attributes/</link>
      <pubDate>Fri, 31 May 2024 00:00:00 +0000</pubDate>
      <guid>https://mever.gr/post/sdfd_building-a-versatile-synthetic-face-image-dataset-with-diverse-attributes/</guid>
      <description>&lt;p&gt;Artificial Intelligence (AI) systems today are incredibly advanced, leveraging vast amounts of data to perform complex tasks with high accuracy. These systems require huge datasets to train effectively. The quality and quantity of data significantly impact their performance, enabling them to recognize patterns, make predictions, and improve decision-making processes. As AI continues to evolve, the demand for large, diverse, and high-quality datasets increases especially, for image-based systems dealing with demographic attribute prediction that often face considerable bias and discrimination issues. Many current face image datasets primarily focus on representativeness in terms of demographic factors such as age, gender, and skin tone, overlooking other crucial facial attributes like hairstyle and accessories. This narrow focus limits the diversity of the data and consequently the robustness of AI systems trained on them.&lt;/p&gt;
&lt;p&gt;In our recent work &lt;a href=&#34;https://arxiv.org/abs/2404.17255&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;“SDFD: Building a Versatile Synthetic Face Image Dataset with Diverse Attributes”&lt;/a&gt; that we presented in the &lt;a href=&#34;https://responsiblefaceimageprocessing.github.io/fg2024/&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;1st International Workshop on Responsible Face Image Processing&lt;/a&gt;, we tried to address the former limitations of existing datasets, by proposing a methodology for generating synthetic face image datasets that capture a broader spectrum of facial diversity. Specifically, our approach integrates a state-of-the-art text-to-image generation model with a systematic prompt formulation strategy, encompassing not only demographics and biometrics but also non-permanent traits like make-up, hairstyle, and accessories. These lead to a comprehensive dataset of high-quality realistic images, which can be used as an evaluation set in face analysis systems.&lt;/p&gt;
&lt;p&gt;The first step in our process was to compile a list of terms that will represent the attributes that one would like to be depicted in the target face images. These terms should be carefully picked and then filtered to eliminate specific words or phrases (see Table 1). After completing the basic attribute list, combinations of them are created to generate the text prompt. Prompts are used as input text to the generative model, describing the image that should be constructed. The more exact the description, the closer the resulting image will be to what was envisioned. Besides, negative terms are also important in the prompt process since they specify what should not be included in the generated image.&lt;/p&gt;
&lt;p&gt;















&lt;figure  &gt;
  &lt;div class=&#34;d-flex justify-content-center&#34;&gt;
    &lt;div class=&#34;w-100&#34; &gt;&lt;img src=&#34;https://mever.gr/media/sdfd_table.png&#34; alt=&#34;Table 1&#34; loading=&#34;lazy&#34; data-zoomable /&gt;&lt;/div&gt;
  &lt;/div&gt;&lt;/figure&gt;
&lt;em&gt;Table 1. Terms used in prompts. Options are presented in alphabetical order.&lt;/em&gt;&lt;/p&gt;
&lt;p&gt;Figure 1 shows some example face image datasets created by our methodology along with their input prompts.&lt;/p&gt;
&lt;p&gt;















&lt;figure  &gt;
  &lt;div class=&#34;d-flex justify-content-center&#34;&gt;
    &lt;div class=&#34;w-100&#34; &gt;&lt;img src=&#34;https://mever.gr/media/sdfd_featured.png&#34; alt=&#34;Figure 1&#34; loading=&#34;lazy&#34; data-zoomable /&gt;&lt;/div&gt;
  &lt;/div&gt;&lt;/figure&gt;
&lt;em&gt;Fig. 1. Example generated images and their corresponding prompts without including universal prompt terms:a. Black, baby boy, short hair, 4K, Fujifilm XT3, b. Pacific Islander-Middle Eastern woman, having face tattoo, headband,having wrinkles, 8K, Nikon Z9, c. Pacific Islander, stressed, wearing headscarf, girl, black eyes, wearing lipstick, 8K, d. White, androgynous person, pink hair, blue eyes, Fujifilm XT3, e. White, girl, headband, Ultra HD, Nikon Z9, f. Southeast Asian-White, man, having piercing, dreadlocks, having wrinkles, Ultra HD, Canon Eos 5D.&lt;/em&gt;&lt;/p&gt;
&lt;p&gt;We opted for Stable Diffusion v2.1 [1] and generated 1000 face images, which constitute the first version of our Stabe Diffusion Face-image Dataset (SDFD).&lt;/p&gt;
&lt;p&gt;We compared SDFD with the existing FairFace [2] and LFW [3] datasets, which are established face images that comprise real images and are used in several fairness-aware research works. Our comparative study demonstrated that SDFD was an equally or even more challenging dataset compared to the existing ones, while also being considerably smaller in size.&lt;/p&gt;
&lt;p&gt;In the future, we intend to extend the number of images in our dataset to include less well-represented facial attributes such as scars, braces, and even disabilities - that we were unable to include in the current dataset version due to limitations in the text-to-image model. Besides, we intend to explore different prompting strategies and generative models. Finally, we would also like to extend SDFD with multiple images for the same identity to make it appropriate for other tasks such as face verification.&lt;/p&gt;
&lt;p&gt;SDFD is publicly available on &lt;a href=&#34;https://github.com/gebaltso/SDFD/&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;Github&lt;/a&gt; and the corresponding paper on &lt;a href=&#34;https://arxiv.org/abs/2404.17255&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;arXiv&lt;/a&gt;.&lt;/p&gt;
&lt;h1 id=&#34;references&#34;&gt;References&lt;/h1&gt;
&lt;p&gt;[1] Rombach, R., Blattmann, A., Lorenz, D., Esser, P., &amp;amp; Ommer, B. (2022). High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 10684-10695).&lt;/p&gt;
&lt;p&gt;[2] Karkkainen, K., &amp;amp; Joo, J. (2021). Fairface: Face attribute dataset for balanced race, gender, and age for bias measurement and mitigation. In Proceedings of the IEEE/CVF winter conference on applications of computer vision (pp. 1548-1558).&lt;/p&gt;
&lt;p&gt;[3] Huang, G. B., Mattar, M., Berg, T., &amp;amp; Learned-Miller, E. (2008, October). Labeled faces in the wild: A database for studying face recognition in unconstrained environments. In Workshop on faces in &amp;lsquo;Real-Life&amp;rsquo; Images: detection, alignment, and recognition.&lt;/p&gt;
</description>
    </item>
    
    <item>
      <title>FRCSyn-onGoing:Benchmarking and comprehensive evaluation of real and synthetic data to improve face recognition systems</title>
      <link>https://mever.gr/post/frcsyn_ongoing_benchmarking-and-comprehensive-evaluation-of-real-and-synthetic-data-to-improve-face-recognition-systems/</link>
      <pubDate>Fri, 03 May 2024 00:00:00 +0000</pubDate>
      <guid>https://mever.gr/post/frcsyn_ongoing_benchmarking-and-comprehensive-evaluation-of-real-and-synthetic-data-to-improve-face-recognition-systems/</guid>
      <description>&lt;p&gt;This post provides an overview of the paper &lt;a href=&#34;https://www.sciencedirect.com/science/article/pii/S1566253524001003&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;&amp;ldquo;FRCSyn-onGoing: Benchmarking and comprehensive evaluation of real and synthetic data to improve face recognition systems&amp;rdquo;&lt;/a&gt; , which has been published in the &lt;a href=&#34;https://www.sciencedirect.com/journal/&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;Information Fusion&lt;/a&gt;information-fusion journal. This has been a collaborative effort led by the organizers of the FRCSyn-onGoing challenge and several of the participating teams, such as ours.&lt;/p&gt;
&lt;p&gt;The utilization of synthetic data in face recognition systems offers several advantages over real-world datasets. Synthetic datasets provide a solution to privacy concerns associated with collecting real data that potentially include personal information without obtaining the consent by the affected individuals, a case that is quite common in image datasets sourced from the Internet. They also enable the generation of large datasets, which is especially important after the discontinuation of established databases due to privacy issues and regulations like the General Data Protection Regulation (GDPR) [27]. Synthetic data can be tailored to specific characteristics, such as demographic groups and age, without the need for additional human efforts, unlike real-world databases that may lack diversity in representation or suffer from a variety of sampling biases.&lt;/p&gt;
&lt;p&gt;In particular, the paper focuses on advancing face recognition technology by evaluating the effectiveness of using synthetic data alongside real data. This initiative involves a collaborative effort from researchers worldwide to address the limitations and challenges faced by current face recognition systems. By combining real and synthetic data, the paper aims to enhance the performance and accuracy of face recognition technology. The article summarizes the findings from the Face Recognition Challenge in the Era of Synthetic Data (FRCSyn) held at WACV 2024.&lt;/p&gt;
&lt;p&gt;One of the key aspects of the paper is the comprehensive evaluation of Face Recognition (FR) systems across different demographic groups and databases. Researchers have identified notable findings, such as lower performance on demographic groups representing the Asian population compared to others. However, training face recognition systems with synthetic data generated by frameworks like DCFace [1] and GANDiffFace [2] (see Figure 1) has led to promising results, particularly in addressing demographic diversity within test populations.&lt;/p&gt;
&lt;p&gt;















&lt;figure  &gt;
  &lt;div class=&#34;d-flex justify-content-center&#34;&gt;
    &lt;div class=&#34;w-100&#34; &gt;&lt;img alt=&#34;Figure 1&#34; srcset=&#34;
               /post/frcsyn_ongoing_benchmarking-and-comprehensive-evaluation-of-real-and-synthetic-data-to-improve-face-recognition-systems/featured_hu_d4f3b7b69ff09ca8.webp 400w,
               /post/frcsyn_ongoing_benchmarking-and-comprehensive-evaluation-of-real-and-synthetic-data-to-improve-face-recognition-systems/featured_hu_8d7a593e7d1434ab.webp 760w,
               /post/frcsyn_ongoing_benchmarking-and-comprehensive-evaluation-of-real-and-synthetic-data-to-improve-face-recognition-systems/featured_hu_fd1937081eeb92c6.webp 1200w&#34;
               src=&#34;https://mever.gr/post/frcsyn_ongoing_benchmarking-and-comprehensive-evaluation-of-real-and-synthetic-data-to-improve-face-recognition-systems/featured_hu_d4f3b7b69ff09ca8.webp&#34;
               width=&#34;760&#34;
               height=&#34;185&#34;
               loading=&#34;lazy&#34; data-zoomable /&gt;&lt;/div&gt;
  &lt;/div&gt;&lt;/figure&gt;
&lt;em&gt;Figure 1: Examples of synthetic identities (one for each row) and their intra-class variations provided by two generative frameworks:(a) DCFace [1] and (b) GANDiffFa[2].&lt;/em&gt;&lt;/p&gt;
&lt;p&gt;Teams participating in the challenge, among which the MeVer team, proposed new approaches to reduce demographic bias and improve the overall performance of FR systems. By using ResNet backbones, ArcFace, and AdaFace loss functions, with several integrating multiple networks and advanced data augmentation techniques, researchers aimed to create less biased features and enhance the learning process for FR systems. Standardized benchmarks and metrics to evaluate FR performance in realistic scenarios, are also presented. By considering factors such as pose variations, aging, occlusions, and diverse demographic groups, researchers provide a more comprehensive assessment of the capabilities of these systems.&lt;/p&gt;
&lt;p&gt;Through the FRCSyn-onGoing challenge, researchers are paving the way for the future of FR technology by exploring the potential of synthetic data and domain generalization techniques. The collaboration between industry and academia in this initiative highlights the importance of addressing demographic bias and improving the fairness and accuracy of face recognition systems. By continuing to explore the benefits of synthetic data and innovative approaches, the paper aims to drive advancements in FR technology and contribute to rendering it more trustworthy and reliable.&lt;/p&gt;
&lt;h1 id=&#34;references&#34;&gt;References&lt;/h1&gt;
&lt;p&gt;[1] M. Kim, F. Liu, A. Jain, X. Liu, DCFace: Synthetic face generation with dual condition diffusion model, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.&lt;/p&gt;
&lt;p&gt;[2] P. Melzi, C. Rathgeb, R. Tolosana, R. Vera-Rodriguez, D. Lawatsch, F. Domin, M. Schaubert, GANDiffFace: Controllable generation of synthetic datasets for face recognition with realistic variations, in: Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, 2023.&lt;/p&gt;
&lt;p&gt;[3] P. Voigt, A. Von dem Bussche, The EU general data protection regulation (GDPR), in: A Practical Guide, first ed., Vol. 10, (3152676) Springer International Publishing, Cham, 2017, pp. 10–5555.&lt;/p&gt;
</description>
    </item>
    
  </channel>
</rss>
