{"id":1478,"date":"2022-10-11T13:41:03","date_gmt":"2022-10-11T13:41:03","guid":{"rendered":"https:\/\/sbia.org.br\/lnlm\/?page_id=1478"},"modified":"2022-10-11T13:41:45","modified_gmt":"2022-10-11T13:41:45","slug":"vol20-no1-art5","status":"publish","type":"page","link":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/","title":{"rendered":"A Scalable Analytics Pipeline for COVID-19 Face Mask Surveillance"},"content":{"rendered":"<p>Clayton Kossoski <a href=\"https:\/\/orcid.org\/0000-0002-3291-6465\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1167\" src=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\" alt=\"orcid\" width=\"20\" height=\"20\" \/><\/a>Gustavo Schaefer <a href=\"https:\/\/orcid.org\/0000-0002-2353-7025\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1167\" src=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\" alt=\"orcid\" width=\"20\" height=\"20\" \/><\/a>Gianlucca Fiori Oliveira <a href=\"https:\/\/orcid.org\/0000-0002-8767-6315\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1167\" src=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\" alt=\"orcid\" width=\"20\" height=\"20\" \/><\/a>&#038; Heitor Silv\u00e9rio Lopes  <a href=\"https:\/\/orcid.org\/0000-0003-3984-1432\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1167\" src=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\" alt=\"orcid\" width=\"20\" height=\"20\" \/><\/a><\/p>\n<p><strong>Abstract:<\/strong> The COVID-19 coronavirus pandemic still causes a global health crisis. An effective protection method is using a face mask in public areas, according to the World Health Organization (WHO). Computer vision systems can be allies in monitoring public areas where the face mask is mandatory. However, face mask detection is challenging due to many factors, including diversity of people, facial features, head accessories, mask design, image position, and lighting changes. To tackle these issues, we present the following contributions: a new balanced face mask dataset named UTFPR-FMD1, consisting of 61,430 images splitted into \u201cface\u201d and \u201cmask\u201d classes; a transfer learning classification model for computer vision tasks, trained with our dataset; a new processing pipeline that allows face mask detection in video streams. Unlike available public datasets with imbalanced class distributions, the UTFPR-FMD1 contains images from different people, gender, and ages to minimize the training difficulty of deep learning models. We introduced a new measure to select valid images to perform inferences. Experimental results show the effectiveness of our model, outperforming the state-of-art methods for face mask detection tasks. Additionally, and different from other authors, we also present qualitative results. The system can detect heads with up to 60 degrees of rotation and process up to 10 FPS. In future work, we will deploy the current framework into production, perform tests in a near real-time environment, and extend it to process multiple video streams.<\/p>\n<p><strong>Keywords:<\/strong> facemask dataset, facemask detection model, distributed processing framework, data augmentation, transfer learning.<\/p>\n<p><strong>DOI code:<\/strong> <a href=\"http:\/\/dx.doi.org\/10.21528\/lnlm-vol20-no1-art5\">10.21528\/lnlm-vol20-no1-art5<\/a><\/p>\n<p><strong>PDF file:<\/strong> <a href=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/2022\/12\/vol20-no1-art5.pdf\">vol20-no1-art5.pdf<\/a><\/p>\n<p><strong>BibTex file:<\/strong> <a href=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/2022\/12\/vol20-no1-art5.bib\">vol20-no1-art5.bib<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Clayton Kossoski Gustavo Schaefer Gianlucca Fiori Oliveira &#038; Heitor Silv\u00e9rio Lopes Abstract: The COVID-19 coronavirus pandemic still causes a global health crisis. An effective protection method is using a face mask in public areas, according to the World Health Organization <a href=\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/\" class=\"read-more\">Read More &#8230;<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":1458,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-1478","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>A Scalable Analytics Pipeline for COVID-19 Face Mask Surveillance - Learning and NonLinear Models<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/\" \/>\n<meta property=\"og:locale\" content=\"pt_BR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"A Scalable Analytics Pipeline for COVID-19 Face Mask Surveillance - Learning and NonLinear Models\" \/>\n<meta property=\"og:description\" content=\"Clayton Kossoski Gustavo Schaefer Gianlucca Fiori Oliveira &#038; Heitor Silv\u00e9rio Lopes Abstract: The COVID-19 coronavirus pandemic still causes a global health crisis. An effective protection method is using a face mask in public areas, according to the World Health Organization Read More ...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/\" \/>\n<meta property=\"og:site_name\" content=\"Learning and NonLinear Models\" \/>\n<meta property=\"article:modified_time\" content=\"2022-10-11T13:41:45+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. tempo de leitura\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minuto\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/\",\"url\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/\",\"name\":\"A Scalable Analytics Pipeline for COVID-19 Face Mask Surveillance - Learning and NonLinear Models\",\"isPartOf\":{\"@id\":\"https:\/\/sbia.org.br\/lnlm\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\",\"datePublished\":\"2022-10-11T13:41:03+00:00\",\"dateModified\":\"2022-10-11T13:41:45+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/#breadcrumb\"},\"inLanguage\":\"pt-BR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"pt-BR\",\"@id\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/#primaryimage\",\"url\":\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\",\"contentUrl\":\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Browse issues\",\"item\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Learning &#038; Nonlinear Models &#8211; L&#038;NLM &#8211; Volume 20 &#8211; N\u00famero 1\",\"item\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"A Scalable Analytics Pipeline for COVID-19 Face Mask Surveillance\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/sbia.org.br\/lnlm\/#website\",\"url\":\"https:\/\/sbia.org.br\/lnlm\/\",\"name\":\"Learning and NonLinear Models\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/sbia.org.br\/lnlm\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/sbia.org.br\/lnlm\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"pt-BR\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/sbia.org.br\/lnlm\/#organization\",\"name\":\"Learning and NonLinear Models\",\"url\":\"https:\/\/sbia.org.br\/lnlm\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"pt-BR\",\"@id\":\"https:\/\/sbia.org.br\/lnlm\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/2021\/07\/logo-lnlm.png\",\"contentUrl\":\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/2021\/07\/logo-lnlm.png\",\"width\":398,\"height\":94,\"caption\":\"Learning and NonLinear Models\"},\"image\":{\"@id\":\"https:\/\/sbia.org.br\/lnlm\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"A Scalable Analytics Pipeline for COVID-19 Face Mask Surveillance - Learning and NonLinear Models","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/","og_locale":"pt_BR","og_type":"article","og_title":"A Scalable Analytics Pipeline for COVID-19 Face Mask Surveillance - Learning and NonLinear Models","og_description":"Clayton Kossoski Gustavo Schaefer Gianlucca Fiori Oliveira &#038; Heitor Silv\u00e9rio Lopes Abstract: The COVID-19 coronavirus pandemic still causes a global health crisis. An effective protection method is using a face mask in public areas, according to the World Health Organization Read More ...","og_url":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/","og_site_name":"Learning and NonLinear Models","article_modified_time":"2022-10-11T13:41:45+00:00","og_image":[{"url":"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. tempo de leitura":"1 minuto"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/","url":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/","name":"A Scalable Analytics Pipeline for COVID-19 Face Mask Surveillance - Learning and NonLinear Models","isPartOf":{"@id":"https:\/\/sbia.org.br\/lnlm\/#website"},"primaryImageOfPage":{"@id":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/#primaryimage"},"image":{"@id":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/#primaryimage"},"thumbnailUrl":"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg","datePublished":"2022-10-11T13:41:03+00:00","dateModified":"2022-10-11T13:41:45+00:00","breadcrumb":{"@id":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/#breadcrumb"},"inLanguage":"pt-BR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/"]}]},{"@type":"ImageObject","inLanguage":"pt-BR","@id":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/#primaryimage","url":"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg","contentUrl":"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/vol20-no1-art5\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Browse issues","item":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/"},{"@type":"ListItem","position":2,"name":"Learning &#038; Nonlinear Models &#8211; L&#038;NLM &#8211; Volume 20 &#8211; N\u00famero 1","item":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol20-no1\/"},{"@type":"ListItem","position":3,"name":"A Scalable Analytics Pipeline for COVID-19 Face Mask Surveillance"}]},{"@type":"WebSite","@id":"https:\/\/sbia.org.br\/lnlm\/#website","url":"https:\/\/sbia.org.br\/lnlm\/","name":"Learning and NonLinear Models","description":"","publisher":{"@id":"https:\/\/sbia.org.br\/lnlm\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/sbia.org.br\/lnlm\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"pt-BR"},{"@type":"Organization","@id":"https:\/\/sbia.org.br\/lnlm\/#organization","name":"Learning and NonLinear Models","url":"https:\/\/sbia.org.br\/lnlm\/","logo":{"@type":"ImageObject","inLanguage":"pt-BR","@id":"https:\/\/sbia.org.br\/lnlm\/#\/schema\/logo\/image\/","url":"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/2021\/07\/logo-lnlm.png","contentUrl":"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/2021\/07\/logo-lnlm.png","width":398,"height":94,"caption":"Learning and NonLinear Models"},"image":{"@id":"https:\/\/sbia.org.br\/lnlm\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/pages\/1478","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/comments?post=1478"}],"version-history":[{"count":2,"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/pages\/1478\/revisions"}],"predecessor-version":[{"id":1480,"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/pages\/1478\/revisions\/1480"}],"up":[{"embeddable":true,"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/pages\/1458"}],"wp:attachment":[{"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/media?parent=1478"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}