{"id":1655,"date":"2024-01-19T16:56:37","date_gmt":"2024-01-19T16:56:37","guid":{"rendered":"https:\/\/sbia.org.br\/lnlm\/?page_id=1655"},"modified":"2024-01-19T17:03:44","modified_gmt":"2024-01-19T17:03:44","slug":"vol21-no2-art3","status":"publish","type":"page","link":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/","title":{"rendered":"An Active Learning Approach for Detecting Customer Induced Damages in Motherboards with Deep Neural Networks"},"content":{"rendered":"<p>Lucas Cabral <a href=\"https:\/\/orcid.org\/0009-0002-9668-6184\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1167\" src=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\" alt=\"orcid\" width=\"20\" height=\"20\" \/><\/a>, Victor Farias <a href=\"https:\/\/orcid.org\/0000-0001-6244-625X\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1167\" src=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\" alt=\"orcid\" width=\"20\" height=\"20\" \/><\/a>, Lucas Sena <a href=\"https:\/\/orcid.org\/0009-0004-9318-6867\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1167\" src=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\" alt=\"orcid\" width=\"20\" height=\"20\" \/><\/a>, Iago Chaves <a href=\"https:\/\/orcid.org\/0000-0002-1733-3069\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1167\" src=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\" alt=\"orcid\" width=\"20\" height=\"20\" \/><\/a>, Jo\u00e3o Paulo Pordeus <a href=\"https:\/\/orcid.org\/0000-0003-1686-595X\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1167\" src=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\" alt=\"orcid\" width=\"20\" height=\"20\" \/><\/a>, Jo\u00e3o Pedro Santiago <a href=\"https:\/\/orcid.org\/0009-0005-2454-3397\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1167\" src=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\" alt=\"orcid\" width=\"20\" height=\"20\" \/><\/a>, Diego S\u00e1 <a href=\"https:\/\/orcid.org\/0009-0009-0689-511X\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1167\" src=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\" alt=\"orcid\" width=\"20\" height=\"20\" \/><\/a>, Javam Machado <a href=\"https:\/\/orcid.org\/0000-0002-8430-9421\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1167\" src=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\" alt=\"orcid\" width=\"20\" height=\"20\" \/><\/a>,&amp; Jo\u00e3o Paulo Madeiro <a href=\"https:\/\/orcid.org\/0000-0001-6511-6707\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1167\" src=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\" alt=\"orcid\" width=\"20\" height=\"20\" \/><\/a><\/p>\n<p><strong>Abstract:<\/strong> Identifying Customer Induced Damage (CID) is a key part in warranty programs of electronics manufacturers. CID is defined as any damage in the unit performed by an unauthorized person including the customer in a Printed Circuit Board (PCB). In such cases, damaged units are not covered by warranty. The inspection of CIDs is usually performed by humans which may be costly and error prone. Modern computer vision techniques for object detection using deep neural networks can automatically and accurately detect CIDs on PCBs. The training of such networks requires a large labeled dataset of image examples of CIDs. Daily, hardware factories and repair centers generate hundreds of unlabeled images. Labeling them manually is laborious and time-consuming. Therefore, it is crucial to label the minimum amount of images such that the trained neural network can achieve comparable accuracy as if it were trained with the whole dataset. To this end, we propose an active learning approach that selects the most informative images for the object detector. For that, our approach is based on the uncertainty of the object detector, i.e., it selects new images based on class probability distribution given by the object detector. Also, we tackle some challenges that are intrinsic to this problem: i) it is a multiclass object detection problem since there are many types of defects; ii) there is a class accuracy imbalance; iii) there is a focus on recall, e.g. false positives are less harmful than false negatives, and iv) there are many images with no object which should not be selected for labeling. We evaluate this approach by using it to iteratively sample data, train and evaluate a model, and compare it with randomly sampled data. The results show that our method consistently outperforms random sampling by an average margin of 21.6%, proving to be a viable alternative for reducing the labeling cost and increasing detection accuracy in this domain.<\/p>\n<p><strong>Keywords:<\/strong> Customer Induced Damage, Printed Circuit Board (PCB), Deep Learning, Computer Vision.<\/p>\n<p><strong>DOI code:<\/strong> <a href=\"http:\/\/dx.doi.org\/10.21528\/lnlm-vol21-no2-art3\">10.21528\/lnlm-vol21-no2-art3<\/a><\/p>\n<p><strong>PDF file:<\/strong> <a href=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/2023\/12\/vol21-no2-art3.pdf\">vol21-no2-art3.pdf<\/a><\/p>\n<p><strong>BibTex file:<\/strong> <a href=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/2023\/12\/vol21-no2-art3.bib\">vol21-no2-art3.bib <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Lucas Cabral , Victor Farias , Lucas Sena , Iago Chaves , Jo\u00e3o Paulo Pordeus , Jo\u00e3o Pedro Santiago , Diego S\u00e1 , Javam Machado ,&amp; Jo\u00e3o Paulo Madeiro Abstract: Identifying Customer Induced Damage (CID) is a key part in <a href=\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/\" class=\"read-more\">Read More &#8230;<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":1613,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-1655","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>An Active Learning Approach for Detecting Customer Induced Damages in Motherboards with Deep Neural Networks - Learning and NonLinear Models<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/\" \/>\n<meta property=\"og:locale\" content=\"pt_BR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"An Active Learning Approach for Detecting Customer Induced Damages in Motherboards with Deep Neural Networks - Learning and NonLinear Models\" \/>\n<meta property=\"og:description\" content=\"Lucas Cabral , Victor Farias , Lucas Sena , Iago Chaves , Jo\u00e3o Paulo Pordeus , Jo\u00e3o Pedro Santiago , Diego S\u00e1 , Javam Machado ,&amp; Jo\u00e3o Paulo Madeiro Abstract: Identifying Customer Induced Damage (CID) is a key part in Read More ...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/\" \/>\n<meta property=\"og:site_name\" content=\"Learning and NonLinear Models\" \/>\n<meta property=\"article:modified_time\" content=\"2024-01-19T17:03:44+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. tempo de leitura\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutos\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/\",\"url\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/\",\"name\":\"An Active Learning Approach for Detecting Customer Induced Damages in Motherboards with Deep Neural Networks - Learning and NonLinear Models\",\"isPartOf\":{\"@id\":\"https:\/\/sbia.org.br\/lnlm\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\",\"datePublished\":\"2024-01-19T16:56:37+00:00\",\"dateModified\":\"2024-01-19T17:03:44+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/#breadcrumb\"},\"inLanguage\":\"pt-BR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"pt-BR\",\"@id\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/#primaryimage\",\"url\":\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\",\"contentUrl\":\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Browse issues\",\"item\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Learning &#038; Nonlinear Models &#8211; L&#038;NLM &#8211; Volume 21 &#8211; N\u00famero 2\",\"item\":\"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"An Active Learning Approach for Detecting Customer Induced Damages in Motherboards with Deep Neural Networks\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/sbia.org.br\/lnlm\/#website\",\"url\":\"https:\/\/sbia.org.br\/lnlm\/\",\"name\":\"Learning and NonLinear Models\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/sbia.org.br\/lnlm\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/sbia.org.br\/lnlm\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"pt-BR\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/sbia.org.br\/lnlm\/#organization\",\"name\":\"Learning and NonLinear Models\",\"url\":\"https:\/\/sbia.org.br\/lnlm\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"pt-BR\",\"@id\":\"https:\/\/sbia.org.br\/lnlm\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/2021\/07\/logo-lnlm.png\",\"contentUrl\":\"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/2021\/07\/logo-lnlm.png\",\"width\":398,\"height\":94,\"caption\":\"Learning and NonLinear Models\"},\"image\":{\"@id\":\"https:\/\/sbia.org.br\/lnlm\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"An Active Learning Approach for Detecting Customer Induced Damages in Motherboards with Deep Neural Networks - Learning and NonLinear Models","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/","og_locale":"pt_BR","og_type":"article","og_title":"An Active Learning Approach for Detecting Customer Induced Damages in Motherboards with Deep Neural Networks - Learning and NonLinear Models","og_description":"Lucas Cabral , Victor Farias , Lucas Sena , Iago Chaves , Jo\u00e3o Paulo Pordeus , Jo\u00e3o Pedro Santiago , Diego S\u00e1 , Javam Machado ,&amp; Jo\u00e3o Paulo Madeiro Abstract: Identifying Customer Induced Damage (CID) is a key part in Read More ...","og_url":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/","og_site_name":"Learning and NonLinear Models","article_modified_time":"2024-01-19T17:03:44+00:00","og_image":[{"url":"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. tempo de leitura":"2 minutos"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/","url":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/","name":"An Active Learning Approach for Detecting Customer Induced Damages in Motherboards with Deep Neural Networks - Learning and NonLinear Models","isPartOf":{"@id":"https:\/\/sbia.org.br\/lnlm\/#website"},"primaryImageOfPage":{"@id":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/#primaryimage"},"image":{"@id":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/#primaryimage"},"thumbnailUrl":"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg","datePublished":"2024-01-19T16:56:37+00:00","dateModified":"2024-01-19T17:03:44+00:00","breadcrumb":{"@id":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/#breadcrumb"},"inLanguage":"pt-BR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/"]}]},{"@type":"ImageObject","inLanguage":"pt-BR","@id":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/#primaryimage","url":"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg","contentUrl":"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/sites\/4\/2020\/09\/orcid.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/vol21-no2-art3\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Browse issues","item":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/"},{"@type":"ListItem","position":2,"name":"Learning &#038; Nonlinear Models &#8211; L&#038;NLM &#8211; Volume 21 &#8211; N\u00famero 2","item":"https:\/\/sbia.org.br\/lnlm\/publicacoes\/vol21-no2\/"},{"@type":"ListItem","position":3,"name":"An Active Learning Approach for Detecting Customer Induced Damages in Motherboards with Deep Neural Networks"}]},{"@type":"WebSite","@id":"https:\/\/sbia.org.br\/lnlm\/#website","url":"https:\/\/sbia.org.br\/lnlm\/","name":"Learning and NonLinear Models","description":"","publisher":{"@id":"https:\/\/sbia.org.br\/lnlm\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/sbia.org.br\/lnlm\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"pt-BR"},{"@type":"Organization","@id":"https:\/\/sbia.org.br\/lnlm\/#organization","name":"Learning and NonLinear Models","url":"https:\/\/sbia.org.br\/lnlm\/","logo":{"@type":"ImageObject","inLanguage":"pt-BR","@id":"https:\/\/sbia.org.br\/lnlm\/#\/schema\/logo\/image\/","url":"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/2021\/07\/logo-lnlm.png","contentUrl":"https:\/\/sbia.org.br\/lnlm\/wp-content\/uploads\/2021\/07\/logo-lnlm.png","width":398,"height":94,"caption":"Learning and NonLinear Models"},"image":{"@id":"https:\/\/sbia.org.br\/lnlm\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/pages\/1655","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/comments?post=1655"}],"version-history":[{"count":4,"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/pages\/1655\/revisions"}],"predecessor-version":[{"id":1659,"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/pages\/1655\/revisions\/1659"}],"up":[{"embeddable":true,"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/pages\/1613"}],"wp:attachment":[{"href":"https:\/\/sbia.org.br\/lnlm\/wp-json\/wp\/v2\/media?parent=1655"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}