FGSSNet: Applying Feature-Guided Semantic Segmentation on real world floorplans
2024 (Engelska)Självständigt arbete på avancerad nivå (yrkesexamen), 20 poäng / 30 hp
Studentuppsats (Examensarbete)
Abstract [en]
This master thesis introduces FGSSNet, a novel multi-headed feature-guided semantic segmentation (FGSS) architecture designed to improve the generalization ability of segmentation models on floorplans by injecting domain-specific information into the latent space, guiding the segmentation process. FGSSNet features a U-Net segmentation backbone with a jointly trained reconstruction head attached to the U-Net decoder, tasked with reconstructing the injected feature maps, forcing their utilization throughout the decoding process. A multi-headed dedicated feature extractor is used to extract the domain-specific feature maps used by the FGSSNet while also predicting the wall width used for our novel dynamic scaling algorithm, designed to ensure spatial consistency between the training and real-world floorplans. The results show that the reconstruction head proved redundant, diverting the networks attention away from the segmentation task, ultimately hindering its performance. Instead, the ablated reconstruction head model, FGSSNet-NoRec, showed increased performance by utilizing the injected features freely, showcasing their importance. FGSSNet-NoRec slightly improves the IoU performance of comparable U-Net models by achieving 79.3 wall IoU(%) on a preprocessed CubiCasa5K dataset while showing an average IoU increase of 3.0 (5.3%) units on the more challenging real-world floorplans, displaying a superior generalization performance by leveraging the injected domain-specific information.
Ort, förlag, år, upplaga, sidor
2024. , s. 119
Nyckelord [en]
Segmentation, Semantic-Segmentation, Feature-guided, guide segmentation, CubiCasa5k, Floorplan, injecting domain-specific, FGSSNet, FGSSNet-NoRec, Unet, Unet-backbone
Nationell ämneskategori
Data- och informationsvetenskap
Identifikatorer
URN: urn:nbn:se:hh:diva-53653OAI: oai:DiVA.org:hh-53653DiVA, id: diva2:1867190
Externt samarbete
Axis Communications AB
Ämne / kurs
Datateknik
Utbildningsprogram
Civilingenjör i datateknik
Handledare
Examinatorer
2024-05-292024-06-102025-10-01Bibliografiskt granskad