FGSSNet: Applying Feature-Guided Semantic Segmentation on real world floorplans
2024 (engelsk)Independent thesis Advanced level (professional degree), 20 poäng / 30 hp
Oppgave
Abstract [en]
This master thesis introduces FGSSNet, a novel multi-headed feature-guided semantic segmentation (FGSS) architecture designed to improve the generalization ability of segmentation models on floorplans by injecting domain-specific information into the latent space, guiding the segmentation process. FGSSNet features a U-Net segmentation backbone with a jointly trained reconstruction head attached to the U-Net decoder, tasked with reconstructing the injected feature maps, forcing their utilization throughout the decoding process. A multi-headed dedicated feature extractor is used to extract the domain-specific feature maps used by the FGSSNet while also predicting the wall width used for our novel dynamic scaling algorithm, designed to ensure spatial consistency between the training and real-world floorplans. The results show that the reconstruction head proved redundant, diverting the networks attention away from the segmentation task, ultimately hindering its performance. Instead, the ablated reconstruction head model, FGSSNet-NoRec, showed increased performance by utilizing the injected features freely, showcasing their importance. FGSSNet-NoRec slightly improves the IoU performance of comparable U-Net models by achieving 79.3 wall IoU(%) on a preprocessed CubiCasa5K dataset while showing an average IoU increase of 3.0 (5.3%) units on the more challenging real-world floorplans, displaying a superior generalization performance by leveraging the injected domain-specific information.
sted, utgiver, år, opplag, sider
2024. , s. 119
Emneord [en]
Segmentation, Semantic-Segmentation, Feature-guided, guide segmentation, CubiCasa5k, Floorplan, injecting domain-specific, FGSSNet, FGSSNet-NoRec, Unet, Unet-backbone
HSV kategori
Identifikatorer
URN: urn:nbn:se:hh:diva-53653OAI: oai:DiVA.org:hh-53653DiVA, id: diva2:1867190
Eksternt samarbeid
Axis Communications AB
Fag / kurs
Computer science and engineering
Utdanningsprogram
Computer Science and Engineering, 300 credits
Veileder
Examiner
2024-05-292024-06-102024-06-10bibliografisk kontrollert