Loading...

Learning strengths and weaknesses of classifiers for RGB-D semantic segmentation

Fooladgar, F ; Sharif University of Technology

634 Viewed
  1. Type of Document: Article
  2. DOI: 10.1109/IranianMVIP.2015.7397531
  3. Publisher: IEEE Computer Society
  4. Abstract:
  5. 3D scene understanding is an open challenge in the field of computer vision. Most of the focus is on 2D methods in which the semantic labeling of each RGB pixel is considered. But, in this paper, the 3D semantic labeling of RGB-D images is considered. In the proposed method, to extract some meaningful features, the superpixel generation algorithm is applied to the RGB image to segment it into a set of disjoint pixels. After that, the set of three powerful classifiers are utilized to semantically label each superpixel. In the proposed method, the probability outputs of these classifiers are concatenated as the novel feature vector for each superpixel. Consequently, to analyze the strengths and weaknesses of each classifier, the conditional random field framework is used to improve the contextual relationships among neighboring superpixels. The unary potential function of the conditional random field is learned based on these new feature vectors. The proposed method is evaluated on the challenging NYU-V2 RGB-D dataset and improves the pixel average accuracy compared to previous methods
  6. Keywords:
  7. 3D scene understanding ; RGB-D segmentation ; Semantic scene labeling ; Computer vision ; Image segmentation ; Pixels ; Random processes ; Semantics ; Three dimensional computer graphics ; 3D scenes ; Conditional random field ; Contextual relationships ; Feature vectors ; Generation algorithm ; Potential function ; Semantic labeling ; Semantic segmentation ; Image processing
  8. Source: 9th Iranian Conference on Machine Vision and Image Processing, 18 November 2015 through 19 November 2015 ; Volume 2016-February , 2015 , Pages 176-179 ; 21666776 (ISSN) ; 9781467385398 (ISBN)
  9. URL: http://ieeexplore.ieee.org/document/7397531