Semantic 3D Occupancy Mapping through Efficient High Order CRFs [article]

Shichao Yang, Yulan Huang, Sebastian Scherer
<span title="2017-07-24">2017</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
Semantic 3D mapping can be used for many applications such as robot navigation and virtual interaction. In recent years, there has been great progress in semantic segmentation and geometric 3D mapping. However, it is still challenging to combine these two tasks for accurate and large-scale semantic mapping from images. In the paper, we propose an incremental and (near) real-time semantic mapping system. A 3D scrolling occupancy grid map is built to represent the world, which is memory and
more &raquo; ... ationally efficient and bounded for large scale environments. We utilize the CNN segmentation as prior prediction and further optimize 3D grid labels through a novel CRF model. Superpixels are utilized to enforce smoothness and form robust P N high order potential. An efficient mean field inference is developed for the graph optimization. We evaluate our system on the KITTI dataset and improve the segmentation accuracy by 10% over existing systems.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1707.07388v1">arXiv:1707.07388v1</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/uxgaebfdz5ekrfaal43ujftzx4">fatcat:uxgaebfdz5ekrfaal43ujftzx4</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200902075028/https://arxiv.org/pdf/1707.07388v1.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/8a/57/8a5720964cc8015890246998004191a731759fff.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1707.07388v1" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>