A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit <a rel="external noopener" href="https://arxiv.org/pdf/1905.03277v1.pdf">the original URL</a>. The file type is <code>application/pdf</code>.
Handheld Multi-Frame Super-Resolution
[article]
<span title="2019-05-08">2019</span>
<span class="release-stage" >pre-print</span>
Preserved Fulltext
Other Versions
<span title="2021-02-16">2021</span>
<span class="release-stage">accepted</span>
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1905.03277v2">arXiv:1905.03277v2</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/3kowlgu2ynhhxm7cs3bzs6pcx4">fatcat:3kowlgu2ynhhxm7cs3bzs6pcx4</a> </span>
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1905.03277v2">arXiv:1905.03277v2</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/3kowlgu2ynhhxm7cs3bzs6pcx4">fatcat:3kowlgu2ynhhxm7cs3bzs6pcx4</a> </span>
Compared to DSLR cameras, smartphone cameras have smaller sensors, which limits their spatial resolution; smaller apertures, which limits their light gathering ability; and smaller pixels, which reduces their signal-to noise ratio. The use of color filter arrays (CFAs) requires demosaicing, which further degrades resolution. In this paper, we supplant the use of traditional demosaicing in single-frame and burst photography pipelines with a multiframe super-resolution algorithm that creates a
<span class="external-identifiers">
<a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/3306346.3323024">doi:10.1145/3306346.3323024</a>
<a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1905.03277v1">arXiv:1905.03277v1</a>
<a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/4r6hyu3nbjex7oqpytcd6i3fea">fatcat:4r6hyu3nbjex7oqpytcd6i3fea</a>
</span>
more »
... plete RGB image directly from a burst of CFA raw images. We harness natural hand tremor, typical in handheld photography, to acquire a burst of raw frames with small offsets. These frames are then aligned and merged to form a single image with red, green, and blue values at every pixel site. This approach, which includes no explicit demosaicing step, serves to both increase image resolution and boost signal to noise ratio. Our algorithm is robust to challenging scene conditions: local motion, occlusion, or scene changes. It runs at 100 milliseconds per 12-megapixel RAW input burst frame on mass-produced mobile phones. Specifically, the algorithm is the basis of the Super-Res Zoom feature, as well as the default merge method in Night Sight mode (whether zooming or not) on Google's flagship phone.
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200930130222/https://arxiv.org/pdf/1905.03277v1.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext">
<button class="ui simple right pointing dropdown compact black labeled icon button serp-button">
<i class="icon ia-icon"></i>
Web Archive
[PDF]
<div class="menu fulltext-thumbnail">
<img src="https://blobs.fatcat.wiki/thumbnail/pdf/60/bd/60bd14f75cc23e0afae681da3ec0d36cb717e3da.180px.jpg" alt="fulltext thumbnail" loading="lazy">
</div>
</button>
</a>
<a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/3306346.3323024">
<button class="ui left aligned compact blue labeled icon button serp-button">
<i class="unlock alternate icon" style="background-color: #fb971f;"></i>
acm.org
</button>
</a>
<a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1905.03277v1" title="arxiv.org access">
<button class="ui compact blue labeled icon button serp-button">
<i class="file alternate outline icon"></i>
arxiv.org
</button>
</a>