hiw3c 日报精选
arXiv cs.AI/CL/LG 网页快照

深度Pro 2:清晰且时间一致性良好的度量单目深度

原文标题 · Depth Pro 2: Sharp and Temporally Consistent Metric Monocular Depth

作者: Peiyun Hu, Marko Mihajlovic, Lyndon Duong | 我们介绍Depth Pro 2,一种用于在全分辨率下估计图像和视频的密集度量深度的方法。通过分析单目深度估计的现有方法,我们发现它们通常在时间一致性与边界清晰度之间进行权衡:多帧方法更注重一致性,单帧方法更注重清晰度。为克服这种权衡,我们训练了一个单一、可扩展网络,该网络

来源:arXiv cs.AI/CL/LG · arxiv.org

正文为英文,可一键机器翻译(仅首次需要等待)

Computer Science > Computer Vision and Pattern Recognition

Title: Depth Pro 2: Sharp and Temporally Consistent Metric Monocular Depth

Abstract: We present Depth Pro 2, an approach to estimating dense metric depth for images and video at full resolution. By analyzing prior methods for monocular depth estimation, we find that they commonly trade off temporal consistency and boundary sharpness: multi-frame methods favor consistency, single-frame methods favor sharpness. To overcome this trade-off, we train a single, scalable network that processes both images and video and predicts depth maps at native resolution. Depth Pro 2 produces depth maps that are metrically accurate, sharp, and temporally consistent all at once, outperforming prior work in all of these dimensions. We release a family of models that define a new Pareto frontier in terms of metric accuracy, sharpness, temporal consistency, and runtime. We release code and weights at this https URL

Submission history

Access Paper:

Additional Features

Current browse context:

References & Citations

BibTeX formatted citation

Bookmark

Bibliographic and Citation Tools

Code, Data and Media Associated with this Article

Demos

Recommenders and Search Tools

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .