|
--- |
|
tags: |
|
- pytorch_model_hub_mixin |
|
- model_hub_mixin |
|
- image-to-3d |
|
library_name: dust3r |
|
repo_url: https://github.com/naver/dust3r |
|
--- |
|
|
|
## DUSt3R: Geometric 3D Vision Made Easy |
|
|
|
```bibtex |
|
@inproceedings{dust3r_cvpr24, |
|
title={DUSt3R: Geometric 3D Vision Made Easy}, |
|
author={Shuzhe Wang and Vincent Leroy and Yohann Cabon and Boris Chidlovskii and Jerome Revaud}, |
|
booktitle = {CVPR}, |
|
year = {2024} |
|
} |
|
|
|
@misc{dust3r_arxiv23, |
|
title={DUSt3R: Geometric 3D Vision Made Easy}, |
|
author={Shuzhe Wang and Vincent Leroy and Yohann Cabon and Boris Chidlovskii and Jerome Revaud}, |
|
year={2023}, |
|
eprint={2312.14132}, |
|
archivePrefix={arXiv}, |
|
primaryClass={cs.CV}, |
|
url={https://arxiv.org/abs/2312.14132}, |
|
} |
|
``` |
|
|
|
# License |
|
The code is distributed under the CC BY-NC-SA 4.0 License. See [LICENSE](https://github.com/naver/dust3r/blob/main/LICENSE) for more information. |
|
For the checkpoints, make sure to agree to the license of all the public training datasets and base checkpoints we used, in addition to CC-BY-NC-SA 4.0. See [section: Our Hyperparameters](https://github.com/naver/dust3r?tab=readme-ov-file#our-hyperparameters) for details. |
|
|
|
# Model info |
|
|
|
Gihub page: https://github.com/naver/dust3r/ |
|
Project page: https://dust3r.europe.naverlabs.com/ |
|
|
|
| Modelname | Training resolutions | Head | Encoder | Decoder | |
|
|-------------|----------------------|------|---------|---------| |
|
| DUSt3R_ViTLarge_BaseDecoder_512_dpt | 512x384, 512x336, 512x288, 512x256, 512x160 | DPT | ViT-L | ViT-B | |
|
|
|
# How to use |
|
|
|
First, [install dust3r](https://github.com/naver/dust3r?tab=readme-ov-file#installation). |
|
To load the model: |
|
|
|
```python |
|
from dust3r.model import AsymmetricCroCo3DStereo |
|
import torch |
|
|
|
model = AsymmetricCroCo3DStereo.from_pretrained("naver/DUSt3R_ViTLarge_BaseDecoder_512_dpt") |
|
|
|
device = torch.device("cuda" if torch.cuda.is_available() else "cpu") |
|
model.to(device) |
|
``` |