update README
Browse files
README.md
CHANGED
|
@@ -1,10 +1,10 @@
|
|
| 1 |
-
## How to Use
|
| 2 |
|
| 3 |
-
```python
|
| 4 |
from transformers import AutoModel
|
| 5 |
|
| 6 |
model = AutoModel.from_pretrained(
|
| 7 |
-
"
|
| 8 |
cache_dir="./cache",
|
| 9 |
trust_remote_code=True,
|
| 10 |
# turn on offloading on a low GPU memory machine:
|
|
@@ -21,6 +21,7 @@ model(prompt)
|
|
| 21 |

|
| 22 |
|
| 23 |
--------------------------------------------------------------------------------
|
|
|
|
| 24 |
### [Website](https://www.nvidia.com/en-us/ai/cosmos/) | [HuggingFace](https://huggingface.co/collections/nvidia/cosmos-6751e884dc10e013a0a0d8e6) | [GPU-free Preview](https://build.nvidia.com/explore/discover) | [Paper](https://arxiv.org/abs/2501.03575) | [Paper Website](https://research.nvidia.com/labs/dir/cosmos1/)
|
| 25 |
|
| 26 |
[NVIDIA Cosmos](https://www.nvidia.com/cosmos/) is a developer-first world foundation model platform designed to help Physical AI developers build their Physical AI systems better and faster. Cosmos contains
|
|
@@ -41,17 +42,17 @@ Details of the platform is described in the [Cosmos paper](https://research.nvid
|
|
| 41 |
|
| 42 |
## Model Family
|
| 43 |
|
| 44 |
-
| Model name
|
| 45 |
-
|
| 46 |
-
| [Cosmos-1.0-Diffusion-7B-Text2World](https://huggingface.co/nvidia/Cosmos-1.0-Diffusion-7B-Text2World)
|
| 47 |
-
| [Cosmos-1.0-Diffusion-14B-Text2World](https://huggingface.co/nvidia/Cosmos-1.0-Diffusion-14B-Text2World)
|
| 48 |
-
| [Cosmos-1.0-Diffusion-7B-Video2World](https://huggingface.co/nvidia/Cosmos-1.0-Diffusion-7B-Video2World)
|
| 49 |
-
| [Cosmos-1.0-Diffusion-14B-Video2World](https://huggingface.co/nvidia/Cosmos-1.0-Diffusion-14B-Video2World)
|
| 50 |
-
| [Cosmos-1.0-Autoregressive-4B](https://huggingface.co/nvidia/Cosmos-1.0-Autoregressive-4B)
|
| 51 |
-
| [Cosmos-1.0-Autoregressive-12B](https://huggingface.co/nvidia/Cosmos-1.0-Autoregressive-12B)
|
| 52 |
-
| [Cosmos-1.0-Autoregressive-5B-Video2World](https://huggingface.co/nvidia/Cosmos-1.0-Autoregressive-5B-Video2World)
|
| 53 |
-
| [Cosmos-1.0-Autoregressive-13B-Video2World](https://huggingface.co/nvidia/Cosmos-1.0-Autoregressive-13B-Video2World) | Video + Text based future visual world generation
|
| 54 |
-
| [Cosmos-1.0-Guardrail](https://huggingface.co/nvidia/Cosmos-1.0-Guardrail)
|
| 55 |
|
| 56 |
## Example Usage
|
| 57 |
|
|
|
|
| 1 |
+
## How to Use
|
| 2 |
|
| 3 |
+
```python
|
| 4 |
from transformers import AutoModel
|
| 5 |
|
| 6 |
model = AutoModel.from_pretrained(
|
| 7 |
+
"Nvidia-CMU25/DiffusionText2WorldGeneration",
|
| 8 |
cache_dir="./cache",
|
| 9 |
trust_remote_code=True,
|
| 10 |
# turn on offloading on a low GPU memory machine:
|
|
|
|
| 21 |

|
| 22 |
|
| 23 |
--------------------------------------------------------------------------------
|
| 24 |
+
|
| 25 |
### [Website](https://www.nvidia.com/en-us/ai/cosmos/) | [HuggingFace](https://huggingface.co/collections/nvidia/cosmos-6751e884dc10e013a0a0d8e6) | [GPU-free Preview](https://build.nvidia.com/explore/discover) | [Paper](https://arxiv.org/abs/2501.03575) | [Paper Website](https://research.nvidia.com/labs/dir/cosmos1/)
|
| 26 |
|
| 27 |
[NVIDIA Cosmos](https://www.nvidia.com/cosmos/) is a developer-first world foundation model platform designed to help Physical AI developers build their Physical AI systems better and faster. Cosmos contains
|
|
|
|
| 42 |
|
| 43 |
## Model Family
|
| 44 |
|
| 45 |
+
| Model name | Description | Try it out |
|
| 46 |
+
| -------------------------------------------------------------------------------------------------------------------- | -------------------------------------------------------- | ---------------------------------------------------- |
|
| 47 |
+
| [Cosmos-1.0-Diffusion-7B-Text2World](https://huggingface.co/nvidia/Cosmos-1.0-Diffusion-7B-Text2World) | Text to visual world generation | [Inference](cosmos1/models/diffusion/README.md) |
|
| 48 |
+
| [Cosmos-1.0-Diffusion-14B-Text2World](https://huggingface.co/nvidia/Cosmos-1.0-Diffusion-14B-Text2World) | Text to visual world generation | [Inference](cosmos1/models/diffusion/README.md) |
|
| 49 |
+
| [Cosmos-1.0-Diffusion-7B-Video2World](https://huggingface.co/nvidia/Cosmos-1.0-Diffusion-7B-Video2World) | Video + Text based future visual world generation | [Inference](cosmos1/models/diffusion/README.md) |
|
| 50 |
+
| [Cosmos-1.0-Diffusion-14B-Video2World](https://huggingface.co/nvidia/Cosmos-1.0-Diffusion-14B-Video2World) | Video + Text based future visual world generation | [Inference](cosmos1/models/diffusion/README.md) |
|
| 51 |
+
| [Cosmos-1.0-Autoregressive-4B](https://huggingface.co/nvidia/Cosmos-1.0-Autoregressive-4B) | Future visual world generation | [Inference](cosmos1/models/autoregressive/README.md) |
|
| 52 |
+
| [Cosmos-1.0-Autoregressive-12B](https://huggingface.co/nvidia/Cosmos-1.0-Autoregressive-12B) | Future visual world generation | [Inference](cosmos1/models/autoregressive/README.md) |
|
| 53 |
+
| [Cosmos-1.0-Autoregressive-5B-Video2World](https://huggingface.co/nvidia/Cosmos-1.0-Autoregressive-5B-Video2World) | Video + Text based future visual world generation | [Inference](cosmos1/models/autoregressive/README.md) |
|
| 54 |
+
| [Cosmos-1.0-Autoregressive-13B-Video2World](https://huggingface.co/nvidia/Cosmos-1.0-Autoregressive-13B-Video2World) | Video + Text based future visual world generation | [Inference](cosmos1/models/autoregressive/README.md) |
|
| 55 |
+
| [Cosmos-1.0-Guardrail](https://huggingface.co/nvidia/Cosmos-1.0-Guardrail) | Guardrail contains pre-Guard and post-Guard for safe use | Embedded in model inference scripts |
|
| 56 |
|
| 57 |
## Example Usage
|
| 58 |
|