_ / README_DEV.md
Zafaflahfksdf's picture
Upload folder using huggingface_hub
da3eeba verified
|
raw
history blame
1.77 kB
# Usage of Inpaint Anything Library
## Introduction
The `inpalib` from the `inpaint-anything` package lets you segment images and create masks using sketches from other applications.
## Code Breakdown
### Imports and Module Initialization
```python
import importlib
import numpy as np
from PIL import Image, ImageDraw
inpalib = importlib.import_module("inpaint-anything.inpalib")
```
### Fetch Model IDs
```python
available_sam_ids = inpalib.get_available_sam_ids()
use_sam_id = "sam_hq_vit_l.pth"
# assert use_sam_id in available_sam_ids, f"Invalid SAM ID: {use_sam_id}"
```
Note: Only the models downloaded via the Inpaint Anything are available.
### Generate Segments Image
```python
input_image = np.array(Image.open("/path/to/image.png"))
sam_masks = inpalib.generate_sam_masks(input_image, use_sam_id, anime_style_chk=False)
sam_masks = inpalib.sort_masks_by_area(sam_masks)
seg_color_image = inpalib.create_seg_color_image(input_image, sam_masks)
Image.fromarray(seg_color_image).save("/path/to/seg_color_image.png")
```
<img src="images/sample_input_image.png" alt="drawing" width="256"/> <img src="images/sample_seg_color_image.png" alt="drawing" width="256"/>
### Create Mask from Sketch
```python
sketch_image = Image.fromarray(np.zeros_like(input_image))
draw = ImageDraw.Draw(sketch_image)
draw.point((input_image.shape[1] // 2, input_image.shape[0] // 2), fill=(255, 255, 255))
mask_image = inpalib.create_mask_image(np.array(sketch_image), sam_masks, ignore_black_chk=True)
Image.fromarray(mask_image).save("/path/to/mask_image.png")
```
<img src="images/sample_mask_image.png" alt="drawing" width="256"/>
Note: Ensure you adjust the file paths before executing the code.