| # Bidirectional Translation | |
| Pytorch implementation for multimodal comic-to-manga translation. | |
| **Note**: The current software works well with PyTorch 1.6.0+. | |
| ## Prerequisites | |
| - Linux | |
| - Python 3 | |
| - CPU or NVIDIA GPU + CUDA CuDNN | |
| ## Getting Started ### | |
| ### Installation | |
| - Clone this repo: | |
| ```bash | |
| git clone https://github.com/msxie/ScreenStyle.git | |
| cd ScreenStyle/MangaScreening | |
| ``` | |
| - Install PyTorch and dependencies from http://pytorch.org | |
| - Install python libraries [tensorboardX](https://github.com/lanpa/tensorboardX) | |
| - Install other libraries | |
| For pip users: | |
| ``` | |
| pip install -r requirements.txt | |
| ``` | |
| ## Data praperation | |
| The training requires paired data (including manga image, western image and their line drawings). | |
| The line drawing can be extracted using [MangaLineExtraction](https://github.com/ljsabc/MangaLineExtraction). | |
| ``` | |
| ${DATASET} | |
| |-- color2manga | |
| | |-- val | |
| | | |-- ${FOLDER} | |
| | | | |-- imgs | |
| | | | | |-- 0001.png | |
| | | | | |-- ... | |
| | | | |-- line | |
| | | | | |-- 0001.png | |
| | | | | |-- ... | |
| ``` | |
| ### Use a Pre-trained Model | |
| - Download the pre-trained [ScreenVAE](https://drive.google.com/file/d/1OBxWHjijMwi9gfTOfDiFiHRZA_CXNSWr/view?usp=sharing) model and place under `checkpoints/ScreenVAE/` folder. | |
| - Download the pre-trained [color2manga](https://drive.google.com/file/d/18-N1W0t3igWLJWFyplNZ5Fa2YHWASCZY/view?usp=sharing) model and place under `checkpoints/color2manga/` folder. | |
| - Generate results with the model | |
| ```bash | |
| bash ./scripts/test_western2manga.sh | |
| ``` | |
| ## Copyright and License | |
| You are granted with the [LICENSE](LICENSE) for both academic and commercial usages. | |
| ## Citation | |
| If you find the code helpful in your resarch or work, please cite the following papers. | |
| ``` | |
| @article{xie-2020-manga, | |
| author = {Minshan Xie and Chengze Li and Xueting Liu and Tien-Tsin Wong}, | |
| title = {Manga Filling Style Conversion with Screentone Variational Autoencoder}, | |
| journal = {ACM Transactions on Graphics (SIGGRAPH Asia 2020 issue)}, | |
| month = {December}, | |
| year = {2020}, | |
| volume = {39}, | |
| number = {6}, | |
| pages = {226:1--226:15} | |
| } | |
| ``` | |
| ### Acknowledgements | |
| This code borrows heavily from the [pytorch-CycleGAN-and-pix2pix](https://github.com/junyanz/pytorch-CycleGAN-and-pix2pix) repository. | |