This repo is based on the work of Jason Antic, the creator of DeOldify. I have used his code base, to bring you this repository that allows you to colorise anime/manga sketches.
Quick Start: The easiest way to colorize images using This model trained via DeOldify (for free!) is via one of the colabs below!
Sketches to Shading (tempremental)
The easiest way to learn how to use the Colabs, are the same those used in the DeOldify repository, which has kinldy been provided by in video tutorial form by Old Ireland in Colour's John Breslin. Click video image below to watch.
Get more updates here Twitter .
The goal for project this was to recolorise manga into color. Its been one of the main things I have wanted to do with deep learning and after experimenting with DeOldify, I wanted to try it with the danbooru2019 dataset.
Here are some pictures from this model.
This repository contains four models, All trained using the same code but different datasets. They are all based on the artistic training code that is provided by DeOldify [DeOldify]. They are the Image coloriser,Grayscale2Color, Sketch2Color, and Sketch2Gray.
As described in the DeOldify repo. The Artistic model acheives the highest quality in image coloriosation, in terms of interesting details and vibrance, which is needed for any dataset based on art especially Danbooru. However, the model can be particular on getting the best results, which can be adjusted using the render setting. The best setting is currently 12, but a higher render_factor is needed for rendering manga.
The easiest way to get started is using the google colabs, avaialble here.
This should be an easy install if you have conda installed.
git clone https://github.com/Dakini/AnimeColorDeOldify
cd AnimeColorDeOldify
pip install -r requirements.txt
jupyter notebook
My training code, is not avaiable, as its a bit of a mess at the moment, with various hacks in place. However, I used the same training code from the Artistic jupyter notebook avaiable on the DeOldify repository
I used the danbooru dataset, which you can find more information here. The dataset is a total of ~3 TB, with over 3 millions images.
To start right away on your own machine with your own images or videos without training the models yourself, you'll need to download the pretrained models.They can be found here
The colorization inference notebooks should be able to guide you from here.
All code in this repository is under the MIT license as specified by the LICENSE file.
The model weights listed in this readme under the "Pretrained Weights" section are trained by ourselves and are released under the MIT license.