gustavla / autocolorize Goto Github PK

View Code? Open in Web Editor NEW

219.0 219.0 65.0 74 KB

Automatic colorizaton of grayscale images using Deep Learning

License: BSD 3-Clause "New" or "Revised" License

Python 18.28% C++ 67.29% Cuda 13.04% Protocol Buffer 1.39%

autocolorize's People

Contributors

Stargazers

Watchers

Forkers

caomw milestonesvn dcnhan arasharchor hitluobin wanjinchang benjamesbabala xxradon thomashagebols ilovecv aihgf cv-ip macsnair ramitpahwa ivasiljevic sumitneup vanova arunirc ginsongsong echoorchid dhaneshr walkoncross jdc08161063 jgabriellima cmc1023 hardik2396 monroid seominlee maserg antixrist githubcrj zgsxwsdxg 1165048017 sidsamsi praveenmunagapati inkimage xiangyuwei trinhquocnguyen samuel2015 cwei95 zjgirl sunguwei ystallonne lukeandshuo opentld thanhtd91 jaypatel52970 fengzhang2011 xxthink studian lulu1315 pandinosaurus archive-git-repo rolan2006 siriusdemon mttsky martinthoma pcapelo vamuvetv biggiti davidwu-git qingkongwanli123 wenlong66 phuocnx

autocolorize's Issues

RuntimeError or AttributeError

Actually, I managed to install Caffe and autocolorize and then, I try to get it working with an image.
I use GitBash, Windows 10, conda.

When I run in GitBash autocolorize grayscale.png -o colorized.png I get the following error:

File "C:/Users/xxx/anaconda3/envs/caffe/Scripts/autocolorize", line 11, in <module>
    main()
  File "C:\Users\xxx\anaconda3\envs\caffe\lib\site-packages\autocolorize\__main__.py", line 57, in main
    weights=args.weights)
  File "C:\Users\xxx\anaconda3\envs\caffe\lib\site-packages\autocolorize\extraction.py", line 66, in load_default_classifier
    classifier = load_classifier(f.name, weights=weights_fn)
  File "C:\Users\xxx\anaconda3\envs\caffe\lib\site-packages\autocolorize\extraction.py", line 44, in load_classifier
    classifier = caffe.Classifier(bare_fn, fn)
  File "C:\Users\xxx\anaconda3\envs\caffe\lib\site-packages\caffe\classifier.py", line 26, in __init__
    caffe.Net.__init__(self, model_file, caffe.TEST, weights=pretrained_file)
RuntimeError: Could not open file C:\Users\xxx\AppData\Local\Temp\tmp1ndjgn6lprototxt
(caffe)

When I run via a Python script, then I get this error:

Loading C:\Users\xxx/.autocolorize\autocolorize.caffemodel.h5
Traceback (most recent call last):
  File "colorize.py", line 3, in <module>
    classifier = autocolorize.load_default_classifier()
  File "C:\Users\xxx\anaconda3\lib\site-packages\autocolorize\extraction.py",
line 66, in load_default_classifier
    classifier = load_classifier(f.name, weights=weights_fn)
  File "C:\Users\xxx\anaconda3\lib\site-packages\autocolorize\extraction.py",
line 44, in load_classifier
    classifier = caffe.Classifier(bare_fn, fn)
AttributeError: module 'caffe' has no attribute 'Classifier'

Could you help in here?

Training - ExtendedImageDataLayer has no member named ‘iter’

Hi Gustav,

Trying to train the network from scratch using your extended data layer (I did not find any quick way to avoid using that layer):

I am stuck at an error in when doing make all in the caffe directory.
It seems that the ExtendedImageDataLayer class is missing a lot of member attributes.
Could you please help?

CXX src/caffe/layers/extended_image_data_layer.cpp
src/caffe/layers/extended_image_data_layer.cpp: In instantiation of ‘void caffe::ExtendedImageDataLayer<Dtype>::DataLayerSetUp(const std::vector<caffe::Blob<Dtype>*>&, const std::vector<caffe::Blob<Dtype>*>&) [with Dtype = float]’:
src/caffe/layers/extended_image_data_layer.cpp:703:1:   required from here
src/caffe/layers/extended_image_data_layer.cpp:574:21: error: ‘class caffe::ExtendedImageDataLayer<float>’ has no member named ‘PREFETCH_COUNT’
   for (int i = 0; i < this->PREFETCH_COUNT; ++i) {
                     ^
src/caffe/layers/extended_image_data_layer.cpp:575:5: error: ‘__gnu_cxx::__alloc_traits<std::allocator<boost::shared_ptr<caffe::Batch<float> > > >::value_type’ has no member named ‘data_’
     this->prefetch_[i].data_.Reshape(top_shape);

caffe compilation failed

Hi,
I am trying to compile caffe by including your layers, however i get following error message
src/caffe/layers/extended_image_data_layer.cpp:39:21: fatal error: maskApi.h: No such file or directory

pre-trained model

Hello, excuse me, can you provide a pre-trained model, the previous connection can no longer be opened

Missing demo files

Killed

I use only cpu to run, but the output is 'killed'

Training model on custom dataset

Can you provide code or network to train model on custom dataset ?

Training - missing bgr_to_hsv_layer.hpp

Hi,

I had no problems compiling caffe with GPU support and running your pip package to colorize some images, by the way congratulations for your work, deep learning colorization is really awesome!

On the training code, apparently "bgr_to_hsv_layer.hpp" include is missing.
Also I had to uncomment SoftmaxKLDLossParameter and SparseHistogramExtractorParameter on LayerParameter in order to try to recompile caffe.

Best regards

Fails with caffe-cpu

I've installed caffe-cpu and get:

F1229 12:32:06.315968 6270 split_layer.cpp:53] Cannot use GPU in CPU-only Caffe: check mode.

While writing this and trying to fix it, I found issue #1 - maybe it should be added in the README?

difference in autocolorize.prototxt and train_vgg16.prototxt

Hi,
I have view the structure of autocolorize.prototxt and train_vgg16.prototxt in netscope,I think the train_vgg16.prototxt is for training and the autocolorize.prototxt is for inference,but I found that except the layers in VGG, there are many layers in autocolorize.prototxt but not in train_vgg16.prototxt ,for example, _reshaped,_full_reshaped,*_full,prediction_h,prediction_c, many of these layers have params to learn when there type is conv or deconv,but there are no these layers in the training protxt,so How can you get these params when you inference? Could you please help ,me,Thank you!

Command for running

I was able to install the program the standard way, however the command cannot execute (unknown command). Probably a certain environment variable is not set, but I couldn't find out which one it is.
What file does the command "autocolorize" relate to?
In my Anaconda directory, I have two autocolorize folders under lib\site-packages.
There are many execututable python files, but all with different names.
E.g., when I execute main.pyc, it says "ValueError: Attemted relative import in non-package"
I know I am very close, but I don't know how to solve it. Any help would be appreciated!

Pip package broken: missing caffee

I installed version '0.2.1-00' using pip. This package depends on python python-numpy python-scikit-image python-requests python-scipy packages.
But when I was trying to colorize one image, I got such an error

Traceback (most recent call last):
  File "/usr/bin/autocolorize", line 8, in <module>
    from autocolorize.__main__ import main
  File "/usr/lib/python3.9/site-packages/autocolorize/__init__.py", line 7, in <module>
    from .checker import checker_main
  File "/usr/lib/python3.9/site-packages/autocolorize/checker.py", line 5, in <module>
    import caffe
ModuleNotFoundError: No module named 'caffe'

installing dependencies

I have ubuntu 16.04.
Seems the dependencies are quite hard to install.
(protobuf, ... cv 3.0.0) either wrong headers/too new compiler... etc.
any better tutorial on that?
How to install all from the source and in which order?

Where is the caffe.proto file ?

Hello,

In the README, I'm trying to find the proto folder containing this file but it's not there?

Thanks!

Same problem as #8 when running autocolorize

Hello,
I have the same problem as #8.
I try to run: autocolorize grayscale.png -o colorized.png
I already run: rm ~/.autocolorize/autocolorize.caffemodel.h5 as told in #8
But the autocolorize still aborts.
In #8 it shows: 7 7 (102760448).
My results shows:
F0906 12:04:59.769284 24443 hdf5.cpp:79] Check failed: blob_dims == blob->shape() Cannot load blob from hdf5; shape mismatch. Source shape is 1024 12417 (12715008) target shape is 1024 12417 1 1 (12715008)
Does anyone know what is going on?
Thanks.

Error running for a single image

Hello,

I installed caffe and autocolarize, but when I try to run for a png image(512x512) I get the following error.

F0417 13:52:09.999788 2561 hdf5.cpp:79] Check failed: blob_dims == blob->shape() Cannot load blob from hdf5; shape mismatch. Source shape is 4096 25088 (102760448) target shape is 4096 512 7 7 (102760448)

This causes the code to abort. Does anyone know how to solve this issue?

cpu only mode

I installed caffe in cpu-only mode on my laptop, which is sufficient for my use cases and also much easier to install. autocolorize by standard only works in gpu mode, it would be great if that would be parametrized! (Thanks to the source code I got it running in cpu-only mode (great!), I just uncommented the set parameter section).

calc_rgb param argument splitting

https://github.com/gustavla/autocolorize/blob/master/autocolorize/__main__.py#L130

This won't work when the desired h_method is expectation-cf since the delimiting character is in one of the components.

Install failed "python setup.py egg_info"

Maybe because "python" is called ?
Caffe works while be called via pyhton3.

----------------------------------------

Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-aUZ6SF/networkx/

The output is whole dark image

I cannot get correct result from the python code, but when I use the command like
' autocolorize grayscale.png -o colorized.png' I get the correct results

My code is following:

import cv2
import os
import autocolorize

path2 = 'input/'
path3 = 'output/'
files= os.listdir(path2)

classifier = autocolorize.load_default_classifier()

for ff in files:
gray_image = cv2.imread(path2+ff)
rgb_image = autocolorize.colorize(gray_image, classifier=classifier)
cv2.imwrite(path3+rgb_image,rgb_image)

Unable to train from scratch

Hi,

Firstly, I want to congratulate you for this brilliant piece of work. I have tried your autocolorize and it works great ! Many thanks for making it publicly available.

I am trying to work on NIR images. Idea is to convert this single channel image to a color image. Since the nature of image is different from a normal grayscale image, I have to train the system from scratch / fine-tune your model. I followed your simple training instructions and I guess I am successful in copying the required files and setting up the training environment. I have setup the training without 'extended data layer'.

My input is LMDB (converted .jpg files to LMDB using create_imagenet.sh) and it contains 3 channel 640x480. When I run the training in CPU-only mode, I get the following error:

I0905 16:48:48.431213 14444 net.cpp:434] sr_x_minus_one <- sr_minus_one
I0905 16:48:48.431243 14444 net.cpp:408] sr_x_minus_one -> sr_x_minus_one
F0905 16:48:48.431275 14444 eltwise_layer.cpp:34] Check failed: bottom[i]->shape() == bottom[0]->shape()

I apologize if this is a trivial issue. I am not much experienced in CAFFE, thus, I request you to kindly help me to figure out the possible issue and get the training running.

Thank you in advance,
Kimi