What is the moved_image used for? Can you explain the function of state.step() a bit more? about pixelrl HOT 3 OPEN

a = action.astype(np.uint8)
a = np.transpose(a, (1,2,0))
cv2.imwrite(SAVE_PATH+str(i)+'_'+str(t)+'_action.png', a)

In the saved action maps, each pixel value has the index of the chosen action.
0: pixel value -= 1
1: do nothing
2: pixel value += 1
3: Gaussian filter (sigma=0.5)
.... (see State.py for more details)
After saving the action maps, we colorized them by (a little modified version of) Pascal VOC color map.

from pixelrl.

move_range indicates the number of actions that move the pixel values. e.g., when move_range=3, there are three actions: pixel_value+=1, +=0, and -=1. When move_range=5, there are five actions: pixel_value +=2, +=1, +=0, -=1, and -=2.

act is the action map whose element indicates the index of chosen action at each pixel.
Let us consider the case when move_range=3.
act[b, y, x] = 0, 1, ... , or 8 where b denotes the b-th image in the minibatch, and y, x denote the indices of row and col, respectively.
At the pixel where act[b, y, x] == 0, the pixel value is changed 'pixel_value -= 1' (Line 14-17 in State.py ).

act[b, y, x] == 3, 4, 5, 6, ,7 and 8 correspond to each action: Gaussian filter, bilateral filter, median filter, another Gaussian filter (with different parameters), another bilateral filter (with different parameters), and box filter, respectively.
In Line 26-27, Gaussian filter is performed on the entire image if at least one act[b, y, x] == 3 exists. Similar process is performed in Line 28-37.
Finally, in Line 40, the pixel value after Gaussian filter is performed is chosen at the pixel where act[b, y, x] == 3. Similar process of the other filters is performed in Line 41-45.

from pixelrl.

Thank you for the detailed explanation. I hope to generate the action maps to reproduce the Fig.2 and 4 in your 2019 paper. Where would the best place to output them?

from pixelrl.