Applying Swin UNETR to a new segmentation task about research-contributions HOT 2 CLOSED

Hi I am not expert and just a random user of this -- but I was attempting something similar, so maybe this helps.

The script is adapted specifically to the BTCV dataset so it is different from nnUNet.

I can recommend you check out the BTCV tutorial.

Here it is clear, that the train_trainforms and val_transforms are adapted to the BTCV dataset.

That means you have to adapt these for your dataset specifically.

For example, I have 3d dataset with 2 channels. I changed my nifti files to have the following dimentions, (output of fslinfo):

dim1 2
dim2 512
dim3 512
dim4 175

I now remove the line
AddChanneld(keys=["image", "label"])
from
train_transforms = Compose( ...'
Since I already have dimentions as my first channel. After these changes, I got the expected dimensions while running the scripts on my data.

For my case I also did normalization beforehand and wrote my own script to check orientations are all the correnct, so I also removed those lines from the script. Of course, what you should do depends on your data. :)

If you are in doubt what dimensions to expect, I can recommend that you download the BTCV dataset online and make a print of the tensor shapes fx under "Check data shape and visualize" in the turorial. You should then be able to deduce what the corresponding dimensions should be for your specific case.

Note that if you use the test.py script later on, this uses transforms from get_loader in data_utils.
So changes you make in your transforms during training should also be matched in the get_loader of data_utils, so you continue to load the data as expected.

from research-contributions.

Hi @davidkvcs , thanks for the question and interest of the work. The problem should be related to the patch size. The original configuration used 96x96x96 as the sub-volume for all experiments. The SwinUNETR model contains several downsampling operation. Not sure this is the best solution, but using 64 for each dimension is the minimum requirement for Training SwinUNETR. Hope this can help you re-design your data transformations.

from research-contributions.