Add unit tests about fms-hf-tuning HOT 5 CLOSED

Corresponding issue in internal repo: https://github.ibm.com/ai-foundation/watson-fm-stack-tracker/issues/555

from fms-hf-tuning.

sample tests can begin with functions defined here https://github.com/foundation-model-stack/fms-hf-tuning/blob/main/tuning/utils/data_type_utils.py

the str_to_torch_dtype -> takes a string for data type like "float32" or "bfloat16" , and it converts it to torch dtype. Return value will be torch.float32 , torch.bfloat16 etc.

Unit tests just t=have to pass a string like "float32" and ensure that an object of torch.dtype is returned

from fms-hf-tuning.

@Ssukriti I will take a look. Please assign to me. thanks.

from fms-hf-tuning.

thanks @tedhtchang , you can refer to https://github.com/caikit/caikit-nlp as an example on how tests are organized. we also need to create a tests folder or some organization on where to keep tests in this repository

from fms-hf-tuning.

@Ssukriti This is an output of the sample unit test. https://github.com/tedhtchang/fms-hf-tuning/actions/runs/8068469672/job/22041318467?pr=2

from fms-hf-tuning.