RuntimeError: "svd_cuda_gesvdj" not implemented for 'BFloat16' about mergekit HOT 4 CLOSED

def decompose_delta_weight(
    new_weight: torch.Tensor,
    base_weight: torch.Tensor,
    reduced_rank: int,
    device: Optional[str] = None,
) -> Tuple[torch.Tensor, torch.Tensor]:
    if device is None:
        device = "cuda" if torch.cuda.is_available() else "cpu"

    new_weight = new_weight.half().to(device)
    base_weight = base_weight.half().to(device)

  File "/home/ehartford/mergekit/mergekit/scripts/extract_lora.py", line 36, in _low_rank_decomposition
    U, S, Vh = torch.linalg.svd(weight, full_matrices=False)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: "svd_cuda_gesvdj" not implemented for 'Half'