no attribute 'enable_input_require_grads' about chatglm-tuning HOT 10 CLOSED

Have you figure out this problem? I've faced the same question as you.

I update transformers to 4.27.1, then the problom is solved.
refer to: https://github.com/huggingface/transformers/blob/main/src/transformers/modeling_utils.py#L1150

from chatglm-tuning.

This class should be modified:

class ChatGLMPreTrainedModel(PreTrainedModel):
    """
    An abstract class to handle weights initialization and
    a simple interface for downloading and loading pretrained models.
    """

    is_parallelizable = False
    supports_gradient_checkpointing = True  # change to True
    config_class = ChatGLMConfig
    base_model_prefix = "transformer"
    _no_split_modules = ["GLM6BBlock"]

    def __init__(self, *inputs, **kwargs):
        super().__init__(*inputs, **kwargs)

    def _init_weights(self, module: nn.Module):
        """Initialize the weights."""
        return
    
    # add this
    def _set_gradient_checkpointing(self, module, value=False):
        if isinstance(module, ChatGLMForConditionalGeneration):
            module.gradient_checkpointing = value

another refer:
https://colab.research.google.com/drive/1jCkpikz0J2o20FBQmYmAGdiKmJGOMo-o?usp=sharing#scrollTo=cg3fiQOvmI3Q

from chatglm-tuning.

It seems that there may be a problem with the API version. Can you copy the version in it？

from chatglm-tuning.

I have used version 4.26.1 of transforms, which is consistent with the requirement specified in the requirement.txt file. However, I still encountered an issue. I tried upgrading to version 4.27.1, but the problem persisted.

from chatglm-tuning.

老哥能给个requirements文件吗，好多包冲突

from chatglm-tuning.

老哥能给个requirements文件吗，好多包冲突

环境问题我晚点用colab测试下，晚点更新出来

from chatglm-tuning.

老哥能给个requirements文件吗，好多包冲突

@Chenzongchao 已更新，可以参考
https://github.com/mymusise/ChatGLM-Tuning/blob/master/requirements.txt

from chatglm-tuning.

Have you figure out this problem? I've faced the same question as you.

from chatglm-tuning.

Close it, reopen it if needed~

from chatglm-tuning.

This class should be modified:

class ChatGLMPreTrainedModel(PreTrainedModel):
    """
    An abstract class to handle weights initialization and
    a simple interface for downloading and loading pretrained models.
    """

    is_parallelizable = False
    supports_gradient_checkpointing = True  # change to True
    config_class = ChatGLMConfig
    base_model_prefix = "transformer"
    _no_split_modules = ["GLM6BBlock"]

    def __init__(self, *inputs, **kwargs):
        super().__init__(*inputs, **kwargs)

    def _init_weights(self, module: nn.Module):
        """Initialize the weights."""
        return
    
    # add this
    def _set_gradient_checkpointing(self, module, value=False):
        if isinstance(module, ChatGLMForConditionalGeneration):
            module.gradient_checkpointing = value

another refer: https://colab.research.google.com/drive/1jCkpikz0J2o20FBQmYmAGdiKmJGOMo-o?usp=sharing#scrollTo=cg3fiQOvmI3Q

Could you share the name of this file? I don't know where to modify it. Thank you~

from chatglm-tuning.