[Usage] Error while using finetuned model about llava HOT 3 OPEN

It seems like you fine tuned using LoRa, which means you have to use the merge_lora_weights.py script (located under scripts/ folder) before trying inference.

from llava.

@itay1542 I have ran the merge_lora_weights.py and created the merged one. but getting an error,

File "/home/skadmin/cx-research/core/Llava/llava/eval/run_llava.py", line 117, in eval_model
images_tensor = process_images(
File "/home/skadmin/cx-research/core/Llava/llava/mm_utils.py", line 171, in process_images
image = expand2square(image, tuple(int(x*255) for x in image_processor.image_mean))
AttributeError: 'NoneType' object has no attribute 'image_mean'

here is the code:
model_path = "./saved_model"
model_name = get_model_name_from_path(model_path)
tokenizer, model, image_processor, context_len = load_pretrained_model(model_path, None, model_name)

from llava.

@itay1542 I have fine tuned the model without lora, Now what should i do for the inference. Kindly guide me

from llava.