Assert config.vision_config.model_type == 'davit', 'only DaViT is supported for now'

#44
by Truc95 - opened

Hello,

I facing an issue that I can't solve, similar to the one happening to this space: https://huggingface.co/spaces/mihirinamdar/DocVQA-Florence-2.
Checking config.json, I can see that it it there:
"vision_config": {
"model_type": "davit",

However, the error keep happening.
It might be related to PR : https://huggingface.co/microsoft/Florence-2-large/commit/f0a0996b38848cb40f47db06d4735652bbd7af4d

Does anyone is facing the same issue ?

Best regards,

I fixed this by adding this to my run script iirc
if 'vision_config' not in config_dict:
config_dict['vision_config'] = {}
config_dict['vision_config']['model_type'] = 'davit'

I fixed this by adding this to my run script iirc
if 'vision_config' not in config_dict:
config_dict['vision_config'] = {}
config_dict['vision_config']['model_type'] = 'davit'

Can u explain in some detail how to do this ? I was trying to import AutoConfig and then to do this, but its not working

@dutta18 did you ever find out?

Sign up or log in to comment