We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
版本及硬件按照指示安装
@1049451037
怀疑是 fp16 训练的模型,merge 过程中存在bug,能不能帮忙定位一下问题
The text was updated successfully, but these errors were encountered:
异常报错截图 fp16 bf16都可以随时相互转换吧,应该不是数据类型的问题
Sorry, something went wrong.
没有报错,是推理结果不对,没merge结果是对的,但是merge完推理的结果都是[][][][][][]...
training_main(args, model_cls=model, forward_step_function=forward_step, create_dataset_function=partial(create_dataset_function, image_processor, text_processor), handle_metrics_function=handle_metrics_function, collate_fn=data_collator, forward_step_eval=forward_step_eval) if args.use_lora: model.get_mixin("lora").merge_lora() model.get_mixin("eva").vit_model.get_mixin("lora").merge_lora() args.use_lora = False training_main(args, model_cls=model, forward_step_function=forward_step, create_dataset_function=partial(create_dataset_function, image_processor, text_processor), handle_metrics_function=handle_metrics_function, collate_fn=data_collator, forward_step_eval=forward_step_eval)
两个都能正常输出结果,但是上面的结果是正确的,但是下面的结果就是错的?请问一下是什么原因
Abnormal error screenshot fp16 bf16 can be converted to each other at any time, it should not be a problem of data type
Afaik, It can be a problem, due to bf16 having a higher range but lower precision.
zRzRzRzRzRzRzR
No branches or pull requests
System Info / 系統信息
版本及硬件按照指示安装
Who can help? / 谁可以帮助到您?
@1049451037
Information / 问题信息
Reproduction / 复现过程
Expected behavior / 期待表现
怀疑是 fp16 训练的模型,merge 过程中存在bug,能不能帮忙定位一下问题
The text was updated successfully, but these errors were encountered: