Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

训练VIT_base模型的warning. #74

Open
congjianting opened this issue Feb 27, 2023 · 0 comments
Open

训练VIT_base模型的warning. #74

congjianting opened this issue Feb 27, 2023 · 0 comments

Comments

@congjianting
Copy link

@yutaocui

崔老师, 你好,

训练vit-base的模型报了如下一个warnnning, 麻烦您有空的时候看看是什么原因导致的?

[W reducer.cpp:347] Warning: Grad strides do not match bucket view strides. This may indicate grad was not created according to the gradient layout contract, or that the param's strides changed since DDP was constructed. This is not an error, but may impair performance.
grad.sizes() = [1, 48, 1, 1], strides() = [48, 1, 48, 48]
bucket_view.sizes() = [1, 48, 1, 1], strides() = [48, 1, 1, 1] (function operator())

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant