Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

耦合头效果怎么样 #57

Open
huangjun12 opened this issue Jan 3, 2023 · 6 comments
Open

耦合头效果怎么样 #57

huangjun12 opened this issue Jan 3, 2023 · 6 comments

Comments

@huangjun12
Copy link

请问下 LD蒸馏有在耦合头上实验过效果吗？如TAL
@HikariTJU
Copy link
Owner

没做过

@Python-Eric
Copy link

@huangjun12 请问您有进行相应的实验么？能够分享一下实验结果么

@huangjun12
Copy link
Author

这边在PPYOLOE+实验过，mainKD有效，mainLD没有调出效果

@Python-Eric
Copy link

@huangjun12 你当时是如何设置相关参数的，可否交流一下？我的结果是和你相反，LD有效，KD无效...

@huangjun12
Copy link
Author

@Python-Eric 你的weight和T怎么设置的呢

@Python-Eric
Copy link

@Python-Eric 你的weight和T怎么设置的呢

修改了蒸馏损失函数里的avg_factor，权重和温度是做了挺多实验，KD没有调出效果，具体的话，可方便加个qq吗，沟通一下(413957870)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@huangjun12 @HikariTJU @Python-Eric