Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于对话模板作用以及其在lm-evaluation-harness仓库下对评测效果影响的问题 #4618

Closed
1 task done
marvelcell opened this issue Jun 29, 2024 · 0 comments
Closed
1 task done

关于对话模板作用以及其在lm-evaluation-harness仓库下对评测效果影响的问题 #4618

marvelcell opened this issue Jun 29, 2024 · 0 comments
Labels
wontfix This will not be worked on

Comments

@marvelcell
Copy link

Reminder

  • I have read the README and searched the existing issues.

System Info

None

Reproduction

None

Expected behavior

您好，想请问llama3和default模板在训练和推理过程中的机制是什么呢？

我在LLama-Factory中使用llama3 template微调llama3-8b-instruct，之后使用训练好的模型在lm-evaluation-harness仓库中评测，在评测过程中是没有指定template的这一步骤的，那么训练过程中使用的template是否会对评测效果产生影响呢？

提前感谢您的解答！

Others

No response
@github-actions github-actions bot added the pending This problem is yet to be addressed label Jun 29, 2024
@hiyouga hiyouga added wontfix This will not be worked on and removed pending This problem is yet to be addressed labels Jul 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
wontfix This will not be worked on
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hiyouga @marvelcell