New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

sft训练需要合并权重吗？ #585

Open

258863 opened this issue Jun 28, 2024 · 1 comment

Assignees

258863 commented Jun 28, 2024

No description provided.

paddle-bot bot assigned lyuwenyu

Collaborator

jerrywgz commented Jul 22, 2024

是不需要的，例如llava sft训练vision encoder部分参数不更新，训练时不会保存vision encoder部分，而推理阶段会自动加载这部分参数

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment