大模型训练的一些问题

ONLY NOTE

输出重复输入

表现

大模型输出重复输入的内容，比如输入为：

You are now an experienced lawyer. Give some advice on this case: …

输出为：

You are now an experienced lawyer. Give some advice on this case: … You are now an experienced lawyer. Give some advice on this case: …

解决

修改输入的prompt，使之成为：

You are now an experienced lawyer. Give some advice on this case: …

Sure, here is the advice: