repeated output of LLM

[GallonDeng]

with the gradio demo (caption all mode), I tested some images and found that the answer of LLM would be repeated, such as:

"<ground>keyboard</ground><objects><obj0></objects>
<ground>chair</ground><objects><obj1></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>
<ground>keyboard</ground><objects><obj0></objects>"

"keyboard"

[Mountchicken]

Hi @GallonDeng
That looks a bit strange. Could you check the terminal output to see if the model has correctly loaded the weights?

[GallonDeng]

Hi @GallonDeng That looks a bit strange. Could you check the terminal output to see if the model has correctly loaded the weights?

I tried other functions, only "caption all regions" would output repeated results.