Multiple Prompts

[abhimanyuchadha96]

How does one give multiple prompts to the model?

I see in the onnx file, the only prompt defined is 'dog' and the end model also just accepts that prompt.

But I have a finetuned model on 5 classes and I want to be able to use the TensorRT version to detect all 5 of those.

[dataplayer12]

Can you please share what exactly do you mean by fine tuned on 5 classes? Does the model output a probability map among the five classes? That seems different from the stock SAM-3 architecture. Maybe consider sharing your onnx (randomly initialized weights is fine) so I can understand your architecture better

[dataplayer12]

No activity for 2 weeks, not sure how I can help you. Please feel free to re-open if you are still interested.

[CPFelix]

@dataplayer12 I know his mean.When my prompt is not one category like :prompt = ["water", "car"], and when export onnx, the input_ids.shape is change from [1,32] to [2,32].
But if my prompt is not fixed, the first dim is fixed, how can I export the onnx?
And the first dim of input_ids can be dynamic too?

[dataplayer12]

Okay, I understand the question now. let me investigate the issue. I have a feeling that the model itself does not allow multiple prompts, but let me verify