[Bug] Tensor.item() cannot be called on meta tensors

[brianysoong]

Likely due to package incompatibilities - on a new conda environment, when I tried computing histo embeddings, I get this error: RuntimeError: Tensor.item() cannot be called on meta tensors

Following this issue, OpenGVLab/InternVL#1254, I did pip install transformers<5.0.0 and the issue went away. Probably an issue with transformers>=5.0.0?

[quentinblampey]

Hi @brianysoong,
Thanks for reporting. Are you using conch for the embeddings?

Yes, it's likely due to the new transformers>=5.0.0 versions, I'll try to reproduce it and fix it. Worst case scenario, I just pin transformers<5.0.0 if the issue is related to conch internals.

[brianysoong]

Yep, this is using conch!

[quentinblampey]

I was able to reproduce the issue @brianysoong, and I confirm it's related only to the Conch model loading. I opened an issue here.

Best-case scenario, it gets solved quickly and I do nothing. Otherwise, I'll pin transformers<5.0.0 in the conch-extra of novae