Skip to content

RuntimeError: CUDA error: CUBLAS_STATUS_INVALID_VALUE #17

@maxm224

Description

@maxm224

What

I am trying to get this to run on a NVIDIA T4. However I always get an error. When I run it on a cpu it works great. Just a bit too slow for larger files.

The error:

lh2dg 2022-11-13T10:55:35.504Z layer_outputs = layer( l
h2dg 2022-11-13T10:55:35.504Z encoder_outputs = self.encoder( 
lh2dg 2022-11-13T10:55:35.504Z File "/opt/conda/lib/python3.9/site-packages/transformers/models/wav2vec2/modeling_wav2vec2.py", line 872, in forward
lh2dg 2022-11-13T10:55:35.504Z return forward_call(*input, **kwargs) 
lh2dg 2022-11-13T10:55:35.504Z return forward_call(*input, **kwargs) lh2dg 2022-11-13T10:55:35.505Z attn_weights = torch.bmm(query_states, key_states.transpose(1, 2)) 
lh2dg 2022-11-13T10:55:35.505Z **RuntimeError: CUDA error: CUBLAS_STATUS_INVALID_VALUE when calling `cublasSgemmStridedBatched( handle, opa, opb, m, n, k, &alpha, a, lda, stridea, b, ldb, strideb, &beta, c, ldc, stridec, num_batches)`**

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions