fix(trt): explicit TRT context/engine teardown + VRAM pre-check to prevent CUDA OOM on reload#2
Open
livepeer-tessa wants to merge 1 commit intomainfrom
Open
fix(trt): explicit TRT context/engine teardown + VRAM pre-check to prevent CUDA OOM on reload#2livepeer-tessa wants to merge 1 commit intomainfrom
livepeer-tessa wants to merge 1 commit intomainfrom
