inference results are not always correct

[azkadev]

hi i tried your program, but the result sometimes is not right / only certain sentences get good result, is this because of computer specs?

btw my computer

{
    "OS": "Ubuntu 20.04.6 LTS x86_64",
    "Host": "Virtual Machine 7.0",
    "Kernel": "6.5.0-1025-azure",
    "Uptime": "2 hours, 22 mins",
    "Packages": "657 (dpkg)",
    "Shell": "bash 5.0.17",
    "Resolution": "1024x768",
    "Terminal": "vscode",
    "CPU": "AMD EPYC 7763 (4) @ 3.244GHz",
    "Memory": "2209MiB / 15981MiB",
    "Version": "7.0.0"
}

i run command

./build/examples/main/main -m ./ggml_weights.bin -p "Hello World PABANNIER"

and result

output.mp4

And

i run command

./build/examples/main/main -m ./ggml_weights.bin -p "Hello World AZKADEV"

and result

output.mp4

[PABannier]

Hi @azkadev ! Thanks for reporting the issue! I can reproduce it on my computer! Looking more closely at it, I think there is a problem in the vocoder (Encodec.cpp), I'm investigating the issue and will let you know when it's fixed!