[Antara]: Bot Non-Responsive Post-KB Update

[shijithkjayan]

Summary

Related to #29

Discord Thread

https://discord.com/channels/717975833226248303/1478001278352232589

[shijithkjayan]

The assistant is only intermittently failing. Involved Kaapi team to look in to the issue.

[shijithkjayan]

Kaapi team suggested running evals, @KrishnaDwibhashi2 will inform Antara team