Is your feature request related to a problem?
Sporadically, the LLM-as-a-judge score does not sync for some evaluations in Kaapi Konsole, despite being available in Langfuse. This issue persists even after attempting to resync the score.
Describe the solution you'd like
- Investigate the syncing issue between LLM-as-a-judge in Kaapi Konsole
- Ensure that resyncing reliably updates the scores in all cases.
- Provide error logging or feedback when syncing fails
Screenshot
This has happened for Antara while running recent evaluations
Langfuse Project: kaapi-antara
Kaapi Konsole Project: Kaapi-antara
Is your feature request related to a problem?
Sporadically, the LLM-as-a-judge score does not sync for some evaluations in Kaapi Konsole, despite being available in Langfuse. This issue persists even after attempting to resync the score.
Describe the solution you'd like
Screenshot
This has happened for Antara while running recent evaluations
Langfuse Project: kaapi-antara
Kaapi Konsole Project: Kaapi-antara