Skip to content

ci: update gemini-cli version to latest for evals CI pipeline#122

Merged
omkargaikwad23 merged 2 commits intomainfrom
fix-evalbench-ci
May 5, 2026
Merged

ci: update gemini-cli version to latest for evals CI pipeline#122
omkargaikwad23 merged 2 commits intomainfrom
fix-evalbench-ci

Conversation

@omkargaikwad23
Copy link
Copy Markdown
Contributor

@omkargaikwad23 omkargaikwad23 commented May 4, 2026

💡 Added GEMINI_CLI_TRUST_WORKSPACE: "true"

Context: Recent versions of gemini-cli introduced a workspace trust security check (similar to Git's safe.directory).

Reason for change: In automated environments like Cloud Build (/workspace) and EvalBench sandboxes (.venv/fake_home), the CLI flags the dynamic directory as untrusted. This causes evaluations to fail immediately with a 0% completion rate because it refuses to load extensions or run tool calls.

Setting GEMINI_CLI_TRUST_WORKSPACE: "true" explicitly bypasses this verification check, ensuring successful test and pipeline execution.

@omkargaikwad23 omkargaikwad23 changed the title ci: update gemini-cli version to latest ci: update gemini-cli version to latest for evals CI pipeline May 5, 2026
Comment thread evals/model_config.yaml
@omkargaikwad23 omkargaikwad23 merged commit f584dcd into main May 5, 2026
14 checks passed
@omkargaikwad23 omkargaikwad23 deleted the fix-evalbench-ci branch May 5, 2026 05:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants