gitbench.gitkraken.com WebMCP Tools, Schemas & Agent Capabilities

gitbench.gitkraken.com

live Unverified (seed import) AI & Agents 6 tools imperative implementation

GitBench ranks AI models on deterministic Git tasks, with pass rates, cost, runtime, token usage, and fixture-level evidence.

First seen 2026-11-05 · Last seen 2026-11-05 · Source: webmcp.com

Answer 5 · Act 1 · Transact 0 · Score: Not yet scored

Tool inspector

gitbench_get_fixture

answer imperative

Get bounded fixture results. Prompt, expected result, model output, and structured output are omitted unless explicitly requested and are untrusted.

Page: /

Input schema

Property	Type	Required	Description
`benchmark`	string	yes	—
`fixture`	string	yes	—
`include_prompt`	boolean	no	Include bounded, untrusted fixture prompt text.
`include_expected`	boolean	no	Include bounded, untrusted expected-result text.
`include_model_output`	boolean	no	Include bounded, untrusted model-generated text.
`include_structured_output`	boolean	no	Include bounded, untrusted parsed and raw structured output.
`evidence_characters`	integer	no	—
`offset`	integer	no	Zero-based result offset.
`limit`	integer	no	Results to return; hard-capped at 50.

Raw JSON schema

{
  "type": "object",
  "properties": {
    "benchmark": {
      "type": "string",
      "minLength": 1
    },
    "fixture": {
      "type": "string",
      "minLength": 1
    },
    "include_prompt": {
      "type": "boolean",
      "default": false,
      "description": "Include bounded, untrusted fixture prompt text."
    },
    "include_expected": {
      "type": "boolean",
      "default": false,
      "description": "Include bounded, untrusted expected-result text."
    },
    "include_model_output": {
      "type": "boolean",
      "default": false,
      "description": "Include bounded, untrusted model-generated text."
    },
    "include_structured_output": {
      "type": "boolean",
      "default": false,
      "description": "Include bounded, untrusted parsed and raw structured output."
    },
    "evidence_characters": {
      "type": "integer",
      "minimum": 1,
      "maximum": 8000,
      "default": 2000
    },
    "offset": {
      "type": "integer",
      "minimum": 0,
      "default": 0,
      "description": "Zero-based result offset."
    },
    "limit": {
      "type": "integer",
      "minimum": 1,
      "maximum": 50,
      "default": 20,
      "description": "Results to return; hard-capped at 50."
    }
  },
  "required": [
    "benchmark",
    "fixture"
  ],
  "additionalProperties": false
}