gitbench.gitkraken.com WebMCP Tools, Schemas & Agent Capabilities

gitbench.gitkraken.com

live Unverified (seed import) AI & Agents 6 tools imperative implementation

GitBench ranks AI models on deterministic Git tasks, with pass rates, cost, runtime, token usage, and fixture-level evidence.

First seen 2026-11-05 · Last seen 2026-11-05 · Source: webmcp.com

Answer 5 · Act 1 · Transact 0 · Score: Not yet scored

Tool inspector

gitbench_get_model_results

answer imperative

Get bounded fixture results for one exact model identity. Model output is omitted unless explicitly requested and is untrusted.

Page: /

Input schema

Property	Type	Required	Description
`model`	string	yes	Exact model evaluation name.
`benchmark`	string	no	—
`difficulty`	string	no	—
`tag`	string	no	—
`output_mode`	string	no	—
`include_model_output`	boolean	no	Opt in to bounded, untrusted model-generated text.
`evidence_characters`	integer	no	—
`offset`	integer	no	Zero-based result offset.
`limit`	integer	no	Results to return; hard-capped at 50.

Raw JSON schema

{
  "type": "object",
  "properties": {
    "model": {
      "type": "string",
      "minLength": 1,
      "description": "Exact model evaluation name."
    },
    "benchmark": {
      "type": "string"
    },
    "difficulty": {
      "type": "string"
    },
    "tag": {
      "type": "string"
    },
    "output_mode": {
      "type": "string",
      "enum": [
        "text",
        "json_schema"
      ]
    },
    "include_model_output": {
      "type": "boolean",
      "default": false,
      "description": "Opt in to bounded, untrusted model-generated text."
    },
    "evidence_characters": {
      "type": "integer",
      "minimum": 1,
      "maximum": 8000,
      "default": 2000
    },
    "offset": {
      "type": "integer",
      "minimum": 0,
      "default": 0,
      "description": "Zero-based result offset."
    },
    "limit": {
      "type": "integer",
      "minimum": 1,
      "maximum": 50,
      "default": 20,
      "description": "Results to return; hard-capped at 50."
    }
  },
  "required": [
    "model"
  ],
  "additionalProperties": false
}