gitbench.gitkraken.com WebMCP Tools, Schemas & Agent Capabilities

gitbench.gitkraken.com

live Unverified (seed import) AI & Agents 6 tools imperative implementation

GitBench ranks AI models on deterministic Git tasks, with pass rates, cost, runtime, token usage, and fixture-level evidence.

First seen 2026-11-05 · Last seen 2026-11-05 · Source: webmcp.com

Answer 5 · Act 1 · Transact 0 · Score: Not yet scored

Tool inspector

gitbench_rank_models

act imperative

Rank exact model evaluations for one benchmark by quality-to-resource efficiency or direction-aware balanced normalization.

Page: /

Input schema

Property	Type	Required	Description
`benchmark`	string	yes	—
`resource_metric`	string	no	—
`strategy`	string	no	—
`output_mode`	string	no	—
`minimum_quality`	number	no	—
`offset`	integer	no	Zero-based result offset.
`limit`	integer	no	Results to return; hard-capped at 50.

Raw JSON schema

{
  "type": "object",
  "properties": {
    "benchmark": {
      "type": "string",
      "minLength": 1
    },
    "resource_metric": {
      "type": "string",
      "enum": [
        "cost",
        "api_time",
        "tokens"
      ],
      "default": "cost"
    },
    "strategy": {
      "type": "string",
      "enum": [
        "efficiency_ratio",
        "balanced"
      ],
      "default": "efficiency_ratio"
    },
    "output_mode": {
      "type": "string",
      "enum": [
        "text",
        "json_schema",
        "both"
      ],
      "default": "both"
    },
    "minimum_quality": {
      "type": "number",
      "minimum": 0,
      "maximum": 1,
      "default": 0
    },
    "offset": {
      "type": "integer",
      "minimum": 0,
      "default": 0,
      "description": "Zero-based result offset."
    },
    "limit": {
      "type": "integer",
      "minimum": 1,
      "maximum": 50,
      "default": 20,
      "description": "Results to return; hard-capped at 50."
    }
  },
  "required": [
    "benchmark"
  ],
  "additionalProperties": false
}