One Remote Swap Moved an Agent’s Unprompted Pushes by 11 Points — and Nothing in the Record Says Whether Three Weeks of Config Tuning Converges

Evidence note: This article rests almost entirely on primary sources — vendor announcements, company engineering blogs, and self-published repositories — rather than on independent verification. Where a figure, benchmark, or product capability appears below, it is marked with who reported it. No experiment was run for this piece; the harness described near the end is a proposal, not a result. The central question the title raises — whether weeks of agent-configuration tuning converge on better behaviour or merely drift — has no measurement behind it in the available record, and that absence is stated rather than papered over.

Where game-dev agent configuration stands in late October 2026

Three shapes of "configure your coding agent for game development" are visible in public repositories right now, and none of them has published outcome data.

The first is the instruction file paired with a skill set. A public example exists for the Defold engine: the defold-agent-config repository presents itself as an example configuration combining an agent instruction file with a set of agent skills aimed specifically at AI-assisted Defold development. That is a description the repository gives of itself; sources available here do not independently confirm how widely it is used or whether it changes agent output.

The second is the reusable, cross-engine configuration bundle. The pattern — configuration repositories published on GitHub and targeted at general-purpose coding agents across more than one engine — appears in the record, but it is uncorroborated beyond the repositories’ own framing, and no adoption figures or before/after comparisons accompany it.

The third is the workflow layer. The OpenCodeGameStudios project describes an agentic game development workflow in which agents plan, build, and test across major engines with any coding agent. Again: that is the project’s own description of itself. Whether the plan/build/test loop holds up across engines is not established by anything supplied here.

The common thread is that all three ship artefacts — files you can copy — and none ships evidence. That distinction matters more than it usually does, because the reader this is written for is already editing such a file every week.

The other route: an engine-resident agent instead of a config file

The alternative to configuring a general coding agent is using an agent that already lives inside the engine. Bezi is described as an AI agent for Unity development integrated with the Unity Editor, indexing the whole project for retrieval and supporting checkpointed edits in the style of Cursor. These are product claims that the available record does not independently corroborate — no third-party test of the indexing quality, the retrieval behaviour, or the reliability of checkpoint rollback appears in the sources here.

The architectural difference is still worth naming, because it changes what you tune. With an instruction file, the thing you edit is prose plus a skills directory. With an editor-resident agent, much of the context acquisition is the vendor’s problem and the surface you control shrinks. For a two-person team, that is a trade between tuning latitude and tuning burden — and the record offers no measurement of which produces better results.

The argument for engine-specific context, stated by its author

Bezi’s author reportedly makes a specific argument for the engine-resident route: that scene hierarchy and component relationships are context a generic code agent either lacks outright or spends extra tokens reconstructing. This is presented here as the author’s stated position, not as a verified finding; no token-count comparison between a generic agent and an engine-resident one appears in the supplied evidence.

The argument is coherent on its face. A Unity project’s meaning is not fully recoverable from its text files — prefab wiring, component references, and scene structure carry information a file-by-file reader must rebuild. Whether rebuilding it costs enough tokens to justify a different tool is exactly the kind of question a held-fixed comparison could answer and nobody in this record has published.

Why the choice is now time-boxed for small teams

Two things compress the decision window.

Unity has reportedly shipped Unity Spark, described by CEO Matt Bromberg as a way to make and share games in the browser with no prior Unity or game development experience — a framing set out in Unity’s own post on why it built Spark. Treat the capability claims as the vendor’s; independent evaluation is not present in this record. Our earlier coverage of Unity’s prompt-based browser game creation covers the announcement in more detail.

The harder deadline is a jam. The 2026 Epic AI MegaJam is reported to run November 12–15, 2026, permitting teams of up to five humans plus an unlimited number of AI agents to build a playable game in Unreal Engine or UEFN, with cash prizes reported up to $50,000. Those dates, the team-size rule, and the prize figure come from the announcement as relayed in this record and are not independently confirmed here. If the dates hold, a team reading this has roughly three weeks — which is, not coincidentally, the exact span over which configuration tuning either converges or doesn’t.

Behaviour is set by named switches, not only by prose

One reason "tune the instruction file" is an incomplete model of agent configuration: a meaningful share of agent behaviour is governed by discrete named settings rather than by prose.

Google’s Agent Development Kit reportedly exposes explicit response-scheduling values — when-idle, interrupt, and silent — as configuration options that change what the agent does, illustrated in a Google walkthrough on building a voice agent that never goes silent. This is documentation from the framework’s own vendor and is not independently verified here.

The general point survives the uncertainty about any single setting name. If part of behaviour is a switch with a finite set of values, then "tuning" is not one activity. Changing a switch is a discrete, loggable, reversible event. Rewriting a paragraph of instructions is neither. A team that cannot tell which of the two it did last Tuesday cannot answer the convergence question at all.

The one substitution in the record that was actually measured

There is exactly one case in the supplied evidence where someone changed a single environment variable and reported behaviours separately.

A Microsoft engineering write-up on whether a local git remote can replace GitHub in an agent eval reports that, with the instructions held constant, swapping GitHub for a local git remote left rebasing and pushing-on-request unaffected, while the agent pushed on its own 11 points less often. That 11-point figure is Microsoft’s own reported result and has not been independently reproduced in anything available here.

The structural finding is the useful part, and it is the reason this article exists. The substitution moved self-initiated behaviour while leaving instructed behaviour stable. A single aggregate pass rate would have shown very little. Reported per behaviour, the swap showed something specific: the environment was shaping what the agent chose to do unprompted, not what it did when told.

For a game-dev team, the self-initiated column is where the interesting behaviours live — does the agent run the build without being asked, does it commit mid-task, does it spawn a sub-task, does it touch the scene file you didn’t mention. Those are precisely the behaviours an aggregate score hides.

Why "the task still finished" is not evidence of convergence

The most common informal test — the agent completed the task, so the config is better — fails for a reason the security literature states directly.

Agent runtime security work assumes long-horizon autonomy: NVIDIA’s material on securing AI agents at runtime describes agents working for hours, accessing files, tools, and the internet, and spawning sub-agents, and notes that an agent can complete an assignment while still crossing a security boundary. That characterisation is NVIDIA’s; it is not independently corroborated here, and it is a framing of risk rather than a measurement of frequency.

Taken at face value, it means completion and correctness are separable. Over a multi-hour run, "finished" is compatible with a long trail of unrequested actions. Our earlier look at 303 agent runs that built three Roblox games without the record showing they play makes a related point about self-reports as evidence.

What governance assumes about drifting agents

Platform vendors are building as though drift is expected, which is itself a weak signal about the problem’s reality — though not evidence about its size.

Google documents an architecture for governed, self-evolving agents in which self-modification is constrained by a four-gate defence-in-depth stack, reportedly combining model-level input/output filtering, key management, binary authorisation, and open policy enforcement; this appears in Google’s post on architecting governed, self-evolving agents. Separately, Google’s extension system for agent command-line tooling is described as keeping a unified deployment and evaluation workflow across different frameworks and letting platform teams enforce deployment-time policies such as automated software-bill-of-materials scans, set out in Google’s post on powering the agent development lifecycle with any framework. Microsoft, meanwhile, describes shared agent workspaces that pull plans, code, previews, and deployment feedback onto one surface in its write-up of Azure Canvases. NVIDIA’s reference architecture for securing and governing agent workloads at scale sits in the same category.

Every item above is a vendor describing its own product and remains uncorroborated here. What they share is an assumption: agent behaviour is expected to change over time, and the response is gates and logging, not better prose.

The gap, stated plainly

The supplied evidence contains no measurement, log, changelog, or report of a three-week configuration-tuning run in game development. There is no published series showing an instruction file edited week over week with behaviour tracked across the edits. There is no before/after for a skills directory. There is no study of whether an engine-resident agent and a configured generic agent converge on similar output.

So neither convergence nor drift can be asserted here. The one data point that exists — the remote swap — concerns a single substitution at a single moment, not a trajectory. Anyone claiming their config is improving week over week is, on this evidence, making an unmeasured claim. That includes anyone claiming the opposite.

The harness that would answer it — proposed, not run

What follows is a proposal. No part of it has been executed, and nothing below should be read as a result.

The method would copy the structure of the remote-swap test rather than its subject. Hold the evaluation task fixed: one specific game-dev assignment, repeated. Substitute one variable at a time — the instruction file version, the skills directory, the engine-resident agent versus the generic one, the model. Report per-behaviour deltas, not a single pass rate, because the one measured substitution in the record moved only the self-initiated column and an aggregate would have buried it.

The formalised version of this discipline is reportedly Microsoft’s Agent Experience Practitioner Playbook, described as a method for measuring whether coding agents choose the right SDK, version, and pattern, and for repairing the source material agents rely on when they get it wrong. That description is Microsoft’s own and is not independently verified here. As an analytical matter, a held-fixed harness with single-variable substitution is the closest available method for answering a converge-or-drift question with the evidence on hand — but calling it "closest available" is a judgement about this record, not a demonstration that it works.

A team with three weeks and no eval infrastructure cannot build the full thing. It can build the smallest version: one fixed task, three to five behaviours scored separately, run before and after each config change.

What a small team can decide this week

Pick the behaviours before you tune. Separate instructed behaviours (did it do what the prompt said) from self-initiated ones (did it build, commit, refactor, or edit a scene unasked). The single measured substitution available moved only the latter, which is the practical reason to split the columns. Our earlier analysis of which game constants an agent set and never revisited is a worked example of counting behaviour categories separately rather than in aggregate.

Shorten the debug loop before you lengthen the config. Roblox has reportedly shipped tooling that compresses the agent/developer loop, including structured server-log stack traces that deep-link to the originating script and line in Studio, announced on the Roblox developer forum. That announcement is from Roblox and is not independently evaluated here. The general principle holds regardless of platform: a faster failure signal produces more comparison points per day than a longer instruction file does.

Price the process risk. Generative-AI capability is now a stated factor in release decisions. Digital Sun Games reportedly delayed the public playtest of its next game and restricted testing to its Discord community over concerns about AI-enabled cloning, as reported by Game Developer. The reporting is a single outlet’s account of one studio’s stated reasoning; it is not a measured incidence of cloning. For a jam team shipping publicly in November, it is still a live input into what you show and when.

Developer takeaway

The honest summary: the configuration ecosystem is shipping artefacts faster than it is shipping evidence. A public Defold instruction-plus-skills example exists, cross-engine configuration repositories are reportedly published, an any-agent plan/build/test workflow describes itself in the open, and an engine-resident Unity agent offers project-wide indexing and checkpointed edits. Not one of them comes with a trajectory showing that tuning it over weeks makes behaviour better.

The one usable finding is structural rather than numeric: in the one substitution where behaviours were reported separately, a single environment change moved unprompted behaviour by a reported 11 points while instructed behaviour held steady. The decision rule that follows is cheap to adopt — instrument self-initiated actions separately from instructed ones, and never judge a config change by a single pass rate.

The follow-up a run would have to answer: across three weeks of week-over-week edits to one instruction file, on one fixed game-dev task, do the per-behaviour scores trend in a consistent direction, or do they oscillate within noise? Until someone publishes that series — this site included — "my config is getting better" remains a belief with no measurement attached.