Autoplay
91 tools in this family (folder Editor/Tools/Autoplay/ in the bridge package). Effect: writes changes the project or the scene, read-only does not, destructive deletes or overwrites and the client asks before running it.
| Tool | Effect | Description |
|---|---|---|
tester_act_step | read-only | Run one full Cradle 6-module decision step: information gathering + self-reflection + task inference… |
tester_anomaly_score | read-only | Score a snapshot against a model trained by tester_anomaly_train. Returns per-feature z-scores ((val… |
tester_anomaly_train | writes | Train a per-feature z-score anomaly model on a corpus of golden state snapshots. Each snapshot is a … |
tester_assert_no_nan | read-only | Sweep all active Transform.position and Rigidbody.linearVelocity values in the loaded scene for NaN.… |
tester_assert_property | read-only | Assert that a component's field/property value satisfies a comparison (== / != / < / <= / > / >=). O… |
tester_audio_fingerprint_baseline | writes | Capture the current AudioListener FFT spectrum as a NAMED gold baseline. Stored as Tests/AutoPlay/au… |
tester_audio_fingerprint_compare | read-only | Compare the current AudioListener spectrum against a named baseline (saved by tester_audio_fingerpri… |
tester_blackbox_session | writes | Run an N-step no-SDK blackbox autoplay session. Each step: capture Game View screenshot → send to vi… |
tester_blackbox_step | writes | Single blackbox step: capture screenshot → send to vision LLM → dispatch tester_input_drive. |
tester_bot_sequence_list | read-only | List all Bot Sequence definitions saved in Tests/AutoPlay/sequences/. |
tester_bot_sequence_run | writes | Load and execute a Bot Sequence — an ordered list of typed segments (scripted, monkey, wait_for_even… |
tester_bot_sequence_save | writes | Save a Bot Sequence definition as JSON to Tests/AutoPlay/sequences/<name>.json. |
tester_component_get | read-only | Read a single field or property value from a component. AltTester's GetComponentProperty equivalent … |
tester_component_inspect | read-only | Inspect a component on a GameObject — returns all public + private fields and properties with their … |
tester_component_set | writes | Set a field or property value on a component. AltTester's SetComponentProperty equivalent (Pro featu… |
tester_cradle_memory_index | writes | Push a new entry into the Cradle multimodal memory (BAAI-Agents/Cradle). |
tester_cradle_memory_recall | read-only | Hybrid recall from Cradle multimodal memory. |
tester_curriculum_propose | read-only | Propose 3-7 'interesting next goals' for the autoplay agent using LLM-as-curriculum-rewarder. |
tester_dashboard | writes | Render a local HTML dashboard for a session: heat-map of test coverage, bug count by channel, BYOK t… |
tester_dedupe | read-only | Search the autoplay_bugs Qdrant collection for bugs semantically similar to a given summary. Use BEF… |
tester_detect_anti_cheat | unclassified | Query the anti-cheat false-positive detector buffer. AntiCheatFPDetector matches console errors agai… |
tester_detect_audio | unclassified | Query the audio anomaly buffer. AudioListener.GetSpectrumData clipping detection (samples ≥ 1.0), mi… |
tester_detect_console | unclassified | Query the console-error detector buffer. Captures every Error/Warning/Exception emitted via Applicat… |
tester_detect_crash_pattern | unclassified | Query the crash-pattern miner buffer. CrashPatternDetector listens to LogType.Exception and computes… |
tester_detect_dialogue | unclassified | Query the dialogue traversal buffer. Detects dialogue-tree dead ends, missing voice clips, unlocaliz… |
tester_detect_localization | unclassified | Query the localization completeness audit buffer. LocalizationDetector scans every active |
tester_detect_multiplayer_chaos | unclassified | Query the multiplayer-chaos buffer. Drives Unity Multiplayer Network Simulator at varying latency/ji… |
tester_detect_perf | unclassified | Query the performance regression buffer. ProfilerRecorder samples every Editor update during Play Mo… |
tester_detect_physics | unclassified | Query the physics watchdog buffer. Buril innovation — no OSS pattern. Every 30 fixed-update ticks sc… |
tester_detect_save_roundtrip | unclassified | Query the save round-trip buffer. Periodic save → quit → reload via existing scene_snapshot + BuildT… |
tester_detect_ui_layout | unclassified | Query the UI layout regression buffer. Scans every active RectTransform every 5 seconds during Play … |
tester_emit_nunit_xml | writes | Convert detector findings + bug repros from a session into NUnit-shaped XML and write to disk. CI pi… |
tester_evotest_evolve | writes | EvoTest Self-Improving Agent (arxiv 2510.13220 / ICLR 2026). |
tester_evotest_list_policies | read-only | List all saved EvoTest policies in Tests/AutoPlay/policies/. |
tester_evotest_load_policy | read-only | Load the EvoTest policy for the current game. Call this at the START of every |
tester_github_issue | writes | Emit a structured GitHub-issue payload for a previously recorded bug repro (see tester_repro_record)… |
tester_goto_entity | writes | Walk to a tile adjacent to the named NPC/actor and face them — ready for a tester_input_drive(submit… |
tester_hpath_query | read-only | Run a HierarchyPath query (GameDriver TA-style DSL) and return matching GameObjects with their hiera… |
tester_input_drive | writes | Inject a single keyboard input into the running Unity game in Play Mode. Bypasses OS focus via PocoI… |
tester_invoke_method | destructive | Invoke a method on a component via reflection. AltTester's CallComponentMethod equivalent (Pro featu… |
tester_kb_bug_index | writes | Index a bug repro for semantic deduplication. Concatenates summary + last actions into the embedding… |
tester_kb_index | writes | Index a generic text + metadata observation into the Buril Autoplay knowledge base (Qdrant Apache 2.… |
tester_kb_query | read-only | Semantic search the autoplay KB. Returns top_k most similar entries by cosine similarity over the em… |
tester_kb_summarize | read-only | Summarize a session into a structured markdown + JSON doc. Pulls last N actions from history + last … |
tester_linear_ticket | writes | Emit a Linear / Jira issue payload for a recorded bug. Mirrors tester_github_issue's contract (Buril… |
tester_monkey_run | writes | Run a Monkey Bot — N random input verbs sampled from a configurable set, with random hold durations.… |
tester_multi_agent_swarm | writes | Run a curiosity-driven multi-agent swarm against the loaded scene. Spawns N agents (default 4) with … |
tester_nl_property_compile | read-only | NL Property Monitor — Step 1 of 2. |
tester_nl_property_list | read-only | List all active natural-language property monitors registered with the runtime monitor. |
tester_nl_property_register | writes | NL Property Monitor — Step 2 of 2. |
tester_oracle_propose_asserts | read-only | LLM-as-Bug-Oracle — auto-propose 3-7 candidate test assertions from the CURRENT game state + recent … |
tester_plan_subgoals | read-only | Decompose a high-level test goal into 3-7 concrete, verifiable subgoals using the configured chat pr… |
tester_playtest_swarm | writes | One button: run a persona-driven playtest swarm against the loaded scene and emit the full artifact … |
tester_poll_events | read-only | Return structured events emitted by PocoEventEmitter since since_ts, optionally filtered by types. U… |
tester_pr_session | writes | Single-shot Autoplay session for CI/CD pipelines. Runs the Cradle 6-module decision loop |
tester_pr_status | read-only | Returns the CI-friendly summary from the last tester_pr_session run in this Editor session: |
tester_predict_los | read-only | Report current trainer / NPC line-of-sight status. Returns: |
tester_predict_press | read-only | DRY-RUN — simulate a key press without injecting it. Returns the predicted effect: |
tester_predict_walk | read-only | DRY-RUN — simulate walking N tiles in a direction without actually moving. Returns: |
tester_recording_export_bot_sequence | writes | Export the last stopped recording as a Bot Sequence JSON file. |
tester_recording_export_csharp | writes | Export the last stopped recording as an NUnit C# test class with a [UnityTest] Replay() |
tester_recording_start | writes | Start recording user inputs (keyboard) during Play Mode. Every key press/hold |
tester_recording_stop | writes | Stop the active input recording and return all captured actions as a JSONL block |
tester_reel_export | read-only | Assemble a watchable clip from a captured PNG-sequence folder (an incident reel). |
tester_reel_start | read-only | Arm the rolling frame reel — captures the last ~25 frames continuously and dumps a PNG-sequence clip… |
tester_reel_stop | read-only | Disarm the rolling frame reel (stop capturing). Optionally emit the incident heatmap (scene::channel… |
tester_repro_record | writes | Capture a reproducible bug snapshot to disk under <projectRoot>/Tests/AutoPlay/bugs/<bug_id>/. Write… |
tester_save_backcompat_check | writes | Sweep the save corpus and verify each save still loads in the current build. For each save: invoke t… |
tester_save_corpus_add | writes | Add a save file to the backwards-compatibility corpus. Buril stores it under Tests/AutoPlay/save_cor… |
tester_scene_graph_dump | read-only | Return structured game state extracted via reflection by the resolved IBurilAutoplayAdapter. Schema:… |
tester_screenshot_capture | read-only | Capture the current Unity Game View as a JPG. Primary visual feedback channel for the LLM agent — ca… |
tester_self_reflect | read-only | Run the Cradle Self-Reflection module: review the last N actions and emit a strategic paragraph. |
tester_sensi_observe | read-only | Sensi Observer: ingest an (action, result) pair into the persistent FactBase. |
tester_sensi_propose_action | read-only | Sensi Actor: propose the next concrete test action grounded in the accumulated FactBase. |
tester_sensi_query_facts | read-only | Query the Sensi FactBase for all learned facts about a mechanic topic |
tester_sensi_state | read-only | Returns the Sensi curriculum state machine state + per-topic fact count and average |
tester_session_replay | writes | Deterministically re-run an action sequence from a previous session. Reads bugs/<bug_id>/last_50_act… |
tester_session_start | writes | Boot a new Buril Autoplay session. Verifies Play Mode is active, the Poco TCP server is up on the co… |
tester_session_step | writes | Run an N-step autonomous Cradle decision loop. Each step: pull observation via resolved adapter → ca… |
tester_severity_rank | read-only | Classify a finding's severity (1=trivial → 5=critical) using the configured BYOK chat provider. |
tester_skill_invoke | writes | Execute a saved skill by name, replaying its steps sequentially via ToolRegistry. |
tester_skill_list | read-only | List all saved skills in Qdrant 'autoplay_skills' with name, description, step count, and success ra… |
tester_skill_retrieve | read-only | Semantic search the skill library (Qdrant 'autoplay_skills') for reusable action sequences relevant … |
tester_skill_save | writes | Persist a successful multi-step action sequence as a named reusable skill (Voyager pattern, MineDojo… |
tester_time_scale_set | writes | Set Time.timeScale — controls how fast simulated time advances. Useful for slow-mo animation review … |
tester_time_stats | read-only | Return Unity Time stats: timeScale, time, unscaledTime, deltaTime, frameCount. Use as observation en… |
tester_ui_audit | read-only | Audit the active UI tree for layout regressions and localization gaps. Walks every active GraphicRay… |
tester_visual_baseline_capture | writes | Capture the current Unity Game View screenshot as a NAMED visual gold baseline. |
tester_visual_baseline_compare | read-only | Compare the current Unity Game View screenshot against a named baseline (saved by tester_visual_base… |
tester_wait_for_event | read-only | Block until an event of the given event_type arrives, or the timeout_ms elapses. Returns the matchin… |
tester_walk_to_tile | writes | Pathfind to (x, y) using A* and execute the walk. Steps: (a) dump_grid, (b) A* from player to goal, … |