Commit Graph
100 Commits
Author SHA1 Message Date
creatixchu 685bb24bf7 test(cua): record foreground recovery operation 2026-09-23 20:47:32 +08:00
creatixchu 091a085d5d feat(cua): add explicit activation for hidden application recovery 2026-09-23 20:40:46 +08:00
creatixchu 3a7e7650bb test(cua): record explicit secondary action schema and guidance 2026-09-23 20:32:34 +08:00
creatixchu 493cd1e0bc feat(cua): keep app selection in background and expose explicit AX actions 2026-09-23 20:28:31 +08:00
creatixchu f808571fff Merge remote-tracking branch 'origin/feat/persistent-ptc' into feat/experimental-dsh-cua 2026-09-23 20:22:03 +08:00
creatixchu f5c4110b5e fix(cua): activate selected apps before observing their windows 2026-09-23 20:20:33 +08:00
creatixchu 75ae02da4a fix(ptc): allow top-level await in scoped blocks 2026-09-23 20:18:49 +08:00
creatixchu 9107ae0d21 test(cua): refresh persistent PTC guidance snapshot 2026-09-23 20:18:45 +08:00
creatixchu 56f3d3135d feat(cua): expose plain-text paste and persistent PTC composition 2026-09-23 20:12:21 +08:00
creatixchu 9bd3aca35e feat(cua): support indexed pointer gestures and focused windows 2026-09-23 20:07:19 +08:00
creatixchu 2a17abf773 test(cua): declare image capability for screenshot admission 2026-09-23 17:59:41 +08:00
creatixchu ad41f5f970 test(cua): compare screenshot coordinate metadata structurally 2026-09-23 17:56:25 +08:00
creatixchu a11af71304 test(cua): cover portable screenshots and replay published package exports 2026-09-23 17:55:39 +08:00
creatixchu b44230bdbe Merge remote-tracking branch 'origin/feat/persistent-ptc' into feat/experimental-dsh-cua 2026-09-23 17:38:15 +08:00
creatixchu cd08b60f9c test(ptc): declare workflow runtime confinement capabilities 2026-09-23 17:36:07 +08:00
creatixchu dde3e78c23 Merge remote-tracking branch 'origin/master' into feat/persistent-ptc 2026-09-23 17:19:20 +08:00
creatixchu 62396f4537 docs(ptc): synchronize the generated config source reference 2026-09-23 17:16:00 +08:00
creatixchu cff260f048 chore(ptc): align published artifacts and strict lint contracts 2026-09-23 17:12:43 +08:00
creatixchu b0dc38429a test(ptc): pin packaged-host persistent bootstrap selection 2026-09-23 17:08:00 +08:00
creatixchu d59f96ece2 docs(ptc): refresh generated source locations 2026-09-23 17:06:56 +08:00
creatixchu 1393ed2e12 fix(ptc): simplify evaluation settlement and isolate published bundles 2026-09-23 17:03:04 +08:00
creatixchu 7391d06a8d fix(ptc): preserve provider identity and self-contained published entries 2026-09-23 17:00:37 +08:00
creatixchu e625e7a6a5 fix(ptc): report process loss consistently across exit event ordering 2026-09-23 16:58:27 +08:00
creatixchu f85883425d fix(ptc): release each provider once and await workflow REPL completion 2026-09-23 16:57:46 +08:00
creatixchu 4fe78cb71a fix(ptc): compose the persistent provider and share process cleanup 2026-09-23 16:55:21 +08:00
creatixchu 5f5395f7ad test(ptc): cover persistent process transport and cleanup failures 2026-09-23 16:50:38 +08:00
creatixchu 2859d2bb08 test(ptc): verify REPL callback ownership and scoped output 2026-09-23 16:48:26 +08:00
creatixchu bd2ed0ce61 test(ptc): exercise ownerless requests without explicit undefined fields 2026-09-23 16:45:21 +08:00
creatixchu 607077b985 test(ptc): cover retained state and recovery through the shipped profile 2026-09-23 16:44:48 +08:00
creatixchu 4fb14dcac6 feat(ptc): add opt-in best-effort persistent Node REPL 2026-09-23 16:41:38 +08:00
creatixchu 8a64473c5b docs(cua): document the API and external evaluator integration
Explain configuration, window and input semantics, source ownership and current limitations. Record why persistence belongs to the execution host and refresh repository catalogs.
2026-09-23 16:01:41 +08:00
creatixchu 09b60c331c test(cua): record native tool operations and image delivery
Exercise the real Loader, AgentLoop, helper transport and attachment pipeline with an explicit desktop protocol fixture. Add a headless V4 Session replay for observations and actions.
2026-09-23 16:01:40 +08:00
creatixchu ee676a3025 test(cua): verify AppKit and Electron operations on macOS
Use disposable applications and independent state records to verify clicks, Unicode input, modifiers, scrolling, dragging, capture and stale-target cleanup. Share the native test transport.
2026-09-23 16:01:39 +08:00
creatixchu 445c5f3da7 build(cua): wire the experimental package and source profile
Declare package exports, workspace dependencies and build entries. Add an opt-in macOS source composition and enforce the experimental release payload.
2026-09-23 16:01:36 +08:00
creatixchu 17a4118c20 feat(cua): integrate logged tools with Agent-owned native resources
Register native operations and model guidance, and bridge objects through the current authorized tool binding. Join Agent and provider cleanup without introducing a persistent evaluator.
2026-09-23 16:01:36 +08:00
creatixchu e3911008a8 feat(cua): bound native process communication and cleanup
Implement serial JSONL transport with request/response limits, deadlines, cancellation and process-range cleanup. Cover protocol and stream failures across host platforms.
2026-09-23 16:01:35 +08:00
creatixchu 2355950d20 feat(cua): add scoped application and window objects
Provide discovery, observations, screenshots and input through retained objects. Preserve per-window snapshot identity and prevent action options from replacing the selected target.
2026-09-23 16:01:34 +08:00
creatixchu b0507f94af feat(cua): define application types and validate the operation protocol
Define the evaluator-independent app/window API and validate method-specific requests and native responses. Test invalid targets and parameter admission.
2026-09-23 16:01:34 +08:00
creatixchu 4a6e03fecd feat(cua): implement the macOS native operation helper
Expose app and window handles, scoped AX snapshots, permissions, input and capture through a JSONL helper. Bind handles to process lifetimes and report stable native errors.
2026-09-23 16:01:31 +08:00
creatixchu 7417c38a14 feat(cua): copy licensed macOS accessibility and input primitives
Copy the selected Cua Driver macOS source without modifications. Preserve the MIT notice and a file-level source manifest.
2026-09-23 16:01:29 +08:00
creatixchu c5ca36387b Merge remote-tracking branch 'origin/master' into fix/4775-multimodal-tool-retention
# Conflicts:
#	packages/spill/spill-policy/package.json
2026-09-22 12:35:56 +08:00
creatixchu 670a903237 test: clarify parallel recovery fixture cleanup 2026-09-22 12:08:55 +08:00
creatixchu b74bef5d40 test: exercise image recovery and real PTC retention 2026-09-22 12:03:54 +08:00
creatixchu de45804084 test: refresh tool projection API snapshot 2026-09-22 11:32:07 +08:00
creatixchu 94728ebd23 fix: repair multimodal retention CI resolution and coverage 2026-09-22 11:28:51 +08:00
creatixchu 06923b8868 Merge remote-tracking branch 'origin/master' into fix/4775-multimodal-tool-retention 2026-09-22 11:25:47 +08:00
creatixchu 6b227a81a7 docs: sync plugin inventory after master merge 2026-09-22 11:00:31 +08:00
creatixchu 4137d1d628 Merge remote-tracking branch 'origin/master' into fix/4775-multimodal-tool-retention
# Conflicts:
#	docs/config-catalog.i18n.yaml
#	docs/config-catalog.zh.md
#	docs/module-graph.i18n.yaml
#	docs/module-graph.md
#	docs/module-graph.zh.md
2026-09-22 10:52:21 +08:00
creatixchu 754733d5d1 test: update shell spill snapshot for the shared token budget 2026-09-21 17:34:29 +08:00
creatixchu f3c6d0c0df test: refresh multimodal tool catalog after master update 2026-09-21 17:28:00 +08:00
creatixchu 575dc9add0 Merge remote-tracking branch 'origin/master' into fix/4775-multimodal-tool-retention 2026-09-21 17:21:38 +08:00
creatixchu b0be6e79c2 fix: preserve failed PTC image result forwarding semantics 2026-09-21 17:17:03 +08:00
creatixchu 14c1fec958 test: record mixed-content retention through the headless profile 2026-09-21 17:11:56 +08:00
creatixchu 79468e26dd test: stabilize multimodal spill recovery locators 2026-09-21 17:08:01 +08:00
creatixchu 4694540e2a Merge remote-tracking branch 'origin/master' into fix/4775-multimodal-tool-retention
# Conflicts:
#	docs/module-graph.i18n.yaml
#	docs/module-graph.md
#	docs/module-graph.zh.md
2026-09-21 16:59:45 +08:00
creatixchu e52209da40 test: share multimodal snapshot composition 2026-09-21 16:57:59 +08:00
creatixchu 5c1d966c3f test: cover image recovery failures and snapshot registration 2026-09-21 16:55:13 +08:00
creatixchu c4c18ef0d4 test: align retention checks and catalogs with token budgets 2026-09-21 16:50:35 +08:00
creatixchu ab102138c8 fix: retain ordered tool text and images within a token budget 2026-09-21 16:45:21 +08:00
creatixchu 4e47ba6c1d chore: start multimodal tool result retention work 2026-09-21 16:03:43 +08:00
creatixchu e17f505504 Merge master into ihsiang/changed-files-hover-preview 2026-09-21 15:27:19 +08:00
creatixchu 6ac2d741a6 test(llm): retain pending mock listeners through teardown 2026-09-21 12:36:54 +08:00
creatixchu 6f07deab31 test(llm): preserve coverage timeout budget and drain stalled fixtures 2026-09-21 12:33:59 +08:00
creatixchu 49ff1f815d Merge origin/master into worktree/issue-3881-folder-drop 2026-09-21 12:33:50 +08:00
creatixchu e30f0c7774 test(terminal): check descendant quiescence instead of PID removal 2026-09-21 11:58:04 +08:00
creatixchu 20be0ff297 Merge origin/master into worktree/issue-3881-folder-drop 2026-09-21 11:41:36 +08:00
creatixchu d0ac0afbe2 fix(composer): recognize pasted directories through entry metadata 2026-09-21 11:38:44 +08:00
creatixchu 62891ca4fc Merge origin/master into worktree/issue-3881-folder-drop 2026-09-21 11:11:36 +08:00
creatixchu 82692090c8 Merge remote-tracking branch 'origin/master' into feat/4562-file-open-apps 2026-09-21 09:56:00 +08:00
creatixchu db10002cdd test(web): include file items in image drop fixture 2026-09-20 21:34:31 +08:00
creatixchu 5953ab2913 test(composer): use explicit void paste handler 2026-09-20 21:24:49 +08:00
creatixchu 444ce0444b fix(composer): type paste regression and refresh slot catalog 2026-09-20 21:14:44 +08:00
creatixchu 52a4a5bdb3 fix(composer): preserve batches and quoted directory references 2026-09-20 21:12:06 +08:00
creatixchu 1790a09f77 Merge remote-tracking branch 'origin/master' into feat/4562-file-open-apps 2026-09-20 20:33:24 +08:00
creatixchu 112c9e5749 feat(web): cite dropped folders and files as @ references on Desktop
The Desktop preload reports a picked file's real path through
__DSH_HOST_PATHS__. Where that bridge exists, the composer inserts a dropped,
picked, or pasted folder or non-image file as the same @path reference chip
the user could have typed, so nothing uploads and the model reads the target
with its file tools; images keep uploading. The drop handler names dropped
directories through the entry API, and a browser without the bridge refuses
a dropped folder with product copy instead of failing it as an upload.
2026-09-20 18:00:26 +08:00
creatixchu 7d002f7eff test: compare Windows file identity and refresh delivery controls 2026-09-20 17:17:40 +08:00
creatixchu e0187ecdf8 Merge remote-tracking branch 'origin/master' into feat/4562-file-open-apps 2026-09-20 17:16:21 +08:00
creatixchu 086b64103f test: verify transient feedback and single-action file controls 2026-09-20 16:51:58 +08:00
creatixchu c7a4fae8e5 fix: complete shared menu types and remove obsolete button styles 2026-09-20 16:48:25 +08:00
creatixchu a4148d687f fix: refine file action menus feedback and shared queries 2026-09-20 16:46:58 +08:00
creatixchu c1ee42cd9c fix: portal file action tooltips outside clipped cards 2026-09-20 14:28:15 +08:00
creatixchu a4cd2f57a0 fix: keep file action feedback visible while hovering delivery cards 2026-09-20 14:07:32 +08:00
creatixchu a6daee84ca test: enable the shared opener in the delivery replay 2026-09-20 14:06:00 +08:00
creatixchu 6f1857ae1b test: refresh delivery snapshots for shared file controls 2026-09-20 14:04:54 +08:00
creatixchu 03fde971e2 build: allow browser-safe file association metadata validation 2026-09-20 14:02:18 +08:00
creatixchu 1f7e491526 docs: describe shared delivery and review file actions 2026-09-20 14:00:41 +08:00
creatixchu 28089001a2 fix: complete file action slot contracts and branch coverage 2026-09-20 13:59:00 +08:00
creatixchu 59fdc2604d test: provide the file action slot runtime in delivery fixtures 2026-09-20 13:56:09 +08:00
creatixchu b80722812b fix: scope shared file actions to their owning views 2026-09-20 13:55:27 +08:00
creatixchu 56d0534c30 refactor: share native file actions across delivery and review views 2026-09-20 13:53:16 +08:00
creatixchu 33782150cd fix: name the default application in opening tooltips 2026-09-20 13:42:31 +08:00
creatixchu 6e260998c9 fix: refine shared file controls and native query errors 2026-09-20 13:39:11 +08:00
creatixchu 27b7fd0e2f fix: preserve Shell reference storage during failed handoff cleanup 2026-09-20 13:26:18 +08:00
creatixchu 7943fb3917 Merge master into file application controls 2026-09-20 13:25:10 +08:00
creatixchu 6493cdac9c fix: retain the Windows Shell host until asynchronous handoff settles 2026-09-20 13:14:49 +08:00
creatixchu 39af517961 test: evaluate the Windows fixture output path as a PowerShell expression 2026-09-20 12:58:58 +08:00
creatixchu cbc51b5446 test: isolate native application identity and cold-history associations 2026-09-20 12:51:18 +08:00
creatixchu 5218958366 test: keep native association expectations strictly typed 2026-09-20 12:35:53 +08:00
creatixchu 4fb9d34275 fix: use the native test task timeout for fixture readiness 2026-09-20 12:32:05 +08:00
creatixchu b689c724d1 docs: describe cross-platform file opening and pin desktop browser fixtures 2026-09-20 12:28:41 +08:00