feat: Integrated Vision & Robust Translation Layer, Secured Repo (removed keys)
This commit is contained in:
@@ -1,20 +1,22 @@
|
||||
# Task: Enhance AI Communication Patterns
|
||||
# Full Computer Use Integration - Pixel Perfect
|
||||
|
||||
## Objectives
|
||||
- [x] Integrate `agent-prompt.mjs` for dynamic system prompts
|
||||
- [x] Implement `fetchWithRetry` for robust API calls
|
||||
- [x] Enhance TUI message rendering with `message-renderer.mjs` formatters
|
||||
## Phase 1: Vision Loop Integration
|
||||
- [ ] Create `/vision` TUI command to start autonomous loop
|
||||
- [ ] Connect vision-loop.mjs to TUI command handler
|
||||
- [ ] Add visual feedback for vision loop status
|
||||
- [ ] Add abort mechanism (ESC key)
|
||||
|
||||
## Progress
|
||||
- [x] Create Implementation Plan
|
||||
- [x] Backup `qwen-oauth.mjs` and `bin/opencode-ink.mjs`
|
||||
- [x] Update `qwen-oauth.mjs`:
|
||||
- [x] Import `fetchWithRetry`
|
||||
- [x] Add `systemPrompt` support to `sendMessage`
|
||||
- [x] Wrap `sendVisionMessage` with retry logic
|
||||
- [x] Update `bin/opencode-ink.mjs`:
|
||||
- [x] Import `getSystemPrompt` and `fetchWithRetry`
|
||||
- [x] Refactor `handleSubmit` to use dynamic system prompt
|
||||
- [x] Update `callOpenCodeFree` to use `fetchWithRetry`
|
||||
- [x] Apply `formatSuccess`/`formatError` to file save output
|
||||
- [ ] User Verification of functionality
|
||||
## Phase 2: Course Correction Integration
|
||||
- [ ] Integrate course-correction.mjs into command execution
|
||||
- [ ] Add automatic retry on failure
|
||||
- [ ] Add verification after each action
|
||||
|
||||
## Phase 3: Fix Current Issues
|
||||
- [ ] Fix Playwright path resolution (ensure absolute paths work)
|
||||
- [ ] Test end-to-end: "go to google and search for X"
|
||||
- [ ] Test desktop automation: "open telegram and send message"
|
||||
|
||||
## Phase 4: Polish
|
||||
- [ ] Add /computer command for quick access
|
||||
- [ ] Improve IQ Exchange pattern matching
|
||||
- [ ] Add real-time execution output feedback
|
||||
|
||||
Reference in New Issue
Block a user