feat: Integrated Vision & Robust Translation Layer, Secured Repo (removed keys)

This commit is contained in:
Gemini AI
2025-12-15 04:53:51 +04:00
Unverified
parent a8436c91a3
commit 2407c42eb9
38 changed files with 7786 additions and 3776 deletions

View File

@@ -1,20 +1,22 @@
# Task: Enhance AI Communication Patterns
# Full Computer Use Integration - Pixel Perfect
## Objectives
- [x] Integrate `agent-prompt.mjs` for dynamic system prompts
- [x] Implement `fetchWithRetry` for robust API calls
- [x] Enhance TUI message rendering with `message-renderer.mjs` formatters
## Phase 1: Vision Loop Integration
- [ ] Create `/vision` TUI command to start autonomous loop
- [ ] Connect vision-loop.mjs to TUI command handler
- [ ] Add visual feedback for vision loop status
- [ ] Add abort mechanism (ESC key)
## Progress
- [x] Create Implementation Plan
- [x] Backup `qwen-oauth.mjs` and `bin/opencode-ink.mjs`
- [x] Update `qwen-oauth.mjs`:
- [x] Import `fetchWithRetry`
- [x] Add `systemPrompt` support to `sendMessage`
- [x] Wrap `sendVisionMessage` with retry logic
- [x] Update `bin/opencode-ink.mjs`:
- [x] Import `getSystemPrompt` and `fetchWithRetry`
- [x] Refactor `handleSubmit` to use dynamic system prompt
- [x] Update `callOpenCodeFree` to use `fetchWithRetry`
- [x] Apply `formatSuccess`/`formatError` to file save output
- [ ] User Verification of functionality
## Phase 2: Course Correction Integration
- [ ] Integrate course-correction.mjs into command execution
- [ ] Add automatic retry on failure
- [ ] Add verification after each action
## Phase 3: Fix Current Issues
- [ ] Fix Playwright path resolution (ensure absolute paths work)
- [ ] Test end-to-end: "go to google and search for X"
- [ ] Test desktop automation: "open telegram and send message"
## Phase 4: Polish
- [ ] Add /computer command for quick access
- [ ] Improve IQ Exchange pattern matching
- [ ] Add real-time execution output feedback