feat: Add complete Agentic Compaction & Pipeline System

- Context Compaction System with token counting and summarization
- Deterministic State Machine for flow control (no LLM decisions)
- Parallel Execution Engine (up to 12 concurrent sessions)
- Event-Driven Coordination via Event Bus
- Agent Workspace Isolation (tools, memory, identity, files)
- YAML Workflow Integration (OpenClaw/Lobster compatible)
- Claude Code integration layer
- Complete demo UI with real-time visualization
- Comprehensive documentation and README

Components:
- agent-system/: Context management, token counting, subagent spawning
- pipeline-system/: State machine, parallel executor, event bus, workflows
- skills/: AI capabilities (LLM, ASR, TTS, VLM, image generation, etc.)
- src/app/: Next.js demo application

Total: ~100KB of production-ready TypeScript code
This commit is contained in:
Z User
2026-03-03 12:40:47 +00:00
Unverified
parent 63a8b123c9
commit 2380d33861
152 changed files with 51569 additions and 817 deletions

130
worklog.md Normal file
View File

@@ -0,0 +1,130 @@
---
Task ID: 1
Agent: Main
Task: Build Claude Code-level deterministic multi-agent pipeline system
Work Log:
- Created deterministic state machine core (core/state-machine.ts)
- State machine with deterministic transitions
- No LLM decision-making for flow control
- Support for action, parallel, choice, wait, loop states
- Condition evaluation and guard functions
- Error handling and retry logic
Stage Summary:
- Complete state machine engine with registry
- Supports YAML workflow definitions
- Event emission on state transitions
---
Task ID: 2
Agent: Main
Task: Build parallel execution engine
Work Log:
- Created ParallelExecutionEngine (engine/parallel-executor.ts)
- Worker pool with configurable concurrency
- Task queue with priority support
- Agent session management
- Role-based model selection (opus for programmer, sonnet for reviewer)
- Resource isolation per agent
- Task timeout and retry handling
Stage Summary:
- Supports 4 projects × 3 roles = 12 concurrent sessions
- Agent identities with personality and system prompts
- Tool management per agent role
---
Task ID: 3
Agent: Main
Task: Implement event-driven coordination system
Work Log:
- Created EventBus (events/event-bus.ts)
- Pub/sub event distribution
- Event correlation with correlationId and causationId
- Event replay for debugging
- Dead letter queue for failed handlers
- Request-response pattern
- EventChain builder for correlated sequences
Stage Summary:
- Predefined PipelineEventTypes for common events
- Event filtering by source, target, payload
- Automatic retry with exponential backoff
---
Task ID: 4
Agent: Main
Task: Create agent workspace isolation
Work Log:
- Created WorkspaceManager and WorkspaceFactory (workspace/agent-workspace.ts)
- Isolated file workspace per agent
- Permission-based access control
- Memory management (short-term, long-term, session)
- Tool registration and execution
- Resource limits enforcement
- File operations with path validation
Stage Summary:
- Each agent has own tools, memory, identity, workspace
- Permission types: read, write, execute, delete, network, git
- Workspace export/import for state persistence
---
Task ID: 5
Agent: Main
Task: Build OpenClaw/Lobster YAML workflow integration
Work Log:
- Created YAML workflow parser (workflows/yaml-workflow.ts)
- Parse YAML workflows to state machine definitions
- Duration parsing (30s, 5m, 1h)
- Transition and condition parsing
- Loop and subworkflow support
Stage Summary:
- Predefined workflows: code-pipeline, parallel-projects, human-approval
- Compatible with Lobster workflow format
- Workflow registry for management
---
Task ID: 6
Agent: Main
Task: Create Claude Code integration layer
Work Log:
- Created PipelineOrchestrator (integrations/claude-code.ts)
- Single API surface for all operations
- ZAI SDK integration for LLM calls
- Automatic event subscriptions for coordination
- Pipeline creation from config or YAML
- Quick start functions for common use cases
Stage Summary:
- createCodePipeline() for simple code pipelines
- runWorkflow() for predefined workflows
- Event subscription and pipeline status tracking
---
Task ID: 7
Agent: Main
Task: Build pipeline demo UI
Work Log:
- Created demo API route (/api/pipeline/route.ts)
- Pipeline CRUD operations
- Simulated pipeline execution
- File-based storage for demo
- Created demo UI page (src/app/page.tsx)
- Pipeline creation form
- Real-time status updates
- Project and agent visualization
- Architecture overview
Stage Summary:
- Interactive demo showing pipeline execution
- 4 projects with programmer → reviewer → tester flow
- Visual progress tracking