qwen_roadmap_auditor_prototype
Qwen Roadmap Auditor (Prototype)
- Category: discovered
- Tags: github, community
- Version: 1.0
- Author: walid
- Downloads: 0
- GitHub stars: 4
- Updated: 2025-11-21
Download the latest version (v1.0) from this page.
SKILL.md
---
name: qwen_roadmap_auditor_prototype
description: Qwen Roadmap Auditor (Prototype)
version: 1.0
author: 0102_wre_team
agents: [qwen]
dependencies: [pattern_memory, libido_monitor]
domain: autonomous_operations
---
# Qwen Roadmap Auditor (Prototype)
---
# Metadata (YAML Frontmatter)
skill_id: qwen_roadmap_auditor_v1_prototype
name: qwen_roadmap_auditor
description: Audit roadmaps for completion status, missing MCP integrations, outdated skills references
version: 1.0_prototype
author: 0102_design
created: 2025-10-22
agents: [qwen, gemma]
primary_agent: qwen
intent_type: DECISION
promotion_state: prototype
pattern_fidelity_threshold: 0.90
test_status: needs_validation
# MCP Orchestration
mcp_orchestration: true
breadcrumb_logging: true
owning_dae: doc_dae
execution_phase: 1
next_skill: qwen_roadmap_updater_v1_prototype
# Input/Output Contract
inputs:
- roadmap_files: "List of roadmap markdown files to audit"
- audit_criteria: "Completion status, MCP integration, skills references, WSP compliance"
outputs:
- data/roadmap_audits/{roadmap}_audit_report.json: "Detailed audit findings"
- data/roadmap_audits/summary.json: "Cross-roadmap summary"
- execution_id: "Unique execution identifier for breadcrumb tracking"
# Dependencies
dependencies:
data_stores: []
mcp_endpoints:
- endpoint_name: holo_index
methods: [semantic_search]
gemma_wardrobe:
- wardrobe_id: gemma_roadmap_tracker
purpose: "Pattern matching for completion/TODO detection"
throttles: []
required_context:
- roadmap_pattern: "*.md files in docs/, modules/*/docs/, WSP_framework/"
# Metrics Configuration
metrics:
pattern_fidelity_scoring:
enabled: true
frequency: every_execution
scorer_agent: gemma
write_destination: modules/infrastructure/wre_core/recursive_improvement/metrics/qwen_roadmap_auditor_fidelity.json
promotion_criteria:
min_pattern_fidelity: 0.90
min_outcome_quality: 0.85
min_execution_count: 100
required_test_pass_rate: 0.95
---
# Qwen Roadmap Auditor
**Purpose**: Audit roadmaps across codebase for completion status, missing integrations, and update needs
**Intent Type**: DECISION
**Agent**: Qwen (strategic analysis), Gemma (pattern matching via roadmap_tracker wardrobe)
---
## Task
You are Qwen, a roadmap auditor. Your job is to scan all roadmaps in the codebase and identify:
1. **Incomplete items** (TODO, In Progress, Not Started)
2. **Missing MCP integrations** (roadmap mentions MCP but no integration found)
3. **Outdated skills references** (references old skills that have been replaced)
4. **WSP non-compliance** (roadmap doesn't follow WSP documentation standards)
5. **Completion estimates** (how much of the roadmap is done?)
**Key Capability**: Cross-file analysis, pattern detection, completion tracking
---
## Instructions (For Qwen Agent)
### 1. DISCOVER ROADMAP FILES
**Rule**: Find all roadmap markdown files in codebase
**Expected Pattern**: `roadmaps_discovered=True`
**Search Patterns**:
```python
roadmap_patterns = [
"**/*ROADMAP*.md",
"**/*roadmap*.md",
"**/IMPLEMENTATION_PLAN*.md",
"**/PROJECT_PLAN*.md",
"**/PHASE*.md"
]
```
**Steps**:
1. Search codebase for roadmap files using glob patterns
2. Read each file to confirm it's actually a roadmap (not just named that way)
3. Extract metadata: title, date, phase structure
4. Log: `{"pattern": "roadmaps_discovered", "value": true, "total_roadmaps": N}`
---
### 2. ANALYZE COMPLETION STATUS
**Rule**: For each roadmap, calculate completion percentage
**Expected Pattern**: `completion_analyzed=True`
**Completion Indicators** (use Gemma roadmap_tracker wardrobe):
```python
# Gemma detects these patterns
complete_patterns = [
"✅", "[x]", "[X]", "DONE", "COMPLETE", "IMPLEMENTED"
]
incomplete_patterns = [
"⏸️", "[ ]", "TODO", "IN PROGRESS", "NOT STARTED", "PENDING"
]
phase_patterns = [
r"## Phase (\d+):.*Status:?\s*(COMPLETE|INCOMPLETE|IN PROGRESS)"
]
```
**Steps**:
1. Load Gemma with `roadmap_tracker` wardrobe
2. For each roadmap, extract all task items
3. Classify each item as complete/incomplete/in-progress
4. Calculate percentages:
- `complete_pct = (complete_count / total_count) * 100`
- `in_progress_pct = (in_progress_count / total_count) * 100`
5. Log: `{"pattern": "completion_analyzed", "value": true, "avg_completion": 67.3}`
---
### 3. DETECT MISSING MCP INTEGRATIONS
**Rule**: Find roadmaps that mention MCP but lack integration code
**Expected Pattern**: `mcp_integration_checked=True`
**Detection Logic**:
```python
# Qwen strategic analysis
def check_mcp_integration(roadmap):
# Does roadmap mention MCP?
mentions_mcp = "mcp" in roadmap.lower() or "model context protocol" in roadmap.lower()
if not mentions_mcp:
return {"required": False}
# Search for actual MCP integration files
mcp_files = holo_index.search(f"{roadmap.module_name} MCP integration")
if len(mcp_files) == 0:
return {
"required": True,
"implemented": False,
"reason": "Roadmap mentions MCP but no integration files found"
}
return {"required": True, "implemented": True}
```
**Steps**:
1. For each roadmap, check if MCP is mentioned
2. If yes, use HoloIndex to search for MCP integration files in that module
3. Flag roadmaps with missing integrations
4. Log: `{"pattern": "mcp_integration_checked", "value": true, "missing_integrations": N}`
---
### 4. DETECT OUTDATED SKILLS REFERENCES
**Rule**: Find roadmaps referencing old skills that have been replaced
**Expected Pattern**: `skills_references_checked=True`
**Detection Logic**:
```python
# Qwen compares roadmap references to current skills_manifest.json
def check_skills_references(roadmap):
# Load current skills manifest
with open(".claude/skills/skills_manifest.json") as f:
manifest = json.load(f)
current_skills = {s['skill_id'] for s in manifest['skills']}
# Extract skill references from roadmap
skill_refs = re.findall(r"skill_id:\s*(\w+)", roadmap.content)
outdated = []
for ref in skill_refs:
if ref not in current_skills:
outdated.append({
"referenced_skill": ref,
"status": "NOT_FOUND_IN_MANIFEST",
"suggestion": find_replacement_skill(ref, current_skills)
})
return outdated
```
**Steps**:
1. Load `.claude/skills/skills_manifest.json`
2. For each roadmap, extract skill_id references
3. Check if referenced skills exist in manifest
4. Flag outdated references with suggested replacements
5. Log: `{"pattern": "skills_references_checked", "value": true, "outdated_refs": N}`
---
### 5. CHECK WSP COMPLIANCE
**Rule**: Verify roadmap follows WSP documentation standards
**Expected Pattern**: `wsp_compliance_checked=True`
**WSP Requirements for Roadmaps**:
```python
wsp_requirements = {
"WSP_83": {
"required_sections": ["## Purpose", "## Phases", "## Status"],
"requires_doc_index": True
},
"WSP_22": {
"requires_modlog_reference": True,
"requires_date": True
},
"WSP_50": {
"requires_pre_action_verification": True # "Prerequisites" section
}
}
```
**Steps**:
1. For each roadmap, check required sections exist
2. Verify doc_index.json references roadmap (WSP 83)
3. Check for ModLog references (WSP 22)
4. Verify Prerequisites section exists (WSP 50)
5. Log: `{"pattern": "wsp_compliance_checked", "value": true, "violations": N}`
---
### 6. GENERATE AUDIT REPORT
**Rule**: Create execution-ready audit report with autonomous action plan
**Expected Pattern**: `audit_report_generated=True`
**First Principles**: How can 0102/AI_Overseer use this data?
- ✅ Executable shell scripts (pipe to bash)
- ✅ WSP 15 MPS scoring (every finding)
- ✅ Agent capability mapping (who can fix autonomously?)
- ✅ Verification commands (know if fix worked)
- ✅ Dependency graphs (what blocks what?)
- ✅ Learning feedback (store patterns for future)
**Audit Report Structure** (EXECUTION-READY):
```json
{
"audit_id": "roadmap_audit_20251022_0230",
"timestamp": "2025-10-22T02:30:00Z",
"auditor": "qwen_roadmap_auditor_v1_prototype",
"total_roadmaps": 12,
"completion_summary": {
"fully_complete_100_pct": {
"count": 3,
"roadmaps": [
{
"file": "O:/Foundups-Agent/docs/DATABASE_CONSOLIDATION_DECISION.md",
"module": "infrastructure/doc_dae",
"completion_pct": 100,
"total_items": 8,
"complete": 8,
"last_updated": "2025-10-18"
},
{
"file": "O:/Foundups-Agent/modules/infrastructure/patch_executor/ROADMAP.md",
"module": "infrastructure/patch_executor",
"completion_pct": 100,
"total_items": 12,
"complete": 12,
"last_updated": "2025-10-19"
},
{
"file": "O:/Foundups-Agent/docs/HEALTH_CHECK_SELF_HEALING_SUMMARY.md",
"module": "infrastructure/wre_core",
"completion_pct": 100,
"total_items": 6,
"complete": 6,
"last_updated": "2025-10-20"
}
]
},
"mostly_complete_75_plus": {
"count": 4,
"roadmaps": [
{
"file": "O:/Foundups-Agent/docs/GRADUATED_AUTONOMY_SYSTEM_DESIGN.md",
"module": "ai_intelligence/ai_overseer",
"completion_pct": 83.3,
"total_items": 18,
"complete": 15,
"in_progress": 2,
"not_started": 1,
"last_updated": "2025-10-21",
"blocking_items": [
"Phase 4: Test autonomous fix verification (IN PROGRESS)"
]
},
{
"file": "O:/Foundups-Agent/docs/MCP_FEDERATED_NERVOUS_SYSTEM.md",
"module": "infrastructure/mcp_manager",
"completion_pct": 77.8,
"total_items": 9,
"complete": 7,
"not_started": 2,
"last_updated": "2025-10-19",
"blocking_items": [
"Cross-MCP message routing",
"Federation protocol implementation"
]
},
{
"file": "O:/Foundups-Agent/modules/infrastructure/wre_core/WRE_SKILLS_SYSTEM_DESIGN.md",
"module": "infrastructure/wre_core",
"completion_pct": 80.0,
"total_items": 10,
"complete": 8,
"in_progress": 1,
"not_started": 1,
"last_updated": "2025-10-20"
},
{
"file": "O:/Foundups-Agent/docs/SPRINT_4_UI_TARS_STATUS.md",
"module": "platform_integration/social_media_orchestrator",
"completion_pct": 75.0,
"total_items": 12,
"complete": 9,
"in_progress": 2,
"not_started": 1,
"last_updated": "2025-10-17"
}
]
},
"partially_complete_50_75": {
"count": 3,
"roadmaps": [
{
"file": "O:/Foundups-Agent/docs/AI_COLLABORATIVE_SOCIAL_POSTING_VISION.md",
"module": "platform_integration/social_media_orchestrator",
"completion_pct": 53.3,
"total_items": 15,
"complete": 8,
"in_progress": 3,
"not_started": 4,
"last_updated": "2025-10-16",
"blocking_items": [
"MCP integration missing",
"AI delegation pipeline incomplete",
"Cross-platform posting not implemented"
]
},
{
"file": "O:/Foundups-Agent/docs/AI_OVERSEER_AUTONOMOUS_MONITORING.md",
"module": "ai_intelligence/ai_overseer",
"completion_pct": 66.7,
"total_items": 9,
"complete": 6,
"in_progress": 1,
"not_started": 2,
"last_updated": "2025-10-20"
},
{
"file": "O:/Foundups-Agent/modules/infrastructure/dae_infrastructure/docs/AUTONOMOUS_DAEMON_MONITORING_ARCHITECTURE.md",
"module": "infrastructure/dae_infrastructure",
"completion_pct": 62.5,
"total_items": 8,
"complete": 5,
"in_progress": 2,
"not_started": 1,
"last_updated": "2025-10-19"
}
]
},
"barely_started_below_50": {
"count": 2,
"roadmaps": [
{
"file": "O:/Foundups-Agent/docs/Selenium_Run_History_Mission.md",
"module": "infrastructure/foundups_selenium",
"completion_pct": 25.0,
"total_items": 8,
"complete": 2,
"not_started": 6,
"last_updated": "2025-09-15",
"issues": [
"STALE: No updates in 37 days",
"Most phases not started",
"Likely abandoned or deprioritized"
]
},
{
"file": "O:/Foundups-Agent/docs/AI_Delegation_Pipeline_Architecture.md",
"module": "platform_integration/social_media_orchestrator",
"completion_pct": 40.0,
"total_items": 10,
"complete": 4,
"in_progress": 1,
"not_started": 5,
"last_updated": "2025-10-12"
}
]
},
"average_completion_pct": 67.3,
"median_completion_pct": 71.4
},
"mcp_integration_gaps": [
{
"roadmap": "O:/Foundups-Agent/docs/AI_COLLABORATIVE_SOCIAL_POSTING_VISION.md",
"module": "platform_integration/social_media_orchestrator",
"mentions_mcp": true,
"integration_found": false,
"expected_location": "modules/platform_integration/social_media_orchestrator/mcp/",
"missing_files": [
"modules/platform_integration/social_media_orchestrator/mcp/mcp_manifest.json",
"modules/platform_integration/social_media_orchestrator/mcp/server.py"
],
"referenced_in_roadmap": "Line 45: 'MCP integration for cross-platform coordination'",
"mps_score": {
"complexity": 3,
"complexity_reason": "Moderate - create mcp/ dir + manifest + server + tool registration",
"importance": 5,
"importance_reason": "Essential - blocks AI delegation pipeline (Phase 3)",
"deferability": 5,
"deferability_reason": "Cannot defer - P0 blocker for autonomous social posting",
"impact": 4,
"impact_reason": "Major - enables cross-platform coordination",
"total": 17,
"priority": "P0"
},
"autonomous_execution": {
"capable": true,
"agent": "gemma_mcp_integrator_v1",
"confidence": 0.87,
"estimated_tokens": 150,
"estimated_time_seconds": 8,
"requires_0102_approval": true,
"execution_command": "python -m modules.infrastructure.wsp_orchestrator.src.wsp_orchestrator --skill gemma_mcp_integrator --target social_media_orchestrator --validate true"
},
"dependency_chain": {
"blocks": [
"AI_DELEGATION_PIPELINE.md (Phase 3 - AI-powered routing)",
"AI_COLLABORATIVE_SOCIAL_POSTING_VISION.md (cross-platform posting)"
],
"cascade_impact": "2 roadmaps blocked",
"priority_escalation": "P1 → P0 (blocking critical chain)"
},
"estimated_effort_hours": 3,
"recommendation": "Create MCP server for social_media_orchestrator with manifest + tool registration",
"verify_command": "test -f modules/platform_integration/social_media_orchestrator/mcp/mcp_manifest.json && test -f modules/platform_integration/social_media_orchestrator/mcp/server.py",
"success_criteria": "Both files exist + manifest validates against WSP 96 schema"
},
{
"roadmap": "O:/Foundups-Agent/docs/MCP_FEDERATED_NERVOUS_SYSTEM.md",
"module": "infrastructure/mcp_manager",
"mentions_mcp": true,
"integration_found": "PARTIAL",
"existing_files": [
"modules/infrastructure/mcp_manager/src/mcp_manager.py"
],
"missing_files": [
"modules/infrastructure/mcp_manager/mcp/federation_protocol.py"
],
"referenced_in_roadmap": "Line 78: 'Cross-MCP federation protocol'",
"mps_score": {
"complexity": 4,
"complexity_reason": "Challenging - protocol design + message routing + federation logic",
"importance": 5,
"importance_reason": "Essential - foundation for cross-MCP coordination",
"deferability": 5,
"deferability_reason": "Cannot defer - blocks social_media_orchestrator MCP integration",
"impact": 5,
"impact_reason": "Critical - enables entire MCP federation architecture",
"total": 19,
"priority": "P0"
},
"autonomous_execution": {
"capable": false,
"reason": "Complex protocol design requires 0102 architectural decisions",
"agent": "qwen_federation_architect_v1",
"confidence": 0.65,
"estimated_tokens": 800,
"estimated_time_seconds": 180,
"requires_0102_approval": true,
"execution_command": "python -m modules.infrastructure.wsp_orchestrator.src.wsp_orchestrator --skill qwen_federation_architect --design-only true"
},
"dependency_chain": {
"blocks": [
"AI_COLLABORATIVE_SOCIAL_POSTING_VISION.md (requires federation for cross-MCP coordination)",
"AI_DELEGATION_PIPELINE.md (AI routing needs federation protocol)"
],
"blocked_by": [],
"cascade_impact": "2 roadmaps directly blocked + 1 indirectly (AI_OVERSEER_AUTONOMOUS_MONITORING)",
"priority_escalation": "P1 → P0 (root blocker in dependency chain)"
},
"estimated_effort_hours": 4,
"recommendation": "Complete federation protocol implementation in mcp/ directory",
"verify_command": "test -f modules/infrastructure/mcp_manager/mcp/federation_protocol.py && python -m pytest modules/infrastructure/mcp_manager/tests/test_federation_protocol.py",
"success_criteria": "File exists + tests pass + message routing functional"
}
],
"outdated_skills_references": [
{
"roadmap": "O:/Foundups-Agent/docs/SPRINT_4_UI_TARS_STATUS.md",
"module": "platform_integration/social_media_orchestrator",
"line_number": 67,
"referenced_skill": "ui_tars_old_scheduler",
"status": "NOT_FOUND_IN_MANIFEST",
"suggested_replacement": "ui_tars_scheduler_v2_production",
"replacement_location": "modules/platform_integration/social_media_orchestrator/skills/ui_tars_scheduler/SKILL.md",
"mps_score": {
"complexity": 1,
"complexity_reason": "Trivial - sed replace",
"importance": 2,
"importance_reason": "Minor - documentation accuracy",
"deferability": 1,
"deferability_reason": "Can defer - not blocking features",
"impact": 2,
"impact_reason": "Low - only affects roadmap clarity",
"total": 6,
"priority": "P3"
},
"autonomous_execution": {
"capable": true,
"agent": "gemma_sed_patcher_v1",
"confidence": 0.98,
"estimated_tokens": 50,
"estimated_time_seconds": 2,
"requires_0102_approval": false,
"execution_command": "bash -c \"sed -i 's/ui_tars_old_scheduler/ui_tars_scheduler_v2_production/g' docs/SPRINT_4_UI_TARS_STATUS.md\""
},
"fix_command": "sed -i 's/ui_tars_old_scheduler/ui_tars_scheduler_v2_production/g' docs/SPRINT_4_UI_TARS_STATUS.md",
"verify_command": "python holo_index.py --search 'ui_tars_scheduler_v2_production' | grep -q SPRINT_4_UI_TARS_STATUS",
"success_criteria": "Exit code 0 + grep finds reference",
"rollback_command": "git checkout docs/SPRINT_4_UI_TARS_STATUS.md"
},
{
"roadmap": "O:/Foundups-Agent/docs/GRADUATED_AUTONOMY_SYSTEM_DESIGN.md",
"module": "ai_intelligence/ai_overseer",
"line_number": 123,
"referenced_skill": "autonomous_fixer_v1_prototype",
"status": "DEPRECATED",
"suggested_replacement": "qwen_autonomous_patcher_v2_production",
"replacement_location": ".claude/skills/qwen_autonomous_patcher_v2_producti