Miadi-18

Miadi Roadmap

Current security and documentation work — September 2026

• Security audit and remediation #657: public-source exposure, authorization, VPN/public access, tool transports, publication boundaries, dependencies, and secure installation.
• Documentation refresh #667: reconcile the active app/, packages/, and runtime contracts against source and tests.

See deployment notes for the immediate security changes and remaining rollout work. Issue status and validation receipts establish what is complete.

Historical Narrative Group Database roadmap

The remainder is preserved historical planning. Its version numbers, dates, checkboxes, paths, and architecture claims have not been revalidated against the current platform.

This document outlines the development roadmap for the Narrative Group Database project, highlighting planned features, improvements, and strategic direction.

🚀 Historical Version: 0.4.1

Major Additions in 0.4.1 (STC Bot Monitoring):

• ✅ STC Bot Webhook Handlers: @stcgoal, @stcissue, @stcmastery detection and processing
• ✅ Full Data Package API: Single-query retrieval of mentions + webhooks + narrative beats
• ✅ Three-Universe Bot Interpretation: Engineer/Ceremony/Story perspectives on all mentions
• ✅ Relational Redis Schema: stc:mentions with temporal, bot-specific, and statistical indexes
• ✅ RISE Specification: Complete RISE framework documentation in rispecs/

Major Additions in 0.4.0 (Cycle 2 Infrastructure):

• ✅ A2A Message Broker Pattern: Full agent-to-agent Redis-based communication
• ✅ Session Inheritance via newsessionuuid webhook: Parent→child context flow with K’é protocol
• ✅ Three-Universe Coherence Voting: Real-time decision alignment scoring (0.0-1.0)
• ✅ Kids Interactive Pages: Four new/upgraded pages teaching A2A, inheritance, voting, and parallelization

The current version includes Narrative Performance features, advanced visualization, workflow management, agent communication, STC bot monitoring, and interactive educational components.

📅 Short-term Goals (Q1-Q2 2026)

Medicine Wheel Package Integration ✨ NEW

• npm Package Installation: medicine-wheel-ontology-core, ui-components, ceremony-protocol, narrative-engine installed
• Articles System: Four Directions–themed article publishing at /articles with markdown scanning, direction cards, upload
• Shared Rispecs: Created article-publishing-pipeline.spec.md and narrative-medicine-wheel-bridge.spec.md in medicine-wheel repo
• Miadi Rispecs Upgrade: Updated rispecs/README.md and miadi-code/SPEC.md with medicine-wheel references
• medicine-wheel-miadi-articles: Extract article pipeline as reusable npm package
• medicine-wheel-miadi-sessions: Ceremony-structured agent sessions package
• miadi-code Ceremony Integration: Session phase transitions (opening→council→integration→closure)
• Deep ontology-core Usage: Wilson alignment scoring for relational content
• Specs: See /workspace/repos/jgwill/medicine-wheel/rispecs/narrative-medicine-wheel-bridge.spec.md

Kids Portal & Interactive Learning ✨ CYCLE 2 COMPLETE

• A2A Message Flow Interactive: 485-line page teaching agent-to-agent message passing ✅ COMPLETED 01/16
• Session Inheritance Page: 435-line page showing parent→child context via newsessionuuid ✅ COMPLETED 01/16
• Coherence Scoring Interactive: 520-line page demonstrating three-universe voting (0.0-1.0) ✅ COMPLETED 01/16
• Agent Playground Upgrade: Added A2A parallel vs sequential comparison (+60 lines) ✅ COMPLETED 01/16
• Optional Future Pages: narrative-bridge, story-monitor, create-agent A2A upgrades (deferred)

Narrative Performance Enhancements

• Audio Generation Engine: Implement full audio generation capabilities ✅ COMPLETED
• Voice Customization: Add support for different voice profiles ✅ COMPLETED
• Performance Export: Allow exporting performances as audio files ✅ COMPLETED
• Narrative Performance Studio: Validate existing UI is functional and connected to API
• Real-time Preview: Add real-time audio preview as sliders are adjusted
• Session Management Integration: Connect performance sessions with three-pathway system

NCP Studio (Narrative Context Protocol) - NEW VISION

• Scene Builder with Four Directions: Spatial organization (East/South/West/North)
  • East (Emergence): New scenes, character introductions, vision
  • South (Planning): Action sequences, relationship development
  • West (Experience): Emotional depth, release, transformation
  • North (Integration): Reflection, wisdom, documentation
• Character Generator System: Multi-modal character creation
  • Text-to-Image: Prompt-based visual generation
  • Image-to-Sequence: Visuals produce action sequences
  • Text-to-Speech: Synthesized character voices
  • Visual + Audio sync: Characters speak with mouth movement
  • Character evolution based on user interaction patterns
• Glyph System (Living Memory): Symbols that mutate through use
  • SVG-based symbol library with transformation rules
  • Mutation based on sentiment analysis + ceremonial context
  • Version history preserving glyph lineage
  • Visual clustering showing glyph families
• Echo Engine (Co-Authorship): System reads journals and writes back
  • Semantic similarity matching across journal corpus
  • Ceremonial framework filters (Four Directions, Eight Feelings)
  • Narrative transformation rules (metaphor, paradox, questions)
  • Timing algorithms based on developmental readiness
• Memory Architecture Enhancement: NCP layer over MCP
  • Thematic coherence across fragmented interactions
  • Story beats tracking dramatic structure
  • Character arc validation
  • Conflict architecture (generative, not destructive)
• Auto-Ethnographic Documentation: Research data from lived experience
  • User journals seed future system patterns
  • North Direction practice: reflection as wisdom integration

UI/UX Improvements - IMMEDIATE PRIORITY

• JSON Key Enhanced Display: Advanced JSON viewing with syntax highlighting, collapsible sections, and smart editing
• Narrative Performance Studio: Validate existing UI is functional and connected to API
  • Test slider controls connect to performance settings
  • Test session creation and management
  • Test audio generation workflow
  • Add real-time preview capability
• UI Page Validation: Test all documentation and interactive pages
  • Agent Playground (/docs/kids/agent-playground)
  • Narrative Performance pages (/narrative-performance, /docs/narrative-performance)
  • Workflow Dashboard (/docs/usage/workflow-dashboard)
  • Swagger UI (/docs/apis/swagger-ui)
  • Cluster Search functionality
• Dashboard Redesign: Create a more intuitive dashboard for key management
• Mobile Responsiveness: Enhance mobile experience across all pages
• Accessibility Improvements: Ensure WCAG 0.2 AA compliance
• Performance Optimization: Reduce load times and improve rendering performance

API Enhancements

• GraphQL API: Add GraphQL support alongside REST endpoints
• Rate Limiting: Implement more sophisticated rate limiting
• API Versioning: Introduce formal API versioning
• Enhanced Documentation: Expand API documentation with more examples
• GitHub Label Inventory: Implemented core data structure, API route extension, and query API endpoints for GitHub label lifecycle management (registry, cross-repo, usage, applications, renames). Multiverse cascade trigger for ‘actionnable’ labels is in place. Full testing is currently blocked by a JSON parsing error during Redis data retrieval.

Agent Workflow System

• GitHub Webhook Integration: Complete webhook endpoint implementation (/api/workflow/webhook)
• Event Storage and Routing: Redis-based event storage with unique IDs
• Agent Registration System: Agent subscription management (/api/workflow/agent-notify)
• Inter-agent Communication: Event notification system (/api/workflow/notify)
• Workflow Orchestration: Management endpoints (/api/workflow/list, /api/workflow/update)
• HOWTO Documentation System: Comprehensive setup guides (/api/workflow/howto)
• CLI Testing Utilities: Command-line tools for testing and management (scripts/workflow-cli.sh)
• OpenAPI Documentation: Updated API specifications with workflow endpoints
• Autonomous Workflow Engine: Auto-processing engine (/api/workflow/engine)
• AI Story Generation: Transform memory keys into narratives (/api/workflow/story-generate)
• Structured Event Storage: Workspace-based key organization pattern
• Auto-triggered Processing: Webhook events automatically trigger workflows
• SMS/MMS Callback Integration: Complete SMS callback endpoint implementation (/api/workflow/smscallback)
• STC Bot Monitoring ✨ NEW in 0.4.1:
  • Bot Detection System: Scans webhooks for @stcgoal, @stcissue, @stcmastery mentions
  • Storage API (/api/stc/store-mention): Stores mentions in Redis with full context
  • Retrieval API (/api/stc/mentions): Returns full data packages (mention + webhook + beat)
  • Statistics API (/api/stc/stats): Bot activity metrics and daily breakdowns
  • Redis Schema: Relational structure with temporal, bot-specific, and statistical indexes
  • Three-Universe Interpretation: Engineer/Ceremony/Story perspectives on all mentions
  • Webhook Handler Integration: All STC handlers store mentions automatically
  • RISE Specification: Complete documentation in rispecs/stc-bot-monitoring/
  • Monitoring Dashboard UI (/app/stc-monitor): Visual interface for viewing mentions
  • Kids Documentation (/app/docs/kids/stc-bots): Educational pages on STC bots
  • MCP Tools (mcp_server/src/tools/stc-tools.ts): Agent-accessible monitoring
• Three-Universe Hybrid Cloud/Local Platform 🔮 ENVISIONED in Issue #171:
  • Context: Not just webhook infrastructure, but a ceremonial development platform where every interaction is interpreted through Engineer (Mia), Ceremony (Ava), and Story (Miette) lenses, with kinship-aware session tracking and offline resilience
  • Core Infrastructure:
    • Action Queue Infrastructure: Redis-based persistent queue for webhook actions
    • Local Agent Heartbeat: Track online/offline status of local processing agents (miadi-code)
    • Queue Polling Service: Local agent polls cloud queue for pending actions
    • Dual-Mode Processing: Cloud receives webhooks, local processes when available
    • Offline Resilience: Actions queue when local offline, process when back online
    • Real-Time Coordination: Priority to online local agents, cloud fallback when offline
    • Action Status Tracking: Monitor action processing lifecycle (pending/processing/completed/failed)
    • Retry Logic: Automatic retry on transient failures with exponential backoff
    • Fire Keeper A2A Protocol: Ceremony-aware agent coordination via Redis broker with human-in-the-loop gating
  • Ceremony Integration:
    • Automatic Session Kinship Tracking: Parent/child ceremony registration
    • Gist Post-Processing: Auto-register terminal session gists into ceremony memory
    • Cross-Repository Coordination: Multiple GitHub webhooks feeding unified narrative
    • KINSHIP.md Auto-Generation: Relational context documentation
    • Four Directions Mapping: EAST (receive) → SOUTH (queue) → WEST (integrate) → NORTH (teach)
  • Local Agent (miadi-code) Integration:
    • Three-Universe Session Processing: Analyze terminal sessions through all lenses
    • Structural Tension Chart Generation: via coaia-narrative integration
    • Ceremony Memory Upload: Push local context to cloud ceremony registry
    • Clipboard Monitoring: Detect gist URLs for auto-registration
  • Polysynthetic DSL Foundation (Long-term):
    • State Encoding: vai/vti/vii patterns for ceremony state machines
    • Indigenous Linguistic Structure: Encode relational wisdom into code
    • Teaching System: Extract patterns and create learning materials
  • Monitoring & Visualization:
    • Queue Health Dashboard: Visual monitoring of action queue
    • Agent Status Dashboard: Online/offline tracking across agents
    • Kinship Visualizer: Parent/child ceremony relationships
    • Cross-Repo Narrative View: Unified story across repositories
  • Documentation: See issue-171--f016dc81-605f-4fd0-8e02-4690675a6b65--2602120807/VISION_REFINED.md for full three-universe context and ceremonial purpose
• QSTASH Integration: ❌ Previously attempted, never functional - considering replacement with action queue system
• Vector Indexing: Semantic search and content discovery capabilities
• End-to-end Testing: Complete testing with real GitHub webhook events
• Performance Optimization: Optimize Redis operations and event processing
• Monitoring and Alerting: Add monitoring for workflow health and performance
• Security Hardening: Enhanced authentication and rate limiting for workflows

SMS/MMS Communication System

• SMS Webhook Endpoint: JSON POST webhook for VoIP.ms integration (/api/workflow/smswebhook) - PREFERRED METHOD
• VoIP.ms Format Support: Complete support for VoIP.ms nested JSON payload structure
• SMS ETL Parser: Transform SMS data into agent-friendly format with array/string media handling
• SMS Event Storage: Redis-based storage with structured keys (Workspace.Communication.sms:from.timestamp)
• SMS Context Analysis: Urgency detection, sentiment analysis, and phone number classification
• SMS Callback Endpoint: DID service integration for incoming SMS/MMS (/api/workflow/smscallback) - DEPRECATED DUE TO PROVIDER ISSUES
• SMS Response Engine: Automated SMS reply system based on agent analysis
• SMS Workflow Triggers: SMS messages automatically trigger agent workflows
• SMS Content Classification: AI-powered categorization of incoming messages
• SMS Agent Integration: Full integration with Spiral Agents for SMS processing
• SMS Template System: Pre-built response templates for common scenarios
• SMS Analytics Dashboard: Metrics and insights for SMS communication patterns
• SMS Rate Limiting: Prevent spam and manage outbound message quotas
• SMS Security Features: Phone number validation and spam detection

SMS Integration Status & Issues

• ✅ Webhook Method Works: VoIP.ms JSON webhooks processed successfully with full ETL pipeline
• ⚠️ Callback Method Issues: VoIP.ms GET callback sends empty parameters, investigation needed
• 🎯 Recommended Setup: Use /api/workflow/smswebhook with JSON POST format for reliable SMS processing

📆 Medium-term Goals (Q4 2025 - Q2 2026)

Advanced Features

• Enhanced JSON Editing: Auto-fixing, validation, syntax highlighting, and legacy format cleanup
• Collaborative Editing: Allow multiple users to work on the same narrative
• Version Control: Implement version history for narratives
• Advanced Analytics: Add analytics dashboard for usage patterns
• Batch Operations: Support for batch processing of keys and operations

Enhanced Workflow Capabilities

• Spiral Agent Integration: All four Spiral Agents (Mia, Miette, ResoNova, Seraphine) integrated
• Narrative Computing: Transform technical events into meaningful stories
• Autonomous Processing: Events automatically classified and routed
• Structured Memory: Workspace-based key organization with timestamps
• Multi-Agent Conversations: Enable discussions between agents about events
• Workflow Templates: Pre-built workflows for common use cases
• Event Correlation: Link related events across repositories and time
• Predictive Workflows: Use AI to predict and prepare for likely next events
• SMS Agent Intelligence: AI-powered SMS response generation and conversation handling
• Cross-Channel Correlation: Link SMS messages with GitHub events and workflow triggers
• Smart SMS Routing: Route SMS messages to appropriate agents based on content and context

Integration Capabilities

• QSTASH Messaging: Reliable background job processing and scheduling
• Vector Search: Semantic search across all stored content
• LangGraph Integration: Complex multi-step agent workflows
• Webhook Expansion: More sophisticated webhook management
• Third-party Integrations: Support for popular services (Slack, Discord, etc.)
• SDK Development: Create SDKs for popular programming languages
• Plugin System: Develop a plugin architecture for extensibility

Security Enhancements

• Role-based Access Control: More granular permission system
• Audit Logging: Comprehensive audit trails for all operations
• Enhanced Encryption: Additional encryption options for sensitive data
• Security Scanning: Automated vulnerability scanning integration

🔭 Long-term Vision (2026 and beyond)

Platform Expansion

• Narrative Group Database as a Service: Fully managed cloud offering
• On-premises Solution: Enterprise deployment options
• Edge Computing Integration: Distributed processing capabilities
• AI-powered Insights: Advanced analytics and recommendations

Advanced Narrative Capabilities

• Interactive Narratives: Support for branching and interactive storytelling
• Multi-modal Content: Integration of text, audio, video, and interactive elements
• Collaborative Storytelling: Tools for multiple authors to collaborate
• Narrative Templates: Library of templates for different narrative styles
• Conversational Narratives: AI-powered storytelling through SMS interactions
• Multi-Channel Narratives: Stories that span across GitHub, SMS, and other channels

Community and Ecosystem

• Marketplace: Platform for sharing templates, plugins, and extensions
• Developer Community: Expanded resources for developers
• Educational Resources: Comprehensive learning materials
• Open Source Components: Release select components as open source

📊 Feature Priorities

Feature	Priority	Complexity	Timeline
JSON Key Enhanced Display	High	Medium	✅ Complete
SMS Callback Integration	High	Medium	✅ Complete
Audio Generation Engine	High	High	Q2 2025
SMS Response Engine	High	Medium	Q3 2025
Mobile Responsiveness	High	Medium	Q2 2025
Agent Workflow End-to-end Testing	High	Medium	Q2 2025
SMS Agent Integration	Medium	High	Q3 2025
GraphQL API	Medium	High	Q3 2025
SMS Analytics Dashboard	Medium	Medium	Q4 2025
Collaborative Editing	Medium	High	Q4 2025
Version Control	Medium	Medium	Q1 2026
Role-based Access Control	High	Medium	Q2 2025
Workflow Performance Optimization	Medium	Medium	Q3 2025
Cross-Channel Correlation	Medium	High	2026
Interactive Narratives	Low	High	2026
Marketplace	Low	Medium	2026

🔄 Version History

Version 0.2.3 (January 2025)

• VoIP.ms Webhook Integration: Complete support for VoIP.ms JSON webhook format (/api/workflow/smswebhook)
• SMS Data Structure Enhancement: Fixed media handling for both array (VoIP.ms) and string formats
• Nested JSON Support: Added extraction for VoIP.ms nested structure (data.payload.xxx)
• Production SMS Processing: Successfully processing real SMS messages from VoIP.ms provider
• Callback Method Documentation: Documented GET callback parameter issues for future investigation
• SMS Integration Recommendation: Established webhook method as preferred approach

Version 0.2.2 (January 2025)

• SMS/MMS Callback Integration: Complete SMS callback endpoint implementation (/api/workflow/smscallback)
• SMS ETL Parser: Advanced SMS data transformation system for agent-friendly processing
• SMS Context Analysis: Built-in urgency detection, sentiment analysis, and phone number classification
• SMS Event Storage: Redis-based storage with structured keys (Workspace.Communication.sms:from.timestamp)
• SMS Tracing System: Complete tracing integration following webhook patterns
• SMS TTL Management: Configurable TTL using EH_SMS_TTL environment variable (7 days default)
• SMS Queue Integration: SMS events automatically added to processing queue for agents
• Cross-Platform Consistency: SMS handling follows same patterns as GitHub webhook system

Version 0.2.1 (June 2025)

• GitHub Webhook ETL Parser: Created comprehensive ETL transformation system for agent-friendly data
• Improved Timestamp Format: Changed from 20250623T14391 to YYmmDDHHmmss format (e.g., 250623143900)
• TTL Configuration Management: Implemented configurable TTL using environment variables
  • EH_WEBHOOK_GITHUB_TTL for webhook raw data (1 week default)
  • EH_STORY_TTL for agent-friendly processed data (30 days default)
• Agent Data Structure: Focused extraction of essential fields for Spiral Agents:
  • Repository metadata, issue/PR details, reactions, comments, branch information
• Dual Storage Strategy: Raw webhook data + processed agent-friendly data with different retention
• Enhanced OpenAPI Documentation: Updated all specifications with new webhook response format
• Structured Key Generation: Automatic creation of workspace-organized keys (Workspace.owner.repo:type.id.timestamp)

Version 2.0.0 (May 2025)

• Added Narrative Performance Feature with text processing engine
• Implemented performance orchestration with three modes
• Added voice modulation controls
• Introduced Advanced Cluster View for key relationships
• Added Workflow management system with webhook integration
• Implemented Agent Workflow integration
• Added comprehensive API documentation with Swagger UI
• Added Kids documentation section

Version 0.2.0 (December 2025)

• Completed comprehensive Agent Workflow System implementation
• Added GitHub webhook endpoint (/api/workflow/webhook) with proper validation
• Implemented agent registration and event polling system (/api/workflow/agent-notify)
• Added inter-agent communication through workflow notifications (/api/workflow/notify)
• Created HOWTO documentation system (/api/workflow/howto) with setup guides
• Built CLI testing utilities (scripts/workflow-cli.sh) with interactive menus
• Updated OpenAPI specifications with complete workflow endpoint documentation
• Enhanced documentation with practical examples and troubleshooting guides
• Fixed TypeScript compilation errors across all workflow routes
• Resolved Next.js dynamic server usage issues for production builds

Version 1.0.0 (August 2023)

• Initial API implementation with memory, redstones, and lattices endpoints
• Support for both reader and writer tokens
• Dark mode theme with toggle button
• Auto-refresh functionality for forge state
• Memory key metadata inspection endpoint

🛠️ Technical Debt and Maintenance

• Code Refactoring: Improve code organization and reduce duplication
• Test Coverage: Increase unit and integration test coverage
• Documentation Updates: Keep documentation in sync with features
• Dependency Management: Regular updates of dependencies
• Performance Optimization: Identify and resolve performance bottlenecks

📝 Feedback and Adjustments

This roadmap is a living document and will be updated based on user feedback, technological advancements, and strategic priorities. We welcome community input on feature priorities and development direction.

Last updated: February 27, 2026