Project Automation Audit Results
Post-implementation workflow audit covering lifecycle docs, project skills, agent prompts, snippets, templates, routing, report persistence, and human-gate behavior — per Spec Section 3.
Gaps Found
| # | Severity | Area | File | Issue |
|---|---|---|---|---|
| A1 | High | Skills list | Forge/Configs/Agents/Forge_Chat_Prompt.md | Skills List missing Project_Requirements_Eval, Project_Spec_Eval, Project_Plan_Eval (lifecycle eval skills exist on disk but are not discoverable via the Chat prompt’s skills list) |
| A2 | High | Routing | Forge/Configs/Agents/Task_Runner_Prompt.md | Task Runner routes _Eval phases (Requirements_Eval, Spec_Eval, Plan_Eval, Extract_Eval) to Project Evaluator — should route to Project Thinker per Spec Section 4 |
| A3 | Medium | Templates | Forge/Skills/Project_Create/templates/Evaluation_Template.md | Stale template still exists (renamed to Eval_Template.md in Plan 4/6; should have been deleted) |
| A4 | Medium | Templates | Forge/Skills/Project_Create/SKILL.md | Available Templates table lists stale Evaluation_Template.md as “Eval (appended to State)” — should only list Eval_Template.md |
| A5 | Medium | Guide | Forge/Project_Automation_Guide.md | Agent Roles table assigns Extract to Project Evaluator — Spec Section 4 assigns Extract to Project Thinker |
Fixes Applied
| # | Action taken |
|---|---|
| A1 | Added Project_Requirements_Eval, Project_Spec_Eval, Project_Plan_Eval, and Write_Typescript to Skills List in Forge_Chat_Prompt.md |
| A2 | Updated Task Runner routing table: _Eval phases now route to Project Thinker (independent reviewer); Eval still routes to Project Evaluator (fresh session). Also fixed the procedure step 2b text to match. |
| A3 | Trashed Evaluation_Template.md |
| A4 | Removed Evaluation_Template.md row from Project_Create Available Templates table; corrected Verification_Template.md description |
| A5 | Removed “Extract” from Project Evaluator’s “Used In” column in Agent Roles table; also fixed the “What Agents Do” bullet list |
Additional fix: Removed stale evaluation_template sidebar entry from astro.config.mjs (broke build after trashing the file).
Remaining Open Issues
None. All identified gaps have been fixed and verified by build.