From 5984f323a6f0e3b8686dca3ff3e76b52bbbdf486 Mon Sep 17 00:00:00 2001 From: Ben Date: Mon, 7 Sep 2026 13:45:24 -0600 Subject: [PATCH] chore: execute stage 1 vault migration to hybrid architecture --- .wikiignore | 36 ++++++++++++++ inbox.md => 00-inbox/inbox.md | 0 2025-06-15.md => 01-journal/2025-06-15.md | 0 2025-06-17.md => 01-journal/2025-06-17.md | 0 2025-06-18.md => 01-journal/2025-06-18.md | 0 2025-06-19.md => 01-journal/2025-06-19.md | 0 2025-06-30.md => 01-journal/2025-06-30.md | 0 2025-07-01.md => 01-journal/2025-07-01.md | 0 2025-07-03.md => 01-journal/2025-07-03.md | 0 2025-07-06.md => 01-journal/2025-07-06.md | 0 2025-08-15.md => 01-journal/2025-08-15.md | 0 2025-08-24.md => 01-journal/2025-08-24.md | 0 2025-08-29.md => 01-journal/2025-08-29.md | 0 2025-08-30.md => 01-journal/2025-08-30.md | 0 2025-09-09.md => 01-journal/2025-09-09.md | 0 2025-09-10.md => 01-journal/2025-09-10.md | 0 .../TODO_homelab.md | 0 making.md => 02-projects/making.md | 0 todo.md => 02-projects/todo.md | 0 finance.md => 03-areas/finance.md | 0 .../home_improvement.md | 0 AI.md => 04-knowledge/topics/AI.md | 2 +- .../topics/booloumud.md | 0 chezmoi.md => 04-knowledge/topics/chezmoi.md | 2 +- cigars.md => 04-knowledge/topics/cigars.md | 0 .../topics/dev_environments.md | 0 gitea.md => 04-knowledge/topics/gitea.md | 0 homelab.md => 04-knowledge/topics/homelab.md | 4 +- .../topics/keyboards.md | 0 .../topics/opentofu.md | 0 pool.md => 04-knowledge/topics/pool.md | 0 .../topics/rclone_google_drive.md | 0 .../topics/self-hosting_AI.md | 0 tmux.md => 04-knowledge/topics/tmux.md | 0 .../topics/to_watch.md | 0 AGENTS.md | 49 +++++++++++++++++++ system/migration/stage1_map.csv | 21 ++++++++ 37 files changed, 110 insertions(+), 4 deletions(-) create mode 100644 .wikiignore rename inbox.md => 00-inbox/inbox.md (100%) rename 2025-06-15.md => 01-journal/2025-06-15.md (100%) rename 2025-06-17.md => 01-journal/2025-06-17.md (100%) rename 2025-06-18.md => 01-journal/2025-06-18.md (100%) rename 2025-06-19.md => 01-journal/2025-06-19.md (100%) rename 2025-06-30.md => 01-journal/2025-06-30.md (100%) rename 2025-07-01.md => 01-journal/2025-07-01.md (100%) rename 2025-07-03.md => 01-journal/2025-07-03.md (100%) rename 2025-07-06.md => 01-journal/2025-07-06.md (100%) rename 2025-08-15.md => 01-journal/2025-08-15.md (100%) rename 2025-08-24.md => 01-journal/2025-08-24.md (100%) rename 2025-08-29.md => 01-journal/2025-08-29.md (100%) rename 2025-08-30.md => 01-journal/2025-08-30.md (100%) rename 2025-09-09.md => 01-journal/2025-09-09.md (100%) rename 2025-09-10.md => 01-journal/2025-09-10.md (100%) rename TODO homelab.md => 02-projects/TODO_homelab.md (100%) rename making.md => 02-projects/making.md (100%) rename todo.md => 02-projects/todo.md (100%) rename finance.md => 03-areas/finance.md (100%) rename home improvement.md => 03-areas/home_improvement.md (100%) rename AI.md => 04-knowledge/topics/AI.md (91%) rename booloumud.md => 04-knowledge/topics/booloumud.md (100%) rename chezmoi.md => 04-knowledge/topics/chezmoi.md (98%) rename cigars.md => 04-knowledge/topics/cigars.md (100%) rename dev environments.md => 04-knowledge/topics/dev_environments.md (100%) rename gitea.md => 04-knowledge/topics/gitea.md (100%) rename homelab.md => 04-knowledge/topics/homelab.md (97%) rename keyboards.md => 04-knowledge/topics/keyboards.md (100%) rename opentofu.md => 04-knowledge/topics/opentofu.md (100%) rename pool.md => 04-knowledge/topics/pool.md (100%) rename rclone google drive.md => 04-knowledge/topics/rclone_google_drive.md (100%) rename self-hosting AI on lifebalance.md => 04-knowledge/topics/self-hosting_AI.md (100%) rename tmux.md => 04-knowledge/topics/tmux.md (100%) rename to watch.md => 04-knowledge/topics/to_watch.md (100%) create mode 100644 AGENTS.md create mode 100644 system/migration/stage1_map.csv diff --git a/.wikiignore b/.wikiignore new file mode 100644 index 0000000..31b74cc --- /dev/null +++ b/.wikiignore @@ -0,0 +1,36 @@ +# .wikiignore - Privacy Denylist for LLM & Web Processing +# Paths and patterns listed here will NEVER be sent to remote LLM services +# or uploaded to online extraction tools. + +# Secrets and Credentials +.env* +*secret* +*credential* +*.key +*.pem + +# Configuration and Workspace +.vscode/ +*.code-workspace +.git/ +.foam/ + +# Operational / Log data +.logs/ +system/runs/ +system/migration/ + +# Raw binaries not meant for text extraction +assets/ +attachments/ +*.jpg +*.png +*.jpeg +*.gif +*.webp +*.mp4 +*.mp3 +*.wav + +# Specific private notes (Add as needed) +finance.md diff --git a/inbox.md b/00-inbox/inbox.md similarity index 100% rename from inbox.md rename to 00-inbox/inbox.md diff --git a/2025-06-15.md b/01-journal/2025-06-15.md similarity index 100% rename from 2025-06-15.md rename to 01-journal/2025-06-15.md diff --git a/2025-06-17.md b/01-journal/2025-06-17.md similarity index 100% rename from 2025-06-17.md rename to 01-journal/2025-06-17.md diff --git a/2025-06-18.md b/01-journal/2025-06-18.md similarity index 100% rename from 2025-06-18.md rename to 01-journal/2025-06-18.md diff --git a/2025-06-19.md b/01-journal/2025-06-19.md similarity index 100% rename from 2025-06-19.md rename to 01-journal/2025-06-19.md diff --git a/2025-06-30.md b/01-journal/2025-06-30.md similarity index 100% rename from 2025-06-30.md rename to 01-journal/2025-06-30.md diff --git a/2025-07-01.md b/01-journal/2025-07-01.md similarity index 100% rename from 2025-07-01.md rename to 01-journal/2025-07-01.md diff --git a/2025-07-03.md b/01-journal/2025-07-03.md similarity index 100% rename from 2025-07-03.md rename to 01-journal/2025-07-03.md diff --git a/2025-07-06.md b/01-journal/2025-07-06.md similarity index 100% rename from 2025-07-06.md rename to 01-journal/2025-07-06.md diff --git a/2025-08-15.md b/01-journal/2025-08-15.md similarity index 100% rename from 2025-08-15.md rename to 01-journal/2025-08-15.md diff --git a/2025-08-24.md b/01-journal/2025-08-24.md similarity index 100% rename from 2025-08-24.md rename to 01-journal/2025-08-24.md diff --git a/2025-08-29.md b/01-journal/2025-08-29.md similarity index 100% rename from 2025-08-29.md rename to 01-journal/2025-08-29.md diff --git a/2025-08-30.md b/01-journal/2025-08-30.md similarity index 100% rename from 2025-08-30.md rename to 01-journal/2025-08-30.md diff --git a/2025-09-09.md b/01-journal/2025-09-09.md similarity index 100% rename from 2025-09-09.md rename to 01-journal/2025-09-09.md diff --git a/2025-09-10.md b/01-journal/2025-09-10.md similarity index 100% rename from 2025-09-10.md rename to 01-journal/2025-09-10.md diff --git a/TODO homelab.md b/02-projects/TODO_homelab.md similarity index 100% rename from TODO homelab.md rename to 02-projects/TODO_homelab.md diff --git a/making.md b/02-projects/making.md similarity index 100% rename from making.md rename to 02-projects/making.md diff --git a/todo.md b/02-projects/todo.md similarity index 100% rename from todo.md rename to 02-projects/todo.md diff --git a/finance.md b/03-areas/finance.md similarity index 100% rename from finance.md rename to 03-areas/finance.md diff --git a/home improvement.md b/03-areas/home_improvement.md similarity index 100% rename from home improvement.md rename to 03-areas/home_improvement.md diff --git a/AI.md b/04-knowledge/topics/AI.md similarity index 91% rename from AI.md rename to 04-knowledge/topics/AI.md index 6451a8b..66ab361 100644 --- a/AI.md +++ b/04-knowledge/topics/AI.md @@ -10,7 +10,7 @@ ## Projects -* [[self-hosting AI on lifebalance]] +* [[self-hosting_AI]] ## LocalAI Packaged diff --git a/booloumud.md b/04-knowledge/topics/booloumud.md similarity index 100% rename from booloumud.md rename to 04-knowledge/topics/booloumud.md diff --git a/chezmoi.md b/04-knowledge/topics/chezmoi.md similarity index 98% rename from chezmoi.md rename to 04-knowledge/topics/chezmoi.md index 4793ea9..bfea960 100644 --- a/chezmoi.md +++ b/04-knowledge/topics/chezmoi.md @@ -78,4 +78,4 @@ chezmoi init https://github.com/username/dotfiles.git ## Related - [[homelab]] -- [[dev environments]] \ No newline at end of file +- [[dev_environments]] \ No newline at end of file diff --git a/cigars.md b/04-knowledge/topics/cigars.md similarity index 100% rename from cigars.md rename to 04-knowledge/topics/cigars.md diff --git a/dev environments.md b/04-knowledge/topics/dev_environments.md similarity index 100% rename from dev environments.md rename to 04-knowledge/topics/dev_environments.md diff --git a/gitea.md b/04-knowledge/topics/gitea.md similarity index 100% rename from gitea.md rename to 04-knowledge/topics/gitea.md diff --git a/homelab.md b/04-knowledge/topics/homelab.md similarity index 97% rename from homelab.md rename to 04-knowledge/topics/homelab.md index fad466c..3dc685a 100644 --- a/homelab.md +++ b/04-knowledge/topics/homelab.md @@ -67,8 +67,8 @@ * 62 GiB RAM * NVIDIA GeForce RTX 4090 (24 GiB VRAM) * Debian GNU/Linux forky/sid - * [[self-hosting AI on lifebalance]] - * [[rclone google drive]] + * [[self-hosting_AI]] + * [[rclone_google_drive]] * proxmox1 * Beelink Mini PC EQi12, Intel Core 1220P(Max 4.4GHz 10C/12T), 16GB DDR4 500GB PCle4.0 SSD Mini Computers,Dual LAN/Wifi6/BT5.2,Dual 4K Display,Built-in Power Supply Office PC * proxmox2 diff --git a/keyboards.md b/04-knowledge/topics/keyboards.md similarity index 100% rename from keyboards.md rename to 04-knowledge/topics/keyboards.md diff --git a/opentofu.md b/04-knowledge/topics/opentofu.md similarity index 100% rename from opentofu.md rename to 04-knowledge/topics/opentofu.md diff --git a/pool.md b/04-knowledge/topics/pool.md similarity index 100% rename from pool.md rename to 04-knowledge/topics/pool.md diff --git a/rclone google drive.md b/04-knowledge/topics/rclone_google_drive.md similarity index 100% rename from rclone google drive.md rename to 04-knowledge/topics/rclone_google_drive.md diff --git a/self-hosting AI on lifebalance.md b/04-knowledge/topics/self-hosting_AI.md similarity index 100% rename from self-hosting AI on lifebalance.md rename to 04-knowledge/topics/self-hosting_AI.md diff --git a/tmux.md b/04-knowledge/topics/tmux.md similarity index 100% rename from tmux.md rename to 04-knowledge/topics/tmux.md diff --git a/to watch.md b/04-knowledge/topics/to_watch.md similarity index 100% rename from to watch.md rename to 04-knowledge/topics/to_watch.md diff --git a/AGENTS.md b/AGENTS.md new file mode 100644 index 0000000..20d43cb --- /dev/null +++ b/AGENTS.md @@ -0,0 +1,49 @@ +# Homefoam Wiki Architecture & Automation Rules + +This vault is a shared cognitive workspace for both human and agent. It is maintained by background LLM orchestration and semantic indexing, utilizing the QMD search engine. + +## 1. Vault Organization +The vault uses a hybrid hierarchy. Do not create folders with numeric prefixes if they don't already exist unless listed below. +- `00-inbox/` - Unprocessed human notes. +- `00-inbox/agent/` - Raw, timestamped agent insights (memory store). +- `01-journal/` - Daily notes and chronologies. +- `02-projects/` - Active projects. +- `03-areas/` - Life and maintenance areas. +- `04-knowledge/topics/` - Canonical topic pages. +- `04-knowledge/entities/` - Canonical entity pages (people, organizations, etc). +- `04-knowledge/synthesis/` - Cross-topic conclusions and multi-source answers. +- `04-knowledge/hypotheses/` - Speculative connections generated by the Dreaming Cycle. +- `05-sources/` - External ingested materials, packaged as `sources/-/`. +- `system/` - System records, rules (this file), claim ledgers, and run logs. + +## 2. Memory & Cognitive Cycles +- **Store**: Agents must write new insights as timestamped markdown files in `00-inbox/agent/`. Do not bypass the inbox to write unstructured facts directly into canonical pages. +- **Recall/Reflect**: Use standard file reads and QMD CLI/MCP tools. +- **Distillation Cycle (Nightly 03:30)**: + 1. Process `00-inbox/` (human and agent) into formal claims. + 2. Compact and deduplicate the existing claim graph. + 3. Re-evaluate dependent claims for modified sources. +- **Dreaming Cycle (Weekly)**: Traverse the QMD graph, synthesize non-obvious connections, and write speculative notes to `04-knowledge/hypotheses/`. + +## 3. Evidence & Formal Claims +- **Location**: Per-page Markdown sidecars in `system/claims/`. +- **Identity**: Globally stable, opaque IDs (e.g., `clm-a1b2c3`). +- **Locators**: Exact locators (headings, line numbers, timestamps) are required. +- **Authored Notes**: For notes the human authors directly, cite the Git path and baseline commit (e.g., `path/to/note.md@commit`). Do not duplicate human notes into `05-sources/`. +- **Status Lifecycle**: `supported`, `inferred`, `conflicted`, `superseded`, `retracted`. +- **Confidence**: `high`, `medium`, `low`. +- **Contradictions**: Preserved as `conflicted`; the agent must not silently force a winner. + +## 4. Editing Rules & Automation Guardrails +- **Privacy (.wikiignore)**: Paths in `.wikiignore` are strictly excluded from remote LLM/web processing. +- **Protected Markers**: + - `` ... `` : Content inside is never sent to the LLM or indexed. + - `` ... `` : Content inside may be read/indexed, but the agent must never rewrite it. +- **Rewrite Authority**: The agent may freely rewrite semantic content in eligible Markdown notes (unless protected). It must never overwrite, move, or delete raw source binaries, assets, attachments, or editor config files. +- **Failures & Recovery**: Operational failures (network, locks) can be retried. Semantic/content conflicts during automated sync must halt the job and leave `main` untouched; never attempt to force a Git conflict resolution on knowledge content. + +## 5. QMD Search +- **Corpus**: Knowledge, sources, extracted text, and claim sidecars. (Exclude `system/runs`, `system/migration`, and raw binaries). +- **Tooling**: CLI and Stdio MCP. +- **Artifacts**: QMD config is committed. SQLite indexes and model caches must remain untracked. +- **Index Refresh**: Only run after a successful batch that actually altered indexable content. diff --git a/system/migration/stage1_map.csv b/system/migration/stage1_map.csv new file mode 100644 index 0000000..0c8fcc8 --- /dev/null +++ b/system/migration/stage1_map.csv @@ -0,0 +1,21 @@ +old_path,new_path +inbox.md,00-inbox/inbox.md +todo.md,02-projects/todo.md +TODO homelab.md,02-projects/TODO_homelab.md +making.md,02-projects/making.md +finance.md,03-areas/finance.md +home improvement.md,03-areas/home_improvement.md +AI.md,04-knowledge/topics/AI.md +homelab.md,04-knowledge/topics/homelab.md +keyboards.md,04-knowledge/topics/keyboards.md +cigars.md,04-knowledge/topics/cigars.md +booloumud.md,04-knowledge/topics/booloumud.md +pool.md,04-knowledge/topics/pool.md +opentofu.md,04-knowledge/topics/opentofu.md +gitea.md,04-knowledge/topics/gitea.md +tmux.md,04-knowledge/topics/tmux.md +chezmoi.md,04-knowledge/topics/chezmoi.md +rclone google drive.md,04-knowledge/topics/rclone_google_drive.md +dev environments.md,04-knowledge/topics/dev_environments.md +self-hosting AI on lifebalance.md,04-knowledge/topics/self-hosting_AI.md +to watch.md,04-knowledge/topics/to_watch.md