Initial: competitive landscape research pipeline — methodology, tracking, Batch 001 dispatched

CHANGELOG.md

@@ -0,0 +1,9 @@
+# Changelog
+
+## 2026-08-10 — Initial Pipeline Setup
+
+### Added
+- Project folder, README, METHODOLOGY.md, COST-TRACKING.md created
+- Gitea repo: git.itpropartner.com/ippadmin/competitive-landscape-research
+- Research Batch 001 dispatched: 20 sites across 3 parallel teams
+- Products analyzed: IntelSight, TransitPin, VentureBuilt, VerdictTank, HotNow, DRE

METHODOLOGY.md

@@ -0,0 +1,112 @@
+# Research Methodology
+
+## Dispatch Architecture
+
+### Team Composition
+Each batch is split across 3 parallel research teams, each covering 3-8 sites:
+- **Team Alpha:** Marketing/landing optimization + scraping/monitoring tools
+- **Team Bravo:** Micro-SaaS platforms + social/content tools  
+- **Team Charlie:** Career/local discovery + document tools (typically highest priority due to HotNow competitive overlap)
+
+### Model Selection
+- Default: deepseek-v4-pro (cost-effective, strong at structured analysis)
+- Premium: Claude Sonnet 5 for mission-critical competitive analysis (e.g., Locale-NYC vs HotNow)
+- Fallback: deepseek-v4-flash for high-volume scraping passes
+
+### Dispatch Pattern
+```
+delegate_task(tasks=[
+  {goal: "...", context: "...", role: "orchestrator"},
+  {goal: "...", context: "...", role: "orchestrator"},  
+  {goal: "...", context: "...", role: "orchestrator"}
+])
+```
+
+Each team subagent is an orchestrator — they can spawn their own leaf subagents for individual site scraping. This keeps context windows manageable and enables parallel site analysis.
+
+## Site Analysis Protocol
+
+### Per-Site Mandatory Extraction
+1. **Core product/service** — What do they actually sell? (not what their tagline says)
+2. **Pricing model** — Free tier? Monthly? Per-seat? Enterprise?
+3. **Key features** — The 3-5 things that define the product
+4. **UI/UX patterns** — Layout decisions, card designs, search patterns, filter approaches
+5. **USP (Unique Selling Proposition)** — What's their "one thing"?
+6. **Target audience** — Who is this for? (evidence from copy, not assumption)
+7. **Tech stack indicators** — Framework hints, JS libraries, hosting clues
+8. **Polish rating (1-5)** — Landing page quality, copy clarity, conversion strategy
+
+### Competitive Comparison Dimensions
+When comparing a target site to an ITPP product, evaluate across:
+- Feature completeness
+- UX/UI polish
+- Monetization strategy
+- Data pipeline (how do they get their content?)
+- Mobile readiness
+- Conversion funnel
+- Brand voice and positioning
+
+## Cross-Reference Protocol
+
+### Feature Mapping
+Every extracted feature is mapped to at least one ITPP product with:
+- **What:** The specific feature (e.g., "their tiered pricing table with hover comparison")
+- **From:** Source site
+- **To:** Target ITPP product
+- **Why:** Reason this feature would improve the product
+- **Effort:** Low / Medium / High implementation estimate
+- **Impact:** 1-5 rating of expected user impact
+
+### Priority Tiers
+- **P0 (Ship This Week):** 1-2 day features that close obvious gaps
+- **P1 (Next Sprint):** 3-7 day features that add significant value
+- **P2 (Roadmap):** Features requiring refactoring or new infrastructure
+- **P3 (Nice to Have):** "Eventually" features with marginal impact
+
+## New Product Identification
+
+### Signal Detection
+A new product opportunity exists when:
+- 3+ sites in a batch cluster around the same problem
+- A site solves a problem in one vertical that doesn't exist in another
+- A "pick-and-shovel" opportunity emerges (tools for the toolmakers)
+- A local version of a city-specific app is viable (e.g., Locale-NYC → HotNow Savannah)
+
+### Evaluation Criteria
+- Market size estimate (rough)
+- Competition density
+- Our unique advantage
+- MVP scope and timeline
+- AI cost for ongoing operation
+- Domain availability
+
+## Cost Tracking
+
+### Per-Batch Cost Attribution
+```
+Research Batch 001:
+  Team Alpha:  $X.XX (deepseek-v4-pro, N tool calls)
+  Team Bravo:  $X.XX (deepseek-v4-pro, N tool calls)
+  Team Charlie: $X.XX (deepseek-v4-pro, N tool calls)
+  Integration: $X.XX (deepseek-v4-pro, N tool calls)
+  Total:       $X.XX
+```
+
+Tracked via dedicated LiteLLM virtual key `competitive-research-prod` on admin-ai.
+
+### Historical Cost Baseline
+| Batch | Date | Total Cost | Sites | Cost/Site | Notes |
+|---|---|---|---|---|---|
+| 001 | 2026-08-10 | TBD | 20 | TBD | Initial batch |
+
+## Report Template
+
+Each batch produces a master report at `research/NNN-slug.md`:
+1. Executive Summary (1 paragraph)
+2. Site-by-Site Breakdown (summary table)
+3. Feature Extraction Matrix (sortable table)
+4. Product Enhancement Recommendations (grouped by product, prioritized)
+5. New Product Opportunities (concept cards)
+6. Risk Flags & Warnings
+7. Cost Summary
+8. Next Batch Queue (sites flagged for future analysis)

README.md

@@ -0,0 +1,57 @@
+# Competitive Landscape Research Pipeline
+
+Systematic competitive analysis pipeline — scrape target sites, extract features, cross-reference against ITPP products, and identify new product opportunities. Designed as a repeatable research operation.
+
+**Status:** LIVE  
+**Owner:** Germaine Brown / Sho'Nuff  
+**Created:** 2026-08-10  
+
+## Access
+
+| Resource | URL | Access |
+|---|---|---|
+| Git Repo | https://git.itpropartner.com/ippadmin/competitive-landscape-research | ippadmin (read/write) |
+| AI Costs | admin-ai key: `competitive-research-prod` | TBD |
+
+## Purpose
+
+When Germaine identifies a batch of competitor/adjacent sites, this pipeline:
+1. Scrapes and deeply analyzes every site
+2. Extracts features, UI patterns, pricing models, and UX decisions
+3. Cross-references findings against ITPP products (IntelSight, HotNow, VerdictTank, TransitPin, VentureBuilt, DRE)
+4. Identifies new product opportunities from common themes
+5. Produces a structured, searchable report
+
+## Pipeline Architecture
+
+```
+Research Batch (user provides URLs)
+    │
+    ├─ Team Alpha (3-7 sites) ──┐
+    ├─ Team Bravo (3-7 sites) ──┤ Parallel scraping + analysis
+    └─ Team Charlie (3-7 sites)─┘
+    │
+    ▼
+Integration & Synthesis (master report)
+    │
+    ├─ Feature Extraction Matrix
+    ├─ Product Enhancement Recommendations
+    ├─ New Product Opportunities
+    └─ Risk Flags & Cost Summary
+```
+
+## Research Batches
+
+| Batch ID | Date | Sites | Researchers | Products Analyzed | Report |
+|---|---|---|---|---|---|
+| 001 | 2026-08-10 | 20 sites | Alpha, Bravo, Charlie | 6 products | research/001-aug10.md |
+
+## Methodology
+
+See [METHODOLOGY.md](METHODOLOGY.md) for the full research protocol.
+
+Key principles:
+- Every site gets a full page extraction + browser inspection
+- Features are rated on replicability and mapped to specific ITPP products
+- New product ideas must cite which sites inspired them
+- AI costs tracked per-research-batch via dedicated LiteLLM key