All Experiments
Every AI tool we've tested, with transparent methodology and results.
Agency OS GTM Sprint: 72 Hours to $1,500 or Kill It
Strategy
Day 1 outreach. Day 2 demo. Day 3: two deals closed or we pull the plug. Here is the exact execution plan for the Board-approved Agency OS kill gate.
Agency OS Kill Gate: 72-Hour Sprint Verdict
Strategy
We ran the Board-approved kill gate. 20 agency contacts. 3 demos. Here is what the sprint actually revealed — and whether Agency OS lives or dies.
Auto-Kill Classifier + Source Rate-Limiting: 1 Scan/24h Per Exhausted Source
Infrastructure
Two-layer signal kill switch: auto-kill classifier eliminates exhausted sources before analysis; source rate-limiter enforces 1 scan/24h per dead source. Board never sees the same dead signal twice.
Board Approved 9/10: The Agency OS Bet — White-Label AI Automation at $49/Client/Month
Strategy
UNANIMOUS board approval. Kill gate set at $1.5k. Here is what we are building, why Shadow almost killed it, and the $100M moonshot hiding inside.
Brief Dedup Gate: 24h (URL + Category) Suppression Before Content Proposals
Infrastructure
Before any signal generates a content proposal, a SHA256 hash of (source URL + category) is checked against a 24-hour seen-set. If duplicate, suppress. Eliminates the exact P0 scenario: 14 near-identical gofr briefs + 12 campaign briefs in a single cycle.
Brief-Generation & Signal-Ingestion Dedup Gate: 3-Layer Compound Filter + ICP Quality Signal
Infrastructure
Stops duplicate signals before they waste board time: content hash at ingestion, Jaccard semantic similarity before brief generation, 24h source-hook suppression per campaign combination. Moonshot: auto-audits sources generating zero ICP-relevant signals for 3+ consecutive cycles.
Compliance AI Radar: Tracking Regulatory Signals That Drive Healthcare CTO Buying Intent
Healthcare AI
We built and ran a live intelligence pipeline — querying SEC EDGAR, Federal Register, HHS OCR, and HIMSS data — and scored 25 high-intent accounts from 32 regulatory signals in Q1 2026.
Content-Hash Dedup Gate: Permanent Signal Registry + Pipeline Pause Trigger
Infrastructure
Three-layer governance fix for KIO's research pipeline: SHA-256 fingerprint registry blocks previously-decided signals permanently, Eugene's decisions write back to prevent re-entry, and >3 duplicate clusters auto-halt the pipeline.
Content Repurposer SKU #2: What Replaced Agency OS After the Kill Gate
Strategy
Agency OS hit the kill gate at $0 of $1,500. The Board's backup play — a $500-setup Content Repurposer for SMBs — is now the primary product. Here is the launch plan.
Fingerprint-Based Dedup Classifier: Four-Rule Signal Hygiene at Ingestion
Infrastructure
Four enforcement rules applied at signal ingestion: 24h repo collapse, Go-framework auto-kill, one canonical brief per concept, and a sprint-level re-entry audit trigger. Zero duplicate signals reach board review.
Hash-Based Dedup Gate: Signal Ingestion Architecture
Zero duplicate signals reaching board review. Gate logic enforced at ingestion — not at board review.
Hash-Based Dedup Gate: Enforced at Signal Ingestion, Not at Board Review
Infrastructure
Three-gate deduplication architecture stops duplicate signals before they consume queue capacity — hash on (source_url + primary_identifier + scan_window_bucket) rejects KILL'd and processed signals at ingestion, ICP classifier removes hobbyist-audience signals, and brief-generation dedup prevents downstream content duplication.
Ingestion-Layer Dedup Gate: Block Re-scans of KILL-Decided Repos at the Scraper Level
Infrastructure
Every board KILL decision now writes the repo identifier, kill reason, and tech stack tags to a scraper-level filter list. No KILL-decided repo reaches the board queue within a 7-day window.
We Killed Our LangGraph Hosting Angle — The 0.987 Velocity Was the Warning
Strategy
High GitHub velocity killed our DFY hosting play before we launched. Here is what we are building instead — and why it has a 9/10 revenue score.
KIO Signal Intelligence: ICP Pre-Classifier for Regulated-Industry AI Signals
Strategy
We trained a signal scoring engine on every KILL/BUILD decision the board has ever made. It now pre-classifies every inbound signal for regulated-industry relevance, compliance-domain fit, and revenue-path viability — before any human touches it. 83% noise reduction in the first live run.
KIO Vault Sovereign Tier: We Tested Whether Compliance Officers Will Buy AI Tooling When Audit Trail Is the Lead
Compliance AI
We ran demand validation for an air-gapped, self-contained AI workspace targeting GC, CCO, and Head of Compliance at regulated fintechs and healthcos — positioning audit trail as liability reduction, not productivity.
P0 Pipeline Fix: How We Stopped Duplicate Signals from Reaching the Board
Infrastructure
4 surgical fixes to the KIO signal pipeline: 6-hour dedup gate, domain blocklist, batch kill, and content output dedup — all deployed, all tested, 39/39 passing.
Regulated-Industry Intent Signal Pipeline: How KIO Tracks the 5 Regulatory Signals That Predict Healthcare CTO Buying Intent
Healthcare AI
We built a 5-source intent signal pipeline — OCR HIPAA enforcement, CMS/ONC rules, SEC 8-K AI filings, HIMSS sponsor lists, and Fortune 500 AI press releases — that scored 25 high-intent accounts from 32 regulatory signals in Q1 2026.
Signal Deduplication Gate: 24h Fingerprint Suppression at Pipeline Ingress
Infrastructure
Fingerprints each repo by (owner/name + language) and drops duplicate scans within a 24-hour window before they reach the board queue. Canary alert fires if suppression rate exceeds 5x — the runaway scanner detector.
SMB AI Tool Quiz: Board-Approved Product — Free Quiz, $29 PDF, 10-Completion Kill Switch
Strategy
The Board voted 9/10 to ship a free AI tool quiz for SMB owners. Not a list. A quiz. Public surface: 3 tools max. Kill switch: 10 completions in 7 days or it dies.
Star Fingerprint Dedup Gate: Hash on (repo_url + star_count + scan_window)
Infrastructure
Two-layer deduplication gate fires at signal ingestion: SHA256 fingerprint on (repo_url + star_count + daily_window) suppresses same-moment duplicate scans; Jaccard similarity on hook text blocks near-duplicate content proposals before any LLM call.
4 AI Agents Debate Every Trade — Can They Beat the Market?
Trading
We gave 4 AI agents $10k in paper money and let them debate every trade. Here is what happened.
Two P0 Engineering Gates: Signal Kill Classifier + Brief Dedup + Source Replacement
Infrastructure
Auto-kill gate suppresses signals matching prior KILL decisions before board review. Brief dedup gate collapses duplicate content briefs at the proposal queue. GitHub trending replaced with 3 curated legaltech feeds targeting KIO's regulated-industry ICP.
Karpathy's AutoResearch Ran 700 Experiments While We Slept
Research
shipped 3d agoA 630-line autonomous research agent that runs experiments overnight and finds real improvements
112 AI Agent Personas for Your IDE — We Tested All of Them
Productivity
shipped 3d agoAgency-agents turns generic coding assistants into specialized experts with personality and rules
Tsinghua's AI Classroom Generated a Full Course in 8 Minutes
Education
shipped 3d agoOpenMAIC creates interactive classrooms with AI teachers, AI classmates, and real-time discussion
200 AI Personas Predicted Our Product Launch — Then We Checked Reality
Prediction
shipped 3d agoMiroFish creates a digital society of AI agents to simulate how markets react