Output JSON Scheme

Who should read this — Engineers consuming Research → Seed pipeline output. Pair with Category Reference for nature values.

Overview

The Research → Seed pipeline discovers entry_url from source_domain through a 5-stage multi-step exploration and generates Output JSON.

Pipeline Stages

[1] Well-known RSS Feeds (11 standard paths)
   ↓ (if none)
[2] Sitemap.xml analysis (news/media URL extraction)
   ↓ (if none)
[3] Robots.txt hints (Sitemap/Allow paths)
   ↓ (if none)
[4] HTML pattern discovery (RSS links, navigation)
   ↓ (if none)
[5] Manual review required (automation limit)

Output JSON Structure

{
  "meta": {
    "generated_at": "2026-01-24T14:23:45.777Z",
    "total_seeds": 6,
    "pipeline_version": "2.0",
    "generator": "newsfork-seed-discovery"
  },
  "seeds": [
    {
      "id": "sg-mom-001",
      "source_domain": "mom.gov.sg",
      "entry_url": "https://www.mom.gov.sg/newsroom.xml",
      "nature": "news",
      "fetch": {
        "type": "html",
        "selectors": {
          "container": "main, .content, .news-content"
        }
      },
      "url_patterns": ["..."],
      "schedule": "*/30 * * * *",
      "priority": 9,
      "trust_tier": "tier1",
      "status": "draft",
      "metadata": {
        "discovery_confidence": 0.85,
        "nature_detection": {
          "method": "url_pattern",
          "confidence": 0.9
        }
      }
    }
  ]
}

Content Nature Automatic Classification

URL Pattern	Nature	Confidence
/newsroom/	news	90%
/press/	press_release	85%
/faq/	faq	80%
/guide/	guide	80%

Research vs Seed Role Separation

• Research: Discover “where to look” (URL list only)
• Seed: Contract “how to retrieve” (nature identification + collection strategy)

Next steps

• Category Reference — Category definitions.
• JSON structure design — Schema reference.