Arquitecto de Scraping Universal — LeafBox Competitor Pricing

Competidor	plan_name	price_monthly_eur	price_annual_eur	max_skus	users_included	support_tier	scraped_at
GreenStack	starter	€49	€470	500	1	basic	2026-06-12T09:11:02
GreenStack	growth	€99	€950	5 000	5	email	2026-06-12T09:11:02
GreenStack	scale	€199	€1 910	50 000	20	phone	2026-06-12T09:11:02
GreenStack	enterprise	—	—	ilimitado	ilimitado	dedicated	2026-06-12T09:11:02
OrganicOS	semilla	€39	€374	300	1	basic	2026-06-12T09:12:41
OrganicOS	brote	€89	€854	3 000	3	email	2026-06-12T09:12:41
OrganicOS	cosecha	€179	€1 718	25 000	15	phone	2026-06-12T09:12:41
OrganicOS	raiz_pro	€349	€3 350	ilimitado	50	dedicated	2026-06-12T09:12:41
EcoPOS	basico	€35	€336	200	1	basic	2026-06-12T09:13:58
EcoPOS	comercial	€75	€720	2 000	4	email	2026-06-12T09:13:58
EcoPOS	distribuidor	€159	€1 526	20 000	12	phone	2026-06-12T09:13:58
EcoPOS	cadena	€299	€2 870	ilimitado	30	dedicated	2026-06-12T09:13:58

🐍 Script generado — ecopos_bs4_scraper.py (fragment)

# === CONFIG ====================================

TARGET_URL = "https://ecopos.es/tarifas"

OUTPUT_FILE = "competitor_pricing.csv"

TABLE_SELECTOR = {"data-id": "tariff-compare"}

REQUIRED_COLUMNS = [

  "plan_name", "price_monthly_eur",

  "max_skus", "users_included"

]

# === ROUTING DECISION ==========================

# Mode 2 — HTML estático, sin JS rendering

# Coste API: €0 | Rate: 1 req/s

def main():

  log("Checking robots.txt…")

  if not check_robots(TARGET_URL): sys.exit(1)

  html = safe_get(TARGET_URL)  # retry+backoff

  table = find_table(html, TABLE_SELECTOR)

  df = parse_table(table)

  df = clean_column_names(df)

  df = clean_data(df)

  if not validate(df, REQUIRED_COLUMNS):

    sys.exit(1)

  save_output(df, OUTPUT_FILE)

🔍 Validación — validate_extraction.py

✅

JSON bien formado (extraction_summary.json)

status: ok

✅

Campos requeridos presentes en todos los registros

12/12

✅

Sin duplicados (plan_name + competitor)

0 dups

✅

robots.txt respetado en las 3 fuentes

3/3 OK

✅

Rate limit respetado (1 req/s por dominio)

t_total: 12.4s

✅

Sin API keys hardcodeadas detectadas

grep: 0 matches

✅

Exit code del validador

exit 0

Completitud del dataset100%

Ahorro API (Mode 2 vs Firecrawl)66.7%

[2026-06-12 09:10:55] [INFO] ============================================================

[2026-06-12 09:10:55] [INFO] Universal Scraping Architect — Hybrid Pipeline START

[2026-06-12 09:10:55] [INFO] ============================================================

[2026-06-12 09:10:55] [INFO] Routing: greenstack.io → Mode 2 (HTML static, BS4 local)

[2026-06-12 09:10:55] [INFO] Routing: organicos.app → Mode 1 (SPA/JS, Firecrawl API)

[2026-06-12 09:10:55] [INFO] Routing: ecopos.es → Mode 2 (HTML static, BS4 local)

[2026-06-12 09:11:00] [INFO] robots.txt greenstack.io → ALLOWED ✓

[2026-06-12 09:11:01] [INFO] Attempt 1/3: GET https://greenstack.io/pricing

[2026-06-12 09:11:02] [INFO] HTTP 200 — content length: 48,231 chars.

[2026-06-12 09:11:02] [INFO] Target table found: table#pricing-plans

[2026-06-12 09:11:02] [INFO] Parsed table: 4 rows, 6 columns.

[2026-06-12 09:11:02] [INFO] Columns after normalisation: ['plan_name', 'price_monthly_eur', 'price_annual_eur', 'max_skus', 'users_included', 'support_tier']

[2026-06-12 09:11:02] [INFO] Validation passed. 4 rows, 6 columns. ✓

[2026-06-12 09:12:10] [INFO] Firecrawl API call → organicos.app/planes (mode: scrape, formats: ['markdown','extract'])

[2026-06-12 09:12:38] [INFO] Firecrawl tokens used: 2,841 / budget: 10,000

[2026-06-12 09:12:41] [INFO] Parsed __NEXT_DATA__ pricing JSON. 4 plans found.

[2026-06-12 09:12:41] [INFO] Validation passed. 4 rows, 6 columns. ✓

[2026-06-12 09:13:55] [INFO] robots.txt ecopos.es → ALLOWED ✓

[2026-06-12 09:13:56] [INFO] Attempt 1/3: GET https://ecopos.es/tarifas

[2026-06-12 09:13:58] [INFO] HTTP 200 — content length: 31,774 chars.

[2026-06-12 09:13:58] [INFO] Target table found: table[data-id=tariff-compare]

[2026-06-12 09:13:59] [INFO] Parsed table: 4 rows, 6 columns. Validation passed. ✓

[2026-06-12 09:14:00] [INFO] Merging 3 DataFrames → unified competitor_pricing.csv

[2026-06-12 09:14:00] [INFO] Dedup check: 0 duplicates found.

[2026-06-12 09:14:01] [INFO] Running validate_extraction.py extraction_summary.json --json

[2026-06-12 09:14:01] [INFO] {"status": "ok", "message": "JSON is valid and well-formed."}

[2026-06-12 09:14:01] [INFO] Validator exit code: 0 ✓

[2026-06-12 09:14:01] [INFO] Output saved: competitor_pricing.csv (12 rows)

[2026-06-12 09:14:01] [INFO] Output saved: extraction_summary.json

[2026-06-12 09:14:01] [INFO] ============================================================

[2026-06-12 09:14:01] [INFO] EXTRACTION COMPLETE — 12 rows · 3 sources · exit 0

[2026-06-12 09:14:01] [INFO] ============================================================

📦 extraction_summary.json (validate_extraction.py → status: ok)

{
  "pipeline_run": {
    "timestamp": "2026-06-12T09:14:01Z",
    "client": "LeafBox SaaS",
    "objective": "competitor_pricing_monitoring",
    "total_sources": 3,
    "total_records": 12,
    "duplicates": 0,
    "validation_status": "ok",
    "validator_exit_code": 0
  },
  "routing": {
    "firecrawl_sources": ["organicos.app"],
    "local_bs4_sources": ["greenstack.io", "ecopos.es"],
    "firecrawl_tokens_used": 2841,
    "api_cost_saved_pct": 66.7
  },
  "sources": [
    { "domain": "greenstack.io", "mode": "local_bs4", "plans": 4, "robots_ok": true, "status": "ok" },
    { "domain": "organicos.app", "mode": "firecrawl", "plans": 4, "robots_ok": true, "status": "ok" },
    { "domain": "ecopos.es", "mode": "local_bs4", "plans": 4, "robots_ok": true, "status": "ok" }
  ],
  "output_files": {
    "csv": "competitor_pricing.csv",
    "log": "extraction_run.log",
    "summary_json": "extraction_summary.json"
  }
}