Competitor Ingest Error Taxonomy (CM10)

Status: Draft · Date: 2025-12-04 Scope: Standardize retry/backoff/error taxonomy for the competitor ingest pipeline with deterministic diagnostics.

Objectives

• Define comprehensive error taxonomy for ingest failures.
• Specify retry behavior for transient errors.
• Enable deterministic error diagnostics.
• Support offline error handling.

Error Categories

Retryable Errors

Non-Retryable Errors

Warning Conditions

Error Format

Standard Error Response

{
  "error": {
    "code": "E2001",
    "category": "signature_invalid",
    "message": "DSSE signature verification failed",
    "details": {
      "reason": "Key ID not found in trusted keyring",
      "keyId": "unknown-key-12345",
      "algorithm": "ecdsa-p256"
    },
    "retryable": false,
    "diagnostics": {
      "timestamp": "2025-12-04T12:00:00Z",
      "traceId": "abc123...",
      "inputHash": "b3:...",
      "stage": "signature_verification"
    }
  }
}

Warning Response

{
  "result": {
    "status": "accepted_with_warnings",
    "warnings": [
      {
        "code": "W3001",
        "category": "provenance_unknown",
        "message": "SBOM accepted without verified provenance",
        "details": {
          "reason": "No signature present",
          "fallbackLevel": 2
        }
      }
    ],
    "output": {...}
  }
}

Retry Configuration

Backoff Strategies

{
  "backoff": {
    "exponential": {
      "description": "2^attempt * base, capped at max",
      "config": {
        "base": 1000,
        "factor": 2,
        "max": 60000,
        "jitter": 0.1
      },
      "example": [1000, 2000, 4000, 8000, 16000, 32000, 60000]
    },
    "linear": {
      "description": "initial + (attempt * increment), capped at max",
      "config": {
        "initial": 1000,
        "increment": 1000,
        "max": 30000
      },
      "example": [1000, 2000, 3000, 4000, 5000]
    },
    "fixed": {
      "description": "Constant delay between retries",
      "config": {
        "delay": 5000
      },
      "example": [5000, 5000, 5000]
    }
  }
}

Retry Decision Logic

def should_retry(error: IngestError, attempt: int) -> RetryDecision:
    if error.code.startswith('E2'):
        return RetryDecision(retry=False, reason="Non-retryable error")

    config = RETRY_CONFIG.get(error.category)
    if not config:
        return RetryDecision(retry=False, reason="Unknown error category")

    if attempt >= config.max_retries:
        return RetryDecision(retry=False, reason="Max retries exceeded")

    delay = calculate_backoff(config, attempt)
    return RetryDecision(retry=True, delay=delay)

Diagnostic Output

Deterministic Diagnostics

All error diagnostics must be deterministic and reproducible:

{
  "diagnostics": {
    "timestamp": "2025-12-04T12:00:00Z",
    "traceId": "deterministic-trace-id",
    "inputHash": "b3:...",
    "stage": "normalization",
    "context": {
      "tool": "syft",
      "toolVersion": "1.0.0",
      "adapterVersion": "1.0.0",
      "inputSize": 12345,
      "componentCount": 42
    },
    "errorChain": [
      {
        "stage": "schema_validation",
        "error": "Missing required field: artifacts[0].purl",
        "path": "/artifacts/0"
      }
    ]
  }
}

Offline Diagnostics

For offline mode, diagnostics include:

• No timestamps that depend on wall clock
• Deterministic trace IDs (based on input hash)
• All context from bundled metadata

{
  "diagnostics": {
    "mode": "offline",
    "kitVersion": "1.0.0",
    "traceId": "b3:input-hash-derived-trace-id",
    "kitHash": "b3:...",
    "trustRootHash": "b3:..."
  }
}

Error Handling Workflow

┌─────────────┐
│   Ingest    │
│   Request   │
└─────────────┘
       │
       ▼
┌─────────────┐
│  Validate   │──Error──► E2008 schema_invalid
└─────────────┘
       │
       ▼
┌─────────────┐
│   Verify    │──Error──► E2001-E2007 signature errors
│  Signature  │
└─────────────┘
       │
       ▼
┌─────────────┐
│  Normalize  │──Error──► E2008-E2009 format errors
└─────────────┘
       │
       ▼
┌─────────────┐
│   Store     │──Error──► E1001-E1006 retryable errors
└─────────────┘
       │
       ▼
┌─────────────┐
│   Success   │
│  or Warn    │
└─────────────┘

API Error Responses

HTTP Status Mapping

Example Error Response

HTTP/1.1 400 Bad Request
Content-Type: application/json
X-Stellaops-Error-Code: E2001
X-StellaOps-TraceId: abc123...

{
  "error": {
    "code": "E2001",
    "category": "signature_invalid",
    "message": "DSSE signature verification failed",
    "details": {...},
    "retryable": false,
    "diagnostics": {...}
  }
}

Retry Response

HTTP/1.1 503 Service Unavailable
Content-Type: application/json
Retry-After: 5
X-Stellaops-Error-Code: E1004
X-Stellaops-Retry-Attempt: 1

{
  "error": {
    "code": "E1004",
    "category": "service_unavailable",
    "message": "Upstream service temporarily unavailable",
    "retryable": true,
    "retryAfter": 5000,
    "attempt": 1,
    "maxAttempts": 3
  }
}

Logging

Error Log Format

{
  "level": "error",
  "timestamp": "2025-12-04T12:00:00Z",
  "logger": "stellaops.scanner.ingest",
  "message": "Ingest failed: signature_invalid",
  "error": {
    "code": "E2001",
    "category": "signature_invalid"
  },
  "context": {
    "traceId": "abc123...",
    "tool": "syft",
    "inputHash": "b3:..."
  }
}

Links

• Sprint: docs/implplan/SPRINT_0186_0001_0001_record_deterministic_execution.md (CM10)
• Normalization: docs/modules/scanner/design/competitor-ingest-normalization.md (CM1)
• Verification: docs/modules/scanner/design/competitor-signature-verification.md (CM2)
• Offline Kit: docs/modules/scanner/design/competitor-offline-ingest-kit.md (CM5)