Summary
Implement a basic dead-letter handling strategy for records that fail to be processed after multiple retries.
Details
- For now, this can be as simple as logging the failed record to a specific log level (e.g.,
ERROR) with all its details, or inserting it into a dedicated ingestion_dlq table in the database.
Acceptance Criteria
Dependencies
IGDB ETL – Retry & Backoff Strategy Implementation
Out of Scope
- Automated reprocessing of the dead-letter queue.
Test Plan
- Write a test that simulates a record that always fails validation and verify that it ends up in the designated dead-letter location.
Checklist
Summary
Implement a basic dead-letter handling strategy for records that fail to be processed after multiple retries.
Details
ERROR) with all its details, or inserting it into a dedicatedingestion_dlqtable in the database.Acceptance Criteria
Dependencies
IGDB ETL – Retry & Backoff Strategy ImplementationOut of Scope
Test Plan
Checklist