Skip to content

TASK: IGDB ETL – Metrics (fetched_count, upsert_count, lag_seconds) #30

@AndersonGACFilho

Description

@AndersonGACFilho

Summary

Instrument the ETL process with key operational metrics.

Details

  • fetched_count: A counter for the number of game records fetched from the API.
  • upsert_count: A counter for the number of game records successfully upserted into the database.
  • lag_seconds: A gauge to measure the time difference between now() and the last successful watermark timestamp.

Acceptance Criteria

  • The ETL exposes Prometheus-compatible metrics.
  • The specified metrics are correctly incremented or set during a run.
  • Logging & metrics added.
  • No linter / build errors

Dependencies

  • IGDB ETL – Game Upsert

Out of Scope

  • Setting up dashboards or alerts.

Test Plan

  • Write a unit test that runs a mock ETL process and verifies that the metric collectors are called with the expected values.

Checklist

  • Labels added (task, component/igdb-etl)
  • CHANGELOG updated if user-visible
  • No secrets committed

Metadata

Metadata

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions