Skip to content

TASK-8038 - Recover opencga-storage-mongodb#131

Draft
j-coll wants to merge 8 commits intodevelopfrom
TASK-8038
Draft

TASK-8038 - Recover opencga-storage-mongodb#131
j-coll wants to merge 8 commits intodevelopfrom
TASK-8038

Conversation

@j-coll
Copy link
Copy Markdown
Member

@j-coll j-coll commented Apr 24, 2026

Summary

Support work in java-common-libs for recovering opencga-storage-mongodb (TASK-8038).
Adds MongoDB aggregation support in persistent cursors, a parallel DataWriter.tee
primitive, and an embedded MongoDB test harness, plus an NPE fix in ProgressLogger.

Changes

  • commons-datastore-mongodb
    • MongoPersistentCursor: support aggregation pipelines
    • New EmbeddedMongoDBManager / EmbeddedMongoDBRule for tests
    • Added MongoPersistentCursorTest
  • commons-lib
    • DataWriter: new tee (sequential + parallel) with bounded queues; fix hang when a background thread dies with a full queue
    • Task: new tee, deprecated Task.join
    • ProgressLogger.asTask(): fix NPE

Testing

  • New unit tests: DataWriterTest, TaskTest, MongoPersistentCursorTest
  • Embedded MongoDB via EmbeddedMongoDBRule

Related

@imedina
Copy link
Copy Markdown
Member

imedina commented Apr 24, 2026

Task linked: TASK-8038 Recover opencga-storage-mongodb

@j-coll j-coll requested a review from pfurio April 27, 2026 15:25
@j-coll
Copy link
Copy Markdown
Member Author

j-coll commented Apr 27, 2026

Hi @pfurio, ready for review. This is the supporting work for TASK-8038 — MongoDB cursor aggregation, embedded MongoDB test harness, DataWriter.tee, and a couple of small fixes (see PR description).

Goes together with zetta-genomics/opencga#2635 (main PR, also yours). Thanks!

@j-coll j-coll marked this pull request as draft May 4, 2026 14:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants