Skip to content

tutorials: compose ALORA model from source in race notebook#56

Open
lastras wants to merge 5 commits into
generative-computing:mainfrom
lastras:tutorials/alora-race-compose-from-source
Open

tutorials: compose ALORA model from source in race notebook#56
lastras wants to merge 5 commits into
generative-computing:mainfrom
lastras:tutorials/alora-race-compose-from-source

Conversation

@lastras
Copy link
Copy Markdown
Collaborator

@lastras lastras commented May 21, 2026

Summary

  • Replace the pre-built ibm-granite/granite-switch-4.1-3b-preview Hub checkpoint with a freshly composed model in the ALORA race leg, so both legs are built from the same three granitelib adapters using the same compose pipeline (no --technology-filter, so ALORA is preferred with LoRA as fallback)
  • Pass --alora-model to bench_pipeline_race.py in the ALORA benchmark cell
  • Fix three deprecation warnings in bench_pipeline_race.py: target_rolescoring_schema, utcnow()datetime.now(datetime.UTC), remove dead IPython import

Test plan

  • Compose command runs without errors (verified locally: exit 0, 12 adapters, ~4 min, correct ALORA/LoRA technology split)
  • Run the notebook end-to-end on Colab via the branch link

lastrasl@us.ibm.com;4A8621897;Luis Lastras added 5 commits May 21, 2026 17:38
Replace the pre-built Hub checkpoint (granite-switch-4.1-3b-preview)
with a freshly composed model, so both race legs are built from the
same three granitelib adapters using the same compose pipeline. The
ALORA leg uses no --technology-filter so the composer prefers ALORA
adapters and falls back to LoRA where unavailable — symmetric with
the existing LoRA leg which uses --technology-filter lora.
Also fix stale section 4 markdown that still referenced the Hub
checkpoint after the previous commit switched to composing from source.
guardian_check's target_role= kwarg was removed; use scoring_schema='user_prompt'.
The coloransi import was patching TermColors attributes that were never
read anywhere in the file — dead code. Removing it makes the script
runnable outside Jupyter without requiring ipython installed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant