gpt2 SAE recipe: interactive feature-explorer dashboard - #1697
Draft
polinabinder1 wants to merge 3 commits into
Draft
gpt2 SAE recipe: interactive feature-explorer dashboard#1697polinabinder1 wants to merge 3 commits into
polinabinder1 wants to merge 3 commits into
Conversation
TransformerLens GPT-2 small + Joseph Bloom's layer-7 residual SAE (24,576 features). Reuses the shared `sae` lib and the `feature_explorer` dashboard (a ~95-line frontend adaptation, evo2/DNA text scrubbed). Bundles 24,570 Neuronpedia auto-interp labels + a curated star steerable set. CPU-capable, no training/gated model. Prebuilt dashboard dist bundled for one-step serve. Stacked on #1623. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
polinabinder1
requested review from
jstjohn,
jwilber,
pstjohn,
savitha-eng and
trvachov
as code owners
July 28, 2026 04:53
Contributor
|
Important Review skippedAuto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Enterprise Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
polinabinder1
marked this pull request as draft
July 28, 2026 04:55
|
Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually. Contributors can view more details about this message here. |
gpt2 now serves evo2's dashboard (config-driven via /api/health `ui` block; evo2 defaults to DNA, unchanged) and ships backend + `dashboard_data/` only — drops ~9.6k duplicated dashboard/lockfile/built lines. Finer text-label scrub deferred to a config-driven follow-up. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
/api/health now reports restart_enabled from ALLOW_ENGINE_RESTART (was hardcoded False), and POST /api/restart exits the worker with code 42 for a respawn wrapper to bring back — same contract as evo2's launch_inference.sh serve. Button stays off (409) unless run under a respawn loop that sets the flag. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Signed-off-by: polinabinder1 <pbinder@nvidia.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What this is
A GPT-2 small SAE feature explorer — the NLP sibling of the existing
evo2/esm2/codonfminterpretability recipes. It pairs TransformerLens GPT-2 small with Joseph Bloom's layer-7 residual SAE (blocks.7.hook_resid_pre, 24,576 features) and serves an interactive dashboard for browsing, probing, and steering features on ordinary text.Key points
saelib and thefeature_explorerdashboard unchanged apart from a small text adaptation (~95-line frontend diff: evo2/DNA-specific copy scrubbed for NLP). No forked infrastructure.gpt2-small/7-res-jb, index-aligned), so nearly every feature is searchable by concept in the pickers. Plus a curated ⭐ steerable set verified to move generations.distbundled (parquets + labels + JS assets) sogpt2-sae serveis one step — no build needed to try it./apisurface as the sibling recipes (/annotate,/generatefeature-clamped steering,/gene_embedfor the UMAP tab), plus a terminal CLI (gpt2-sae annotate|generate|serve).Lint (ruff) clean and the CPU-only unit tests (5) pass; they do not download the model.
Stacking
Stacked on #1623 — base branch is
pbinder/evo2-sae-dashboard. Review/merge that first; this PR's diff is only the newrecipes/gpt2/tree plus one line addingrecipes/gpt2to the uv workspace members.🤖 Generated with Claude Code