Non-record: add HelixRecur v2 shared-depth recurrence submission#935
Draft
fumbl8 wants to merge 1 commit intoopenai:mainfrom
Draft
Non-record: add HelixRecur v2 shared-depth recurrence submission#935fumbl8 wants to merge 1 commit intoopenai:mainfrom
fumbl8 wants to merge 1 commit intoopenai:mainfrom
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Title
Non-record: add HelixRecur v2 shared-depth recurrence submission
Short Summary
This PR adds a single non-record submission folder for
records/track_non_record_16mb/2026-03-26_HelixRecur_v2on top ofupstream/main.HelixRecur v2 keeps the HelixRecur recurrence stack compact with
6shared blocks over11virtual passes and adds only44conditioning parameters to recover a small amount of depth-specific behavior. It is the active recurrence champion from the branch history, but it is being submitted honestly as exploratory non-record work rather than as a leaderboard attempt.Key Metrics
val_loss 7.54165596,val_bpb 4.46659346, compressed3042658, total3113435,step_avg 675.97msval_loss 4.63764717,val_bpb 2.74667588, compressed4224324, total4295101,step_avg 676.24ms707771518704044Non-record Rationale
Why It Is Still Promising
Next Direction
The next direction is gene-coded low-rank specialization: preserve the compact shared-depth recurrent base and add tiny learned low-rank specialization paths keyed by virtual depth, instead of stacking more scalar-only rescue knobs.