Skip to content

Commit 79cb7f4

Browse files
rushikeshmoreclaude
andcommitted
Merge feat/json-nested-flatten — WIN on every JSON file
Nested flatten for json_array, grouped json_array for diverse schemas, compressed transform metadata, adaptive level tuning. DataCortex now BEATS zstd-19 on every test file: test-ndjson: 19.2x vs 15.6x (+23%) test-api.json: 14.1x vs 13.2x (+7%) uniform-10k: 24.8x vs 16.0x (+55%) twitter.json: 17.0x vs 16.7x (+2%) citm_catalog: 195.3x vs 176.0x (+11%) 339 tests, 22/22 E2E roundtrips, clippy clean. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2 parents 5714afa + 59d5bff commit 79cb7f4

17 files changed

Lines changed: 1734 additions & 254 deletions

.codecortex/constitution.md

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -6,32 +6,32 @@
66
- **Name:** datacortex
77
- **Languages:** rust
88
- **Files:** 50
9-
- **Symbols:** 984
9+
- **Symbols:** 1028
1010
- **Modules:** 3
11-
- **Last updated:** 2026-03-24T21:37:40.097Z
11+
- **Last updated:** 2026-03-25T08:29:06.052Z
1212

1313
## Architecture
1414

1515
**Modules (3):**
16-
- **datacortex-core** (45 files, 16860 lines) — rust
16+
- **datacortex-core** (45 files, 18663 lines) — rust
1717
- **datacortex-neural** (3 files, 773 lines) — rust
18-
- **datacortex-cli** (1 files, 635 lines) — rust
18+
- **datacortex-cli** (1 files, 642 lines) — rust
1919

2020
## Risk Map
2121

2222
**Hottest files (most changes):**
23-
- `CLAUDE.md` — 14 changes, VOLATILE
24-
- `crates/datacortex-core/src/format/mod.rs` — 14 changes, VOLATILE
23+
- `CLAUDE.md` — 17 changes, VOLATILE
24+
- `crates/datacortex-core/src/format/mod.rs` — 16 changes, VOLATILE
25+
- `crates/datacortex-core/src/codec.rs` — 15 changes, VOLATILE
2526
- `crates/datacortex-core/src/model/engine.rs` — 13 changes, VOLATILE
26-
- `crates/datacortex-core/src/codec.rs` — 12 changes, VOLATILE
27-
- `crates/datacortex-core/src/mixer/dual_mixer.rs` — 11 changes, VOLATILE
27+
- `.codecortex/constitution.md` — 12 changes, VOLATILE
2828

2929
**Hidden dependencies (co-change but no import):**
30+
- `crates/datacortex-core/src/format/mod.rs``crates/datacortex-core/src/format/transform.rs` — 11 co-changes (69%)
3031
- `crates/datacortex-core/src/mixer/dual_mixer.rs``crates/datacortex-core/src/model/engine.rs` — 11 co-changes (85%)
31-
- `crates/datacortex-core/src/format/mod.rs``crates/datacortex-core/src/format/transform.rs` — 10 co-changes (71%)
3232
- `crates/datacortex-core/src/model/engine.rs``crates/datacortex-core/src/model/mod.rs` — 8 co-changes (62%)
3333
- `crates/datacortex-core/src/mixer/dual_mixer.rs``crates/datacortex-core/src/model/mod.rs` — 6 co-changes (55%)
34-
- `Cargo.toml``crates/datacortex-core/Cargo.toml` — 5 co-changes (100%)
34+
- `crates/datacortex-cli/src/main.rs``crates/datacortex-core/src/lib.rs` — 5 co-changes (83%)
3535

3636
## Available Knowledge
3737

.codecortex/cortex.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,11 +2,11 @@ version: 1.0.0
22
project: datacortex
33
root: /Users/rushikeshmore/Desktop/personal-desk/03-projects/datacortex
44
generated: 2026-03-24T11:04:44.370Z
5-
lastUpdated: 2026-03-24T21:37:40.097Z
5+
lastUpdated: 2026-03-25T08:29:06.052Z
66
languages:
77
- rust
88
totalFiles: 50
9-
totalSymbols: 984
9+
totalSymbols: 1028
1010
totalModules: 3
1111
projectSize: small
1212
tiers:

.codecortex/graph.json

Lines changed: 1 addition & 1 deletion
Large diffs are not rendered by default.

.codecortex/hotspots.md

Lines changed: 24 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -1,38 +1,38 @@
11
# Risk-Ranked Files
22

3-
> Auto-generated by CodeCortex. 41 commits analyzed over 90 days.
3+
> Auto-generated by CodeCortex. 46 commits analyzed over 90 days.
44
55
| File | Changes | Couplings | Bugs | Risk | Stability |
66
|------|---------|-----------|------|------|-----------|
7-
| `crates/datacortex-core/src/model/engine.rs` | 13 | 13 | 0 | 21.74 | volatile |
8-
| `crates/datacortex-core/src/model/mod.rs` | 11 | 11 | 0 | 18.74 | volatile |
9-
| `crates/datacortex-core/src/codec.rs` | 12 | 10 | 0 | 18.06 | volatile |
10-
| `crates/datacortex-core/src/mixer/dual_mixer.rs` | 11 | 9 | 0 | 18 | volatile |
11-
| `crates/datacortex-core/src/format/mod.rs` | 14 | 6 | 0 | 17.52 | volatile |
12-
| `crates/datacortex-core/src/model/word_model.rs` | 5 | 11 | 0 | 16.32 | stabilizing |
7+
| `crates/datacortex-core/src/model/engine.rs` | 13 | 13 | 0 | 21.64 | volatile |
8+
| `crates/datacortex-core/src/codec.rs` | 15 | 10 | 0 | 20.28 | volatile |
9+
| `crates/datacortex-core/src/format/mod.rs` | 16 | 7 | 0 | 19.78 | volatile |
10+
| `crates/datacortex-core/src/model/mod.rs` | 11 | 11 | 0 | 18.52 | volatile |
11+
| `crates/datacortex-core/src/mixer/dual_mixer.rs` | 11 | 9 | 0 | 17.96 | volatile |
12+
| `CLAUDE.md` | 17 | 0 | 0 | 17 | volatile |
1313
| `crates/datacortex-core/src/model/match_model.rs` | 4 | 10 | 0 | 16.3 | moderate |
14+
| `crates/datacortex-core/src/model/word_model.rs` | 5 | 11 | 0 | 16.22 | stabilizing |
1415
| `crates/datacortex-core/src/state/state_map.rs` | 4 | 9 | 0 | 14.24 | moderate |
15-
| `CLAUDE.md` | 14 | 0 | 0 | 14 | volatile |
16-
| `crates/datacortex-cli/src/main.rs` | 5 | 6 | 0 | 12.86 | stabilizing |
17-
| `Cargo.toml` | 5 | 6 | 0 | 12.7 | stabilizing |
18-
| `crates/datacortex-core/Cargo.toml` | 5 | 6 | 0 | 12.7 | stabilizing |
19-
| `crates/datacortex-core/src/format/transform.rs` | 10 | 1 | 0 | 11.42 | volatile |
16+
| `crates/datacortex-cli/src/main.rs` | 6 | 6 | 0 | 13 | stabilizing |
17+
| `crates/datacortex-core/src/format/transform.rs` | 11 | 1 | 0 | 12.38 | volatile |
18+
| `Cargo.toml` | 5 | 6 | 0 | 12.14 | stabilizing |
19+
| `crates/datacortex-core/Cargo.toml` | 5 | 6 | 0 | 12.14 | stabilizing |
20+
| `.codecortex/constitution.md` | 12 | 0 | 0 | 12 | volatile |
21+
| `.codecortex/cortex.yaml` | 12 | 0 | 0 | 12 | volatile |
22+
| `.codecortex/graph.json` | 12 | 0 | 0 | 12 | volatile |
23+
| `.codecortex/hotspots.md` | 12 | 0 | 0 | 12 | volatile |
24+
| `.codecortex/symbols.json` | 12 | 0 | 0 | 12 | volatile |
25+
| `.codecortex/temporal.json` | 12 | 0 | 0 | 12 | volatile |
2026
| `crates/datacortex-core/src/model/cm_model.rs` | 4 | 6 | 0 | 11.04 | moderate |
21-
| `crates/datacortex-core/src/mixer/mod.rs` | 7 | 5 | 0 | 10.76 | stabilizing |
22-
| `crates/datacortex-core/src/lib.rs` | 5 | 5 | 0 | 10.38 | stabilizing |
27+
| `crates/datacortex-core/src/lib.rs` | 6 | 5 | 0 | 11 | stabilizing |
28+
| `crates/datacortex-core/src/mixer/mod.rs` | 7 | 5 | 0 | 10.58 | stabilizing |
2329
| `crates/datacortex-core/src/model/json_model.rs` | 3 | 5 | 0 | 10.16 | moderate |
2430
| `crates/datacortex-core/src/model/run_model.rs` | 3 | 5 | 0 | 10.16 | moderate |
2531
| `crates/datacortex-core/src/model/sparse_model.rs` | 3 | 5 | 0 | 10.16 | moderate |
2632
| `crates/datacortex-core/src/mixer/apm.rs` | 3 | 6 | 0 | 9.7 | moderate |
27-
| `crates/datacortex-core/src/state/mod.rs` | 4 | 5 | 0 | 9.08 | moderate |
28-
| `.codecortex/constitution.md` | 9 | 0 | 0 | 9 | volatile |
29-
| `.codecortex/cortex.yaml` | 9 | 0 | 0 | 9 | volatile |
30-
| `.codecortex/graph.json` | 9 | 0 | 0 | 9 | volatile |
31-
| `.codecortex/hotspots.md` | 9 | 0 | 0 | 9 | volatile |
32-
| `.codecortex/symbols.json` | 9 | 0 | 0 | 9 | volatile |
33-
| `.codecortex/temporal.json` | 9 | 0 | 0 | 9 | volatile |
34-
| `crates/datacortex-cli/Cargo.toml` | 3 | 4 | 0 | 8.6 | moderate |
35-
| `crates/datacortex-neural/Cargo.toml` | 3 | 4 | 0 | 8.6 | moderate |
33+
| `crates/datacortex-core/src/state/mod.rs` | 4 | 5 | 0 | 8.98 | moderate |
34+
| `crates/datacortex-cli/Cargo.toml` | 3 | 4 | 0 | 8.4 | moderate |
35+
| `crates/datacortex-neural/Cargo.toml` | 3 | 4 | 0 | 8.4 | moderate |
3636
| `crates/datacortex-core/src/mixer/logistic.rs` | 3 | 3 | 0 | 6.54 | moderate |
3737

38-
Generated: 2026-03-24T21:37:40.094Z
38+
Generated: 2026-03-25T08:29:06.050Z
Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,15 @@
1+
# Session: 2026-03-25T07:12:22.645Z
2+
**ID:** 2026-03-25T07-12-22
3+
**Previous:** 2026-03-24T22-25-21
4+
## Summary
5+
Updated knowledge. 1010 symbols, 3 modules.
6+
## Files Changed
7+
- `.codecortex/constitution.md`
8+
- `.codecortex/cortex.yaml`
9+
- `.codecortex/graph.json`
10+
- `.codecortex/hotspots.md`
11+
- `.codecortex/symbols.json`
12+
- `.codecortex/temporal.json`
13+
- `CLAUDE.md`
14+
## Modules Affected
15+
- root
Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,15 @@
1+
# Session: 2026-03-25T07:34:02.466Z
2+
**ID:** 2026-03-25T07-34-02
3+
**Previous:** 2026-03-25T07-12-22
4+
## Summary
5+
Updated knowledge. 1010 symbols, 3 modules.
6+
## Files Changed
7+
- `.codecortex/constitution.md`
8+
- `.codecortex/cortex.yaml`
9+
- `.codecortex/graph.json`
10+
- `.codecortex/hotspots.md`
11+
- `.codecortex/symbols.json`
12+
- `.codecortex/temporal.json`
13+
- `CLAUDE.md`
14+
## Modules Affected
15+
- root
Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,15 @@
1+
# Session: 2026-03-25T08:03:28.692Z
2+
**ID:** 2026-03-25T08-03-28
3+
**Previous:** 2026-03-25T07-34-02
4+
## Summary
5+
Updated knowledge. 1015 symbols, 3 modules.
6+
## Files Changed
7+
- `.codecortex/constitution.md`
8+
- `.codecortex/cortex.yaml`
9+
- `.codecortex/graph.json`
10+
- `.codecortex/hotspots.md`
11+
- `.codecortex/symbols.json`
12+
- `.codecortex/temporal.json`
13+
- `CLAUDE.md`
14+
## Modules Affected
15+
- root
Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,15 @@
1+
# Session: 2026-03-25T08:29:06.066Z
2+
**ID:** 2026-03-25T08-29-06
3+
**Previous:** 2026-03-25T08-03-28
4+
## Summary
5+
Updated knowledge. 1028 symbols, 3 modules.
6+
## Files Changed
7+
- `.codecortex/constitution.md`
8+
- `.codecortex/cortex.yaml`
9+
- `.codecortex/graph.json`
10+
- `.codecortex/hotspots.md`
11+
- `.codecortex/symbols.json`
12+
- `.codecortex/temporal.json`
13+
- `CLAUDE.md`
14+
## Modules Affected
15+
- root

.codecortex/symbols.json

Lines changed: 1 addition & 1 deletion
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)