Skip to content

Commit c5f5485

Browse files
committed
Fix README to match paper scope
- Update Supported Models to list only ResNet-18 and ResNet-50 - Add note that other architectures exist in code but not in paper - Fix dataset references: ImageNet-1k → Tiny-ImageNet - Update seed counts to include statistical power experiments (n=10) - Fix experiment count comment in sweep example
1 parent f19d213 commit c5f5485

File tree

1 file changed

+8
-9
lines changed

1 file changed

+8
-9
lines changed

README.md

Lines changed: 8 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -67,9 +67,9 @@ uv run python -m experiments.train --model resnet18 --dataset cifar10 --epochs 2
6767
# Dry run (shows commands without executing)
6868
uv run python -m experiments.sweep --dry-run
6969

70-
# Run all experiments (90 total: 5 models × 3 datasets × 2 versions × 3 seeds)
71-
# Uses --quiet mode automatically, shows compact progress: [1/90] Running... 92.34%
72-
uv run python -m experiments.sweep
70+
# Run all experiments (paper uses 2 models × 3 datasets × 2 versions × 3 seeds)
71+
# Uses --quiet mode automatically, shows compact progress
72+
uv run python -m experiments.sweep --models resnet18 resnet50
7373

7474
# Run subset
7575
uv run python -m experiments.sweep --models resnet18 resnet50 --datasets cifar10 cifar100
@@ -156,9 +156,8 @@ uv run python -m analysis.generate_figures
156156
|-------|-----------|
157157
| ResNet-18 | `resnet18` |
158158
| ResNet-50 | `resnet50` |
159-
| VGG-16 | `vgg16` |
160-
| MobileNetV2 | `mobilenetv2_100` |
161-
| EfficientNet-B0 | `efficientnet_b0` |
159+
160+
**Note:** The codebase supports additional architectures (VGG-16, MobileNetV2, EfficientNet-B0, ConvNeXt) via timm integration, but the paper focuses on ResNet-18 and ResNet-50 for systematic comparison across 153 experiments.
162161

163162
## Project Structure
164163

@@ -279,9 +278,9 @@ Re-running experiments with the same seed produces bit-exact checkpoint MD5 hash
279278

280279
Compare standard FP32 vs BitNet 1.58-bit across:
281280

282-
- **Models**: ResNet-18, ResNet-50, VGG-16, MobileNetV2, EfficientNet-B0
283-
- **Datasets**: CIFAR-10, CIFAR-100, ImageNet-1k
284-
- **Seeds**: 3 seeds per configuration for statistical significance
281+
- **Models**: ResNet-18, ResNet-50
282+
- **Datasets**: CIFAR-10, CIFAR-100, Tiny-ImageNet
283+
- **Seeds**: 3 seeds per configuration for statistical significance (10 seeds for statistical power analysis)
285284

286285
### Augmentation Ablation Study
287286

0 commit comments

Comments
 (0)