Skip to content

Commit 7131087

Browse files
committed
Fix broken paper references to deleted files and paths
- Replace PROPER_BASELINE_COMMANDS.sh → EXPERIMENTS_REFERENCE.sh - Update experiment count from 135 → 153 (includes Phase 6 TTQ) - Fix all paper/tmlr/ paths → paper/ (flattened directory structure) - Update build instructions: cd paper && make (not cd paper/tmlr) - Fix references in methods.tex, appendix, and results.tex - Recompile paper successfully (28 pages, 552 KB)
1 parent 86367dd commit 7131087

4 files changed

Lines changed: 13 additions & 13 deletions

File tree

paper/main.pdf

-5 Bytes
Binary file not shown.

paper/sections/03_methods.tex

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -24,14 +24,14 @@ \subsection{Reproducible Research Pipeline}
2424

2525
\item \textbf{Aggregation:} \texttt{analysis/aggregate\_results.py} recursively scans \texttt{results/raw/} and \texttt{results/raw\_kd/} directories, loading all \texttt{results.json} files into a unified DataFrame saved as \texttt{results/processed/aggregated.csv}. No filtering or manual selection—all completed experiments included.
2626

27-
\item \textbf{Table generation:} \texttt{analysis/generate\_tables.py} reads the CSV and produces LaTeX tables (\texttt{paper/tmlr/tables/*.tex}) with:
27+
\item \textbf{Table generation:} \texttt{analysis/generate\_tables.py} reads the CSV and produces LaTeX tables (\texttt{paper/tables/*.tex}) with:
2828
\begin{itemize}
2929
\item Mean ± standard deviation across seeds
3030
\item Statistical tests (t-test, Cohen's d)
3131
\item Gap calculations (FP32 - BitNet, FP32+KD - BitNet+Recipe)
3232
\end{itemize}
3333

34-
\item \textbf{Figure generation:} \texttt{analysis/generate\_figures.py} creates publication-quality matplotlib figures (\texttt{paper/tmlr/figures/*.pdf}) directly from CSV data.
34+
\item \textbf{Figure generation:} \texttt{analysis/generate\_figures.py} creates publication-quality matplotlib figures (\texttt{paper/figures/*.pdf}) directly from CSV data.
3535

3636
\item \textbf{Paper integration:} LaTeX \texttt{\\input\{tables/*.tex\}} and \texttt{\\includegraphics\{figures/*.png\}} commands directly reference generated artifacts. No copy-paste or manual number entry.
3737
\end{enumerate}
@@ -258,10 +258,10 @@ \subsection{Code and Data Availability}
258258
\item \textbf{Training code:} \texttt{experiments/train.py}, \texttt{experiments/train\_kd.py}
259259
\item \textbf{Model implementations:} \texttt{bitnet/}, \texttt{experiments/models/}
260260
\item \textbf{Analysis scripts:} \texttt{analysis/*.py}
261-
\item \textbf{Experiment documentation:} \texttt{PROPER\_BASELINE\_COMMANDS.sh} (all 135 commands)
261+
\item \textbf{Experiment documentation:} \texttt{EXPERIMENTS\_REFERENCE.sh} (all 153 commands)
262262
\item \textbf{Raw results:} \texttt{results/raw/}, \texttt{results/raw\_kd/} (JSON files)
263263
\item \textbf{Processed data:} \texttt{results/processed/aggregated.csv}
264-
\item \textbf{Generated artifacts:} \texttt{paper/tmlr/tables/*.tex}, \texttt{paper/tmlr/figures/*.pdf}
264+
\item \textbf{Generated artifacts:} \texttt{paper/tables/*.tex}, \texttt{paper/figures/*.pdf}
265265
\end{itemize}
266266

267267
Dependencies managed with \texttt{uv} (Python package manager), locked versions in \texttt{uv.lock} for exact reproducibility.

paper/sections/05_results.tex

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
% Section 5: Results
2-
% Generated from 133 completed experiments (results/processed/aggregated.csv)
3-
% Tables: paper/tmlr/tables/*.tex
4-
% Figures: paper/tmlr/figures/*.png
2+
% Generated from 153 completed experiments (results/processed/aggregated.csv)
3+
% Tables: paper/tables/*.tex
4+
% Figures: paper/figures/*.png
55

66
\section{Results}
77
\label{sec:results}

paper/sections/08_appendix_reproducibility.tex

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ \subsection{Repository Structure}
2323
aggregate_results.py # CSV aggregation
2424
generate_tables.py # LaTeX tables
2525
generate_paper_figures.py # Publication figures
26-
paper/tmlr/ # Paper source
26+
paper/ # Paper source
2727
main.tex # Main document
2828
sections/ # Modular sections
2929
tables/ # Auto-generated LaTeX tables
@@ -61,12 +61,12 @@ \subsection{Complete Pipeline Execution}
6161
uv run python -m analysis.generate_tables
6262
uv run python -m analysis.generate_paper_figures
6363
uv run python -m analysis.generate_model_size_table
64-
# Output: paper/tmlr/tables/*.tex, paper/tmlr/figures/*.pdf
64+
# Output: paper/tables/*.tex, paper/figures/*.pdf
6565
\end{verbatim}
6666

6767
\textbf{Step 4: Compile paper}
6868
\begin{verbatim}
69-
cd paper/tmlr && make
69+
cd paper && make
7070
# Output: main.pdf (this document)
7171
\end{verbatim}
7272

@@ -82,7 +82,7 @@ \subsection{Verification Without Retraining}
8282
uv run python -m analysis.aggregate_results
8383
uv run python -m analysis.generate_tables
8484
uv run python -m analysis.generate_paper_figures
85-
cd paper/tmlr && make
85+
cd paper && make
8686
\end{verbatim}
8787

8888
\textbf{Option 2: Spot-check individual experiments}
@@ -208,11 +208,11 @@ \subsection{Reproducibility Checklist}
208208
\begin{itemize}
209209
\item[$\boxtimes$] \textbf{Code:} Complete source code provided
210210
\item[$\boxtimes$] \textbf{Data:} Public datasets with download links
211-
\item[$\boxtimes$] \textbf{Model checkpoints:} All 135 experiment checkpoints archived
211+
\item[$\boxtimes$] \textbf{Model checkpoints:} All 153 experiment checkpoints archived
212212
\item[$\boxtimes$] \textbf{Hyperparameters:} Documented in \texttt{config.json} per experiment
213213
\item[$\boxtimes$] \textbf{Seeds:} Fixed seeds (42, 123, 456) for reproducibility
214214
\item[$\boxtimes$] \textbf{Dependencies:} Exact versions in \texttt{uv.lock}
215-
\item[$\boxtimes$] \textbf{Commands:} Complete experiment commands in \texttt{PROPER\_BASELINE\_COMMANDS.sh}
215+
\item[$\boxtimes$] \textbf{Commands:} Complete experiment commands in \texttt{EXPERIMENTS\_REFERENCE.sh}
216216
\item[$\boxtimes$] \textbf{Random state:} Deterministic training (same seed = identical results)
217217
\item[$\boxtimes$] \textbf{Compute:} Hardware specs and total GPU-hours reported
218218
\item[$\boxtimes$] \textbf{Pipeline:} Automated artifact generation (no manual transcription)

0 commit comments

Comments
 (0)