diff --git a/books/fl/src/assets/FedProxAdaptation_bottom.png b/books/fl/src/assets/FedProxAdaptation_bottom.png deleted file mode 100644 index b4e1ec6..0000000 Binary files a/books/fl/src/assets/FedProxAdaptation_bottom.png and /dev/null differ diff --git a/books/fl/src/assets/FedProxAdaptation_top.png b/books/fl/src/assets/FedProxAdaptation_top.png deleted file mode 100644 index 59d6e6e..0000000 Binary files a/books/fl/src/assets/FedProxAdaptation_top.png and /dev/null differ diff --git a/books/fl/src/assets/SplitModels.svg b/books/fl/src/assets/SplitModels.svg deleted file mode 100644 index d0d4588..0000000 --- a/books/fl/src/assets/SplitModels.svg +++ /dev/null @@ -1,4 +0,0 @@ - - - -
Feature Map
Input Features
Classifier
Label
Global Model
Feature Map
Input Features
Classifier
Label
Previous Local Model
Feature Map
Input Features
Classifier
Label
Current Local Model
 diff --git a/books/fl/src/assets/algorithm-fedopt.svg b/books/fl/src/assets/algorithm-fedopt.svg deleted file mode 100644 index 938fc65..0000000 --- a/books/fl/src/assets/algorithm-fedopt.svg +++ /dev/null @@ -1,1010 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/books/fl/src/assets/algorithm-fedprox.svg b/books/fl/src/assets/algorithm-fedprox.svg deleted file mode 100644 index e1a8956..0000000 --- a/books/fl/src/assets/algorithm-fedprox.svg +++ /dev/null @@ -1,661 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/books/fl/src/assets/algorithm-fedsgd.svg b/books/fl/src/assets/algorithm-fedsgd.svg deleted file mode 100644 index 6dbc801..0000000 --- a/books/fl/src/assets/algorithm-fedsgd.svg +++ /dev/null @@ -1,447 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/books/fl/src/assets/algorithm-moon.svg b/books/fl/src/assets/algorithm-moon.svg deleted file mode 100644 index 5a8be95..0000000 --- a/books/fl/src/assets/algorithm-moon.svg +++ /dev/null @@ -1,647 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/books/fl/src/assets/combined_loss_objective.svg b/books/fl/src/assets/combined_loss_objective.svg deleted file mode 100644 index c427a50..0000000 --- a/books/fl/src/assets/combined_loss_objective.svg +++ /dev/null @@ -1,223 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/books/fl/src/assets/fed_df_model.png b/books/fl/src/assets/fed_df_model.png deleted file mode 100644 index 5a397fc..0000000 Binary files a/books/fl/src/assets/fed_df_model.png and /dev/null differ diff --git a/books/fl/src/assets/fedavg_drift.svg b/books/fl/src/assets/fedavg_drift.svg deleted file mode 100644 index a275ebc..0000000 --- a/books/fl/src/assets/fedavg_drift.svg +++ /dev/null @@ -1,881 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/books/fl/src/assets/fedavg_model.png b/books/fl/src/assets/fedavg_model.png deleted file mode 100644 index 561c3c3..0000000 Binary files a/books/fl/src/assets/fedavg_model.png and /dev/null differ diff --git a/books/fl/src/assets/fedsgd_steps.svg b/books/fl/src/assets/fedsgd_steps.svg deleted file mode 100644 index b36a495..0000000 --- a/books/fl/src/assets/fedsgd_steps.svg +++ /dev/null @@ -1,994 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/books/fl/src/assets/heterogeneity_two_routes_alt.svg b/books/fl/src/assets/heterogeneity_two_routes_alt.svg deleted file mode 100644 index ac5ccb4..0000000 --- a/books/fl/src/assets/heterogeneity_two_routes_alt.svg +++ /dev/null @@ -1,4 +0,0 @@ - - - -
Global FL with Robust Optimization
Personalized FL
Two Common
Routes
 diff --git a/books/fl/src/assets/local_model_1.png b/books/fl/src/assets/local_model_1.png deleted file mode 100644 index 92b8bdc..0000000 Binary files a/books/fl/src/assets/local_model_1.png and /dev/null differ diff --git a/books/fl/src/assets/local_model_2.png b/books/fl/src/assets/local_model_2.png deleted file mode 100644 index 5ae2f17..0000000 Binary files a/books/fl/src/assets/local_model_2.png and /dev/null differ diff --git a/books/fl/src/horizontal/robust_global_fl/README.md b/books/fl/src/horizontal/robust_global_fl/README.md index 5e05feb..ef3c57a 100644 --- a/books/fl/src/horizontal/robust_global_fl/README.md +++ b/books/fl/src/horizontal/robust_global_fl/README.md @@ -109,8 +109,8 @@ datasets.
-Local Model 1 -Local Model 2 +Local Model 1 +Local Model 2
Two clients with different datasets. Note that each holds a slightly different view of the feature space. Notably, Client 1 (left) has a distinct cluster of data points in the bottom right and fewer points labeled in @@ -129,8 +129,8 @@ distributions from a global perspective.
-FedAvg Model -FedDF Model +FedAvg Model +FedDF Model
Model resulting from FedAvg (left) compared with the model trained using FedDF (right).
@@ -150,7 +150,7 @@ FL, but more strongly emphasize local distributions.
-Two FL Routes +Two FL Routes
Two possible routes for addressing data heterogeneity in FL.
diff --git a/books/fl/src/horizontal/robust_global_fl/fedopt.md b/books/fl/src/horizontal/robust_global_fl/fedopt.md index 109f77e..fdd8725 100644 --- a/books/fl/src/horizontal/robust_global_fl/fedopt.md +++ b/books/fl/src/horizontal/robust_global_fl/fedopt.md @@ -69,7 +69,7 @@ FedYogi have been proposed. See the algorithm below for details.
-FedOpt Algorithms +FedOpt Algorithms
diff --git a/books/fl/src/horizontal/robust_global_fl/fedprox.md b/books/fl/src/horizontal/robust_global_fl/fedprox.md index bc783d8..c7b1472 100644 --- a/books/fl/src/horizontal/robust_global_fl/fedprox.md +++ b/books/fl/src/horizontal/robust_global_fl/fedprox.md @@ -24,7 +24,7 @@ client loss functions are distinct from the global minimum.
-Combined loss objective +Combined loss objective
Comparison of local loss landscapes for two clients with the combined global loss.
@@ -38,7 +38,7 @@ step makes steady progress towards the global minimum.
-FedSGD and global convergence +FedSGD and global convergence
FedSGD rounds result in averaged models making steady progress towards the global minimum.
@@ -56,7 +56,7 @@ below.
-FedAvg and the influence of local drift +FedAvg and the influence of local drift
Illustration of "client drift" in FedAvg updates caused by differences in the shape of the local loss functions of each client.
@@ -101,7 +101,7 @@ modification coming in the local update calculations.
-FedProx Algorithms +FedProx Algorithms
@@ -124,8 +124,8 @@ line in the Figures below.
-FedProx vs. FedAvg -FedProx vs. FedAvg +FedProx vs. FedAvg +FedProx vs. FedAvg
Comparison of FedProx to FedAvg in various settings. On the top left, data is homogeneous across clients. Without adaptation FedProx struggles to out perform FedAvg. Data is heterogeneous in the other settings and FedProx performs diff --git a/books/fl/src/horizontal/robust_global_fl/moon.md b/books/fl/src/horizontal/robust_global_fl/moon.md index 9399740..da01bad 100644 --- a/books/fl/src/horizontal/robust_global_fl/moon.md +++ b/books/fl/src/horizontal/robust_global_fl/moon.md @@ -54,7 +54,7 @@ models. These models are illustrated in the figure below.
-Moon models and their latent representation +Moon models and their latent representation
The three models important in the computation of MOON's contrastive loss functions and their latent representations.
@@ -117,7 +117,7 @@ below, FedAvg is used as the server-side strategy.
-Moon Algorithms +Moon Algorithms
diff --git a/books/fl/src/horizontal/vanilla_fl/fedsgd.md b/books/fl/src/horizontal/vanilla_fl/fedsgd.md index c33bb55..40dd0f5 100644 --- a/books/fl/src/horizontal/vanilla_fl/fedsgd.md +++ b/books/fl/src/horizontal/vanilla_fl/fedsgd.md @@ -118,7 +118,7 @@ client receives the final model as described by the weights \\(\mathbf{w}\_T\\).
-FedSGD Algorithm +FedSGD Algorithm
diff --git a/books/fl/src/image.png b/books/fl/src/image.png deleted file mode 100644 index 31aad8b..0000000 Binary files a/books/fl/src/image.png and /dev/null differ