Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file removed books/fl/src/assets/FedProxAdaptation_bottom.png
Binary file not shown.
Binary file removed books/fl/src/assets/FedProxAdaptation_top.png
Binary file not shown.
4 changes: 0 additions & 4 deletions books/fl/src/assets/SplitModels.svg

This file was deleted.

1,010 changes: 0 additions & 1,010 deletions books/fl/src/assets/algorithm-fedopt.svg

This file was deleted.

661 changes: 0 additions & 661 deletions books/fl/src/assets/algorithm-fedprox.svg

This file was deleted.

447 changes: 0 additions & 447 deletions books/fl/src/assets/algorithm-fedsgd.svg

This file was deleted.

647 changes: 0 additions & 647 deletions books/fl/src/assets/algorithm-moon.svg

This file was deleted.

223 changes: 0 additions & 223 deletions books/fl/src/assets/combined_loss_objective.svg

This file was deleted.

Binary file removed books/fl/src/assets/fed_df_model.png
Binary file not shown.
881 changes: 0 additions & 881 deletions books/fl/src/assets/fedavg_drift.svg

This file was deleted.

Binary file removed books/fl/src/assets/fedavg_model.png
Binary file not shown.
994 changes: 0 additions & 994 deletions books/fl/src/assets/fedsgd_steps.svg

This file was deleted.

4 changes: 0 additions & 4 deletions books/fl/src/assets/heterogeneity_two_routes_alt.svg

This file was deleted.

Binary file removed books/fl/src/assets/local_model_1.png
Binary file not shown.
Binary file removed books/fl/src/assets/local_model_2.png
Binary file not shown.
10 changes: 5 additions & 5 deletions books/fl/src/horizontal/robust_global_fl/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -109,8 +109,8 @@ datasets.

<figure>
<center>
<img src="../../assets/local_model_1.png" alt="Local Model 1", height="300">
<img src="../../assets/local_model_2.png" alt="Local Model 2", height="300">
<img src="https://d3ddy8balm3goa.cloudfront.net/vector-ai-pocket-refs/fl/local_model_1.png" alt="Local Model 1", height="300">
<img src="https://d3ddy8balm3goa.cloudfront.net/vector-ai-pocket-refs/fl/local_model_2.png" alt="Local Model 2", height="300">
<figcaption>Two clients with different datasets. Note that each holds a
slightly different view of the feature space. Notably, Client 1 (left) has a
distinct cluster of data points in the bottom right and fewer points labeled in
Expand All @@ -129,8 +129,8 @@ distributions from a global perspective.

<figure>
<center>
<img src="../../assets/fedavg_model.png" alt="FedAvg Model", height="300">
<img src="../../assets/fed_df_model.png" alt="FedDF Model", height="300">
<img src="https://d3ddy8balm3goa.cloudfront.net/vector-ai-pocket-refs/fl/fedavg_model.png" alt="FedAvg Model", height="300">
<img src="https://d3ddy8balm3goa.cloudfront.net/vector-ai-pocket-refs/fl/fed_df_model.png" alt="FedDF Model", height="300">
<figcaption>Model resulting from FedAvg (left) compared with the model
trained using FedDF (right).</figcaption>
</center>
Expand All @@ -150,7 +150,7 @@ FL, but more strongly emphasize local distributions.

<figure>
<center>
<img src="../../assets/heterogeneity_two_routes_alt.svg" alt="Two FL Routes", width="75%">
<img src="https://d3ddy8balm3goa.cloudfront.net/vector-ai-pocket-refs/fl/heterogeneity_two_routes_alt.svg" alt="Two FL Routes", width="75%">
<figcaption>Two possible routes for addressing data heterogeneity in FL.</figcaption>
</center>
</figure>
Expand Down
2 changes: 1 addition & 1 deletion books/fl/src/horizontal/robust_global_fl/fedopt.md
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@ FedYogi have been proposed. See the algorithm below for details.

<figure>
<center>
<img src="../../assets/algorithm-fedopt.svg" alt="FedOpt Algorithms" width="100%">
<img src="https://d3ddy8balm3goa.cloudfront.net/vector-ai-pocket-refs/fl/algorithm-fedopt.svg" alt="FedOpt Algorithms" width="100%">
</center>
</figure>

Expand Down
12 changes: 6 additions & 6 deletions books/fl/src/horizontal/robust_global_fl/fedprox.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ client loss functions are distinct from the global minimum.

<figure>
<center>
<img src="../../assets/combined_loss_objective.svg" alt="Combined loss objective" width="66%">
<img src="https://d3ddy8balm3goa.cloudfront.net/vector-ai-pocket-refs/fl/combined_loss_objective.svg" alt="Combined loss objective" width="66%">
<figcaption>Comparison of local loss landscapes for two clients with the combined global loss.</figcaption>
</center>
</figure>
Expand All @@ -38,7 +38,7 @@ step makes steady progress towards the global minimum.

<figure>
<center>
<img src="../../assets/fedsgd_steps.svg" alt="FedSGD and global convergence" width="66%">
<img src="https://d3ddy8balm3goa.cloudfront.net/vector-ai-pocket-refs/fl/fedsgd_steps.svg" alt="FedSGD and global convergence" width="66%">
<figcaption>FedSGD rounds result in averaged models making steady progress towards
the global minimum.</figcaption>
</center>
Expand All @@ -56,7 +56,7 @@ below.

<figure>
<center>
<img src="../../assets/fedavg_drift.svg" alt="FedAvg and the influence of local drift" width="66%">
<img src="https://d3ddy8balm3goa.cloudfront.net/vector-ai-pocket-refs/fl/fedavg_drift.svg" alt="FedAvg and the influence of local drift" width="66%">
<figcaption>Illustration of "client drift" in FedAvg updates caused by
differences in the shape of the local loss functions of each client.</figcaption>
</center>
Expand Down Expand Up @@ -101,7 +101,7 @@ modification coming in the local update calculations.

<figure>
<center>
<img src="../../assets/algorithm-fedprox.svg" alt="FedProx Algorithms" width="100%">
<img src="https://d3ddy8balm3goa.cloudfront.net/vector-ai-pocket-refs/fl/algorithm-fedprox.svg" alt="FedProx Algorithms" width="100%">
</center>
</figure>

Expand All @@ -124,8 +124,8 @@ line in the Figures below.

<figure>
<center>
<img src="../../assets/FedProxAdaptation_top.png" alt="FedProx vs. FedAvg" width="100%">
<img src="../../assets/FedProxAdaptation_bottom.png" alt="FedProx vs. FedAvg" width="100%">
<img src="https://d3ddy8balm3goa.cloudfront.net/vector-ai-pocket-refs/fl/FedProxAdaptation_top.png" alt="FedProx vs. FedAvg" width="100%">
<img src="https://d3ddy8balm3goa.cloudfront.net/vector-ai-pocket-refs/fl/FedProxAdaptation_bottom.png" alt="FedProx vs. FedAvg" width="100%">
<figcaption>Comparison of FedProx to FedAvg in various settings. On the top left,
data is homogeneous across clients. Without adaptation FedProx struggles to out
perform FedAvg. Data is heterogeneous in the other settings and FedProx performs
Expand Down
4 changes: 2 additions & 2 deletions books/fl/src/horizontal/robust_global_fl/moon.md
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,7 @@ models. These models are illustrated in the figure below.

<figure>
<center>
<img src="../../assets/SplitModels.svg" alt="Moon models and their latent representation" width="100%">
<img src="https://d3ddy8balm3goa.cloudfront.net/vector-ai-pocket-refs/fl/SplitModels.svg" alt="Moon models and their latent representation" width="100%">
<figcaption>The three models important in the computation of MOON's
contrastive loss functions and their latent representations.</figcaption>
</center>
Expand Down Expand Up @@ -117,7 +117,7 @@ below, FedAvg is used as the server-side strategy.

<figure>
<center>
<img src="../../assets/algorithm-moon.svg" alt="Moon Algorithms" width="100%">
<img src="https://d3ddy8balm3goa.cloudfront.net/vector-ai-pocket-refs/fl/algorithm-moon.svg" alt="Moon Algorithms" width="100%">
</center>
</figure>

Expand Down
2 changes: 1 addition & 1 deletion books/fl/src/horizontal/vanilla_fl/fedsgd.md
Original file line number Diff line number Diff line change
Expand Up @@ -118,7 +118,7 @@ client receives the final model as described by the weights \\(\mathbf{w}\_T\\).

<figure>
<center>
<img src="../../assets/algorithm-fedsgd.svg" alt="FedSGD Algorithm" width="100%">
<img src="https://d3ddy8balm3goa.cloudfront.net/vector-ai-pocket-refs/fl/algorithm-fedsgd.svg" alt="FedSGD Algorithm" width="100%">
</center>
</figure>

Expand Down
Binary file removed books/fl/src/image.png
Binary file not shown.