Allgather by Logarithmic Expansion
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
In general the math looks like:
Assume you have
processes
with
.
Assume each block of
nodes have gathered their data.
Let
be even
.
In the next step
and
exchange , hence gather, their data.
For in
and