ksuit.distributed.gather
========================

.. py:module:: ksuit.distributed.gather


Functions
---------

.. autoapisummary::

   ksuit.distributed.gather.get_device_and_bfloat16supported
   ksuit.distributed.gather.get_bool_gather_supported
   ksuit.distributed.gather.all_gather_grad
   ksuit.distributed.gather.all_gather_grad_autograd
   ksuit.distributed.gather.all_gather_nograd
   ksuit.distributed.gather.all_gather_nograd_clipped
   ksuit.distributed.gather.all_reduce_sum_nograd
   ksuit.distributed.gather.all_reduce_sum_grad
   ksuit.distributed.gather.all_reduce_mean_grad
   ksuit.distributed.gather.all_reduce_mean_nograd


Module Contents
---------------

.. py:function:: get_device_and_bfloat16supported()

.. py:function:: get_bool_gather_supported()

.. py:function:: all_gather_grad(x, batch_dim=0)

.. py:function:: all_gather_grad_autograd(x)

.. py:function:: all_gather_nograd(x)

.. py:function:: all_gather_nograd_clipped(x, max_length)

.. py:function:: all_reduce_sum_nograd(x)

.. py:function:: all_reduce_sum_grad(x)

.. py:function:: all_reduce_mean_grad(x)

.. py:function:: all_reduce_mean_nograd(x)