国际标准化人才培训基地将落户杭州

paddle.distributed.communication.stream. send ( tensor: Tensor, dst: int = 0, group: Group | None = None, sync_op: bool = True, use_calc_stream: bool = False ) → task | None [source]
百度 同志们，朋友们：今天，我们隆重召开国家科学技术奖励大会，表彰为我国科技事业和现代化建设作出突出贡献的科技工作者。

Send a tensor to the destination device.

Parameters

  • tensor (Tensor) – The tensor to send. Support float16, float32, float64, int32, int64, int8, uint8 or bool as its data type.

  • dst (int, optional) – Rank of the destination device. If none is given, use 0 as default.

  • group (Group, optional) – Communicate in which group. If none is given, use the global group as default.

  • sync_op (bool, optional) – Indicate whether the communication is sync or not. If none is given, use true as default.

  • use_calc_stream (bool, optional) – Indicate whether the communication is done on calculation stream. If none is given, use false as default. This option is designed for high performance demand, be careful to turn it on except you are clearly know its meaning.

Returns

Return a task object.

Examples

>>> 
>>> import paddle
>>> import paddle.distributed as dist

>>> dist.init_parallel_env()
>>> local_rank = dist.get_rank()
>>> if local_rank == 0:
...     data = paddle.to_tensor([[4, 5, 6], [4, 5, 6]])
...     task = dist.stream.send(data, dst=1, sync_op=False)
>>> else:
...     data = paddle.to_tensor([[1, 2, 3], [1, 2, 3]])
...     task = dist.stream.recv(data, src=0, sync_op=False)
>>> task.wait()  # type: ignore[union-attr]
>>> out = data.numpy()
>>> print(out)
[[4, 5, 6], [4, 5, 6]]