Skip to content

rpc : refactor the RPC transport#21998

Merged
ggerganov merged 3 commits into
ggml-org:masterfrom
rgerganov:rpc-rdma-refactor
Apr 19, 2026
Merged

rpc : refactor the RPC transport#21998
ggerganov merged 3 commits into
ggml-org:masterfrom
rgerganov:rpc-rdma-refactor

Conversation

@rgerganov

Copy link
Copy Markdown
Member

Move all transport related code into a separate file and use the socket_t interface to hide all transport implementation details.

Move all transport related code into a separate file and use the
socket_t interface to hide all transport implementation details.
@github-actions github-actions Bot added the ggml changes relating to the ggml tensor library for machine learning label Apr 16, 2026
@rgerganov

Copy link
Copy Markdown
Member Author

Did some testing on the DGX cluster and haven't find any regressions so far.
The change is ready for review.

@rgerganov
rgerganov marked this pull request as ready for review April 17, 2026 08:52
@rgerganov
rgerganov requested a review from a team as a code owner April 17, 2026 08:52
@rgerganov rgerganov self-assigned this Apr 17, 2026
@rgerganov
rgerganov requested a review from ggerganov April 17, 2026 08:52
@ggerganov ggerganov added the merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge. label Apr 17, 2026
@ggerganov
ggerganov merged commit 91fef95 into ggml-org:master Apr 19, 2026
46 of 50 checks passed
ArberSephirotheca pushed a commit to ArberSephirotheca/llama.cpp that referenced this pull request Apr 21, 2026
* rpc : refactor the RPC transport

Move all transport related code into a separate file and use the
socket_t interface to hide all transport implementation details.

* fix win32

* better socket_t construction
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Apr 23, 2026
* rpc : refactor the RPC transport

Move all transport related code into a separate file and use the
socket_t interface to hide all transport implementation details.

* fix win32

* better socket_t construction
ljubomirj pushed a commit to ljubomirj/llama.cpp that referenced this pull request May 6, 2026
* rpc : refactor the RPC transport

Move all transport related code into a separate file and use the
socket_t interface to hide all transport implementation details.

* fix win32

* better socket_t construction
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
* rpc : refactor the RPC transport

Move all transport related code into a separate file and use the
socket_t interface to hide all transport implementation details.

* fix win32

* better socket_t construction
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
* rpc : refactor the RPC transport

Move all transport related code into a separate file and use the
socket_t interface to hide all transport implementation details.

* fix win32

* better socket_t construction
fewtarius pushed a commit to fewtarius/CachyLLama that referenced this pull request May 30, 2026
* rpc : refactor the RPC transport

Move all transport related code into a separate file and use the
socket_t interface to hide all transport implementation details.

* fix win32

* better socket_t construction
MrLordCat referenced this pull request in MrLordCat/llama.cpp-with-GUI Jul 16, 2026
* rpc : refactor the RPC transport

Move all transport related code into a separate file and use the
socket_t interface to hide all transport implementation details.

* fix win32

* better socket_t construction
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ggml changes relating to the ggml tensor library for machine learning merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants