Interesting, thanks. From the wikipedia link, this seems like the probable culpr... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

eigenvalue on July 12, 2024 | parent | context | favorite | on: So you want to rent an NVIDIA H100 cluster? 2024 C...

Interesting, thanks. From the wikipedia link, this seems like the probable culprit for why things break:

"Although in general the delivery order of UDP packets is not guaranteed, the RoCEv2 specification requires that packets with the same UDP source port and the same destination address must not be reordered."

wmf on July 12, 2024 [–]

In practice it's easy to design an Ethernet network that doesn't reorder packets.

eigenvalue on July 13, 2024 | [–]

But if packets have to go over the internet at some point, aren't all bets off if you use UDP?

wmf on July 13, 2024 | | [–]

ROCE doesn't go over the Internet, most ISPs don't reorder packets, and UDP isn't treated specially.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact