197 passing tests were not evidence that RDMA worked.
roce-preflight is a diagnostic tool for RoCE hosts. Its most useful result was finding the boundary its own test suite had not crossed.
Parsers, ranking logic, snapshots, and lifecycle decisions were well tested against synthetic state, but the suite did not require an RDMA device.
Real RDMA execution exposed four defects after 197 tests passed. The first attempted correction also passed the unit suite and still failed on-device.
The CI job creates a Linux soft-RoCE device, asserts the backend did not fall back to simulation, exercises real verbs/sysfs state, and sends real perftest traffic.
Soft-RoCE validates kernel/userspace interface assumptions. It does not establish mlx5, firmware, PCIe/NUMA, switch, PFC/ECN, multi-host, or production-performance claims.
What failed
fe80:: GID and failed with ENETUNREACH