The fastest interconnect for hundreds of CPUs, GPUs and FPGAs (make a supercomputer)

About the fastest inter-server and inter-device communication with bandwidth more than 100 Gbit/sec and latency 0.5 usec
Algorithms and IT-solutions: multicore, high performance computing, computer vision, neural network. Considered approaches with the best ratio: speed / simplicity, speed / accuracy, speed / reliability.