a big problem and data passing among GPUs is also very difficult. With the speed like this, to push a little further requires almost double the money. Otherwise, you will see PFLOP computers everywhere.