Yes, you can push the whole line of heroes unless there is no wall, beam or gameboard edge that blocks the front of the row.