A jump in domestic mergers will likely continue in 2018, but big deals could prove elusive on "competition issues."