Kapanen, the Penguins' first-round pick in the 2014 NHL Draft, scored a power-play goal 5:52 into the game by roofing a shot past Sergei Bobrovsky. Ebbett, who dressed because Sidney Crosby missed the game because of the death of his grandmother, doubled the lead at 11:44.
Crosby had been expected to make his preseason debut.
Brian Gibbons, who played for the Penguins last season before signing with the Blue Jackets as a free agent this summer, scored a power-play goal early in the third period. It was the only one of Columbus' 19 shots to beat Marc-Andre Fleury.
Bobrovsky finished with 29 saves for Columbus, which had won its first four preseason games, including a 2-0 victory against the Penguins at Nationwide Arena on Tuesday.
For more from the Penguins website, CLICK HERE.
For more from the Blue Jackets website, CLICK HERE.