Chris Driedger made 29 saves for the Panthers (3-0-1), who had started a season with three wins for the first time.
Florida tied its second-longest point streak to start a season, matching 1998-99 (two wins, two ties) and 1999-00 (three wins, one tie). In 1996-97, it opened with eight wins and four ties.
"Anybody could take that (seven out of eight points), but at the end of the day, never being satisfied is what makes you better and makes you more successful," Panthers defenseman Aaron Ekblad.
"I don't think we're walking out of here licking our wounds by any means, but we obviously have to know that we can beat a team like this, and know you can take the lead in games, but there's a lot to work."
Domi's power-play goal gave Columbus a 2-1 lead at 6:19 of the third period. It came five seconds Jonathan Huberdeau was called for slashing Liam Foudy. Domi won the face-off at the right dot to Zach Werenski, who retuned the puck to Domi at the top of the circle for a slap shot.
"It was a great pass from 'Z,'" Domi said. "You've just got to hit the net and do it as hard as you can.
"It was nice to get the extra point tonight and we were really happy we could answer the bell tonight, obviously, coming off a tough game as a whole."