Wayne Simmonds and Will Butcher scored, and Mackenzie Blackwood made 21 saves for the Devils (5-8-4), who led 2-1 from late in the first period until midway through the third.
"[This is] inconsistency in our complete game as a group," Blackwood said. "It's not one person, it's everyone. We do a lot of great things, we have a lot of great players do a lot of great things, but we just made a couple of mistakes and they came back to bite us. Every team in this league is good, and on every given night you are hard challenged. We just have to come back and be better."
The Senators were coming off an 8-2 loss at the Carolina Hurricanes on Monday.
"We want to be known as a team that's going to play hard every night, and if we stay patient enough and stay in the game we're going to get our opportunities to score," Ottawa coach D.J. Smith said. "We don't score a lot of goals, but we've got to hold you to nothing. I didn't like our first period, thought we gave up too much, but after that I thought we locked it down pretty good."
Borowiecki scored on a snap shot from the top of the left face-off circle past a screened Blackwood at 13:30 of the third for a 2-2 tie.
"I thought we did a pretty good job of managing the puck," Devils captain Andy Greene said. "It was just two plays in the third, and those are things we should've learned by now."
Butcher gave the Devils a 2-1 lead when he scored on a wrist shot from the left circle that went in off Anderson's right shoulder with 2:08 left in the first.
Pageau scored on a snap shot at the right post to tie it 1-1 at 14:54.
Simmonds gave the Devils a 1-0 lead when he skated onto a pass from Miles Wood near center ice and scored on a breakaway at 4:19. It was his second goal in two games.
