Celtic have won the Scottish Premiership title for the last four seasons.
Rangers overturned a seven-point lead at the top of the table before suffering a shocking collapse of form towards the end of last campaign.
Balogun admitted there has to be a change of mentality if they want to stop Celtic from winning a 55th title next season.
“It’s something we have to work on throughout pre-season, to have that shift in mentality and build more confidence,” the Nigerian told Sky Sports.
“That’s a process that we need to work on every day by repetition mainly, and gaining confidence in what you’re doing.
“Obviously, pre-season friendlies are a vital part of that. Hearts is a very good way to start the season to see how far we’ve come and what we still have to do throughout the season.”
Written by Mike Oyebola