The heroic builders sprung into action when they spotted flames pouring from the house in Batemoor.
Neighbours reported an explosion before the blaze broke out.
Donna Gibson, who lives across from the house, told the Sheffield Telegraph: “I was watching television and heard a loud explosion – it was a huge bang and made me jump.
“They are doing work on the flats nearby, so I thought the noise was from there.
“I looked out and there was just all this smoke and flames. You couldn’t see anything.
“The builders saw the flames and they rushed up and got the man and his dog out.”
South Yorkshire Fire and Rescue said: “Crews from Lowedges, Central and Mosborough fire stations were called to the incident at 10:45 and found one building well alight.
“The resident of the property, a male thought to be in his fifties, was already out of the house when firefighters arrived.
“He was taken to hospital by the ambulance service suffering from possible smoke inhalation.
“One dog, two rabbits and two turtles were rescued from the blaze.”