The man, thought to be aged in his 50s or 60s, fell in Chalkwell Road, Sittingbourne, at about 11:00.
Fire crews were called to the scene to remove scaffolding so paramedics could treat the man.
A crew from Kent air ambulance treated the man for head injuries but he died at the scene, they said.
The Health and Safety Executive said it was making “initial inquires” into the man’s death.