The popular king modernised the royal house but refused to follow in the footsteps of other aging monarchs who have abdicated in recent times.
His son now automatically becomes King Haakon VIII.
Harald had been in hospital since August 17 receiving treatment for a blood condition. The royal household said on Thursday that his condition had become "extremely serious".