The palace in Oslo said he passed away peacefully at 06:35 local time (04:35GMT) on Friday at the national hospital in the capital.
The royal flag on the roof of the palace has been lowered to half-mast.
Harald was Norway's first king born in the country since the 14th Century, and he spent 35 years on the throne. He will be succeeded by his son Haakon.