
Photon noise refers to the inherent natural variation of the incident photon flux. Photoelectrons collected by a CCD exhibit a Poisson Distribution and have a square root relationship between signal and noise (See → Signal To Noise Ratio).
The wikipedia has a nice illustration on this topic.
The noise is therefore directly dependent on the number of photons recorded in a real image. A very bright feature emitting many photons will have little (relative) noise. A very dim feature will look "granular", revealing that not many photons were averaged during its acquisition. This can not be known in advance just by looking at an empty calibration image.
Moreover, the kind of noise in which we are interested is not something intrinsic to the device (that would be another type of noise, maybe from the electronics) but something in the nature of the photons that are averaged. Therefore it also depends on the acquisition time: the larger the exposure, the larger is the amount of photons gathered and the lesser the noise.