Website Optimization: Minimize Noise to Maximize Graphic and Video Compression

Website Optimization is announcing that multimedia compression can be thought of as a war against unnecessary noise. Noise is the unwanted random dot pattern overlaid on videos and graphics when electronic noise is present, due in part to the random motion of electrons. Noise creeps into images, both still and motion, with the more lossy steps you take when manipulating images. These random dot patterns, or "snow," prevent compression algorithms from working optimally, increasing file sizes. By minimizing the noise in your original images and videos, you can gain the maximum amount of compression when optimizing images and videos destined for the Web.

Causes of Noise in Digital Cameras

Low-quality equipment tends to create more noise than higher-quality equipment. For example, smaller digital sensors seen in point-and-shoot cameras are more prone to noise than larger format sensors seen in Canon and Nikon's full frame cameras. As you'd expect for the same number of pixels, smaller sensors have smaller pixels. Smaller pixels are less effective at gathering light, so their weaker signals must be amplified, increasing noise. The effect of small sensors is seen most at high ISO settings and in low light situations. Digital camera manufacturers include in-camera noise reduction, but most professionals and serious amateurs keep in-camera noise reduction low, and reduce noise in Photoshop or with specialized noise reduction tools for maximum control.

Noise can also be caused by scanning film, in the form of scratches or dust. High ISO film introduces grain, which is a form of analog noise. JPEG compression also introduces some noise into flat color areas at lower quality settings. Dithering is an ordered form of noise, and should be minimized to let palette-based compression algorithms find more repeated pixel patterns.

Preventing Noise

If you find noise in your images, then your equipment may not be good enough. Use the highest quality equipment possible. Even with the best equipment you can still have noise problems, especially in low light situations. Use faster lenses and larger photosites to increase the signal and reduce noise. Save your images, still and motion, using the highest quality output format (RAW versus JPEG for example) to avoid introducing unnecessary noise into your originals. Here are some tips on avoiding noise:

* Use fast lenses to increase signal
* Use fast shutter speeds to avoid accumulated noise (faster than 1/60th of a second)
* Use image stabilization to avoid motion blur
* Use low ISO settings below 100 and a tripod, avoid high ISO settings
* Use larger sensors
* Use high quality video and still cameras
* Use a lot of light
* Use a flash
* Use RAW or the highest quality output setting
* Always work from originals if possible

The Effect of Noise on Image Compression

In our tests, noise can increase the optimized file size of JPEGs up to 20% to 30% (see Figure 1). Adding 5% noise increases the high quality JPEG by 8%. Adding 10% noise increases the high quality JPEG by about 27%.

Noise Reduction for Videos

You can deal with noise, to some degree, with the H.264 compressor (and others) that has a "deblocking filter." The de-blocking filter smooths out block artifacts which may occur in the image when using lower bitrates. Using the de-blocking filter may increase image quality considerably (see Figure 3). For the article see Maximize Graphic and Video Compression


This does help but the deblocking filter was designed to handle blocking problems that get introduced by the compression not by the camera. So this is a bit of a trick but it does work. What it does is looks at blocky artifacts and then tries to smooth or blend them together. Of course this happens at the expense of sharpness. You can use more specialized tools to reduce noise in videos like Neat Video for improved results.

Noise Reduction for Graphics

You can reduce noise with filters in Photoshop, Photoshop elements, or specialized software. The noise filter menu has a "reduce noise" option, that allows you to adjust strength, preserve details, reduce color noise, and remove JPEG artifacts. Figure 4 shows the settings we used to remove some of the noise from the 10% noise balloon above. For the article see Maximize Graphic and Video Compression

Conclusion

Noise is the enemy of multimedia compression. Avoid introducing noise into your images, both still and motion, by using high quality equipment, saving high quality output, and working from originals. Noise can increase the size of JPEGs by up to 20% to 30%, and palette-based images by a factor of 100. You can remove noise most effectively with specialized noise reduction software. Removing noise can save over 50% in file size.

For the article see Maximize Graphic and Video Compression

Further Reading:

Compact Camera High ISO Modes
http://www.dpreview.com/articles/compactcamerahighiso/
Discusses the effects of noise in small format cameras at high ISO modes. Shows examples of noise at various settings.

Digital GEM
http://www.asf.com/
Noise reduction software from Kodak.

Effects of the physical size of digicam sensors on performance
http://photo.net/equipment/digital/sensorsize/
Bob Atkins compares different sized sensors on their photographic performance. Includes some information on noise in the comments.

Multimedia: Use Image Stabilization
http://www.websiteoptimization.com/speed/tweak/stabilizer/
Image stabilization creates sharper pictures by damping vibration to avoid motion blur. Gyroscopic stabilizers steady cameras for sharper photographs and videos.

Multimedia: Use a Stable Tripod
http://www.websiteoptimization.com/speed/tweak/tripod/
A stable tripod creates sharper pictures and videos by damping out vibration. Sharper shots mean smaller multimedia destined for the Web.

Neat Image
http://www.neatimage.com/
Stand alone software and plug-in designed to reduce noise in images for Photoshop and Coreldraw. Developed specifically for digital photography. Available for Mac and Windows.

Neat Image Pro Review
http://www.luminous-landscape.com/reviews/software/neatimage.shtml
Luminous Landscape reviews Neat Image for noise reduction.

Neat Video
http://www.neatvideo.com/
Neat Image's version of noise reduction for videos.

Noise Ninja
http://www.picturecode.com/
Noise reduction plug-in available for Mac and Windows.

Noise Reduction Tool Comparison
http://www.michaelalmond.com/Articles/noise.htm
Michael Almond compares different noise reduction software. Recommends Noise Ninja, Neat Image, and Picture Cooler.

Noiseware
http://www.noiseware.com/
Photoshop plug-in for noise reduction. Available for Windows only.

Web Video Optimization Tips
http://www.websiteoptimization.com/speed/tweak/video/
Shows how to capture and optimize videos for the Web.

About Website Optimization

Don't Make Me Wait! The new book titled "Speed Up Your Site – Web Site Optimization" by Andy King, and the companion web site are about designing "speedy" web sites with techniques that…

* Cut file size and download times in half
* Speed up site load time to satisfy customers
* Engage users with fast response times and flow stimulus
* Increase usability, boost profits, and slash bandwidth costs
* Improve search engine rankings and web page conversions

Andy King is also the founder of WebReference.com and JavaScript.com, both award-winning developer sites from internet.com. Created in 1995 and subsequently acquired by Mecklermedia (now Jupitermedia) in 1997, WebReference has grown into one of the most popular developer sites on the Internet. While he was Managing Editor of WebReference.com and JavaScript.com, Andy became the "Usability Czar" at internet.com, where he optimized the speed and usability of their sites. In addition to his consulting work, he continues to write the monthly Bandwidth Report and the “Speed Tweak of the Week” for WebsiteOptimization.com