Shortcuts
What is VQA?
-
VQA = Visual Quality Assessment
-
IQA/VQA = Image/Video Quality Assessment
-
PQA = Perceptual Quality Assessment
-
VQM = Visual Quality Measurement
-
IQM/VQM = Image/Video Quality Measurement
-
PQM = Perceptual Quality Measurement
Some related QoX-terms:
-
QoE = Quality of Experience
-
QoS = Quality of Service => IWQoS
-
QoP = Quality of Protection
VQA research is a highly interdisciplinary topic involving
-
Image and video processing
-
Color science (Colorimetry)
-
Computer vision and pattern recognition
-
Experimental psychology
-
Neuroscience (Human visual system)
-
Digital imaging and displays
-
...
Generally speaking, there are two domains of VQA study: subjective and objective. We are more interested in objective VQA algorithms that can evaluate quality of digital images and videos, and also the performance of digital imaging devices and displays via digital images and videos they produce or display.
Resources
Visual Quality Assessment
General Web Resources:
Annotated Computer Vision Bibliography 5.3.9 Image Quality Evaluation, Quality Assessment, and Imaging Models (
5.3.9.1 Motion Coding Evaluation, Video Image Quality Evaluations)
Stefan Winkler's Image and Video Quality Resources
Organizations:
VQEG
(
Video Quality Research @ ITS.NTIA)
VSF's Quality of Experience (QoE) Metrics Activity Group
Camera Phone Image Quality (CPIQ) @ i3a
IEEE Conformity Assessment Program (ICAP) Camera Phone Image Quality (CPIQ) Conformity Assessment Steering Committee (CASC) (
IEEE Standard Association Working Group 1858,
IEEE Project P1858 - Standard for CPIQ)
People and Algorithms:

(
Qualinet WG2 Taskforce "Crowdsourcing",
crowdlib mailing list)
Laboratory for Image & Video Engineering (LIVE) @ UTAustin
SSIM
Dr. Stefan Winkler
Cornell Visual Communications Lab
(
VSNR)
PSNR-HVS-M
FSIM
DCTune 2.0: Perceptual Optimization of JPEG Images and Perceptual Error Metric
Image, Video, and Usability (IVU) Lab @ Arizona State University
Multimedia Signal Processing Group @ EPFL
Q2S - Centre for Quantifiable Quality of Service in Communication Systems @ NTNU.no
Prof. Thrasyvoulos N. Pappas @ Northwestern University
Image Coding and Analysis Lab @ OSU
MeTriX MuX Visual Quality Assessment Package
Visual Quality Index Implementations @ Salzburg
VBQUEST: Visual Blur QUality Evaluation SofTware
MSU Video Quality Measurement Tools
MSU Perceptual Video Quality tool
(VI(S)TA) Image Quality Toolbox (VistaQualityTools)
EvalVid - A Video Quality Evaluation Tool-set
Perceptual Image Diff
Digital Imaging Devices and Displays:
Society for Imaging Science and Technology (IS&T)
camcorderinfo.com
Camcorders Reviews @ CNET
Camcorder HQ™
dpreview.com
toothwalker.org
oled-display.info
oled-display.net
oled-info.com
tvoled.co.uk
oledtvzone.com
中国OLED网
laser-tv.org
Mitsubishi LasserVue TV
Necsel™ Laser Color
LED TV @ ledtele.co.uk
Commercial Products and Services:
Imatest
OPTICOM
(
OPTICOM's PEVQ™)
Nikon's VQ-1000 Analytical Image Quality Evaluation Tool
Symmetricom - QoE Assurance: V-Factor
Tektronix PQA500
Sarnoff - Video Test and Measurement
AccepTV
Agama
videoclarity.com
Semaca VQLab
eInfochips Video Quality Inspector
VISUALmpeg
(
VISUALmpegVQA,
VISUALmpegQUALIFY)
R&S® DVQ Digital Video Quality Analyzer
DxO Labs
(
DxO Analyzer,
DxO Analyzer Demokit;
DxOMark)
Color Science
General Web Resources:
ColorWiki
ColorPro
colorbasics.com: Science of Color in Non-Technical Terms
EasyRGB
Bruce Lindbloom's Web Site on Colorimetry
(
CIE Color Calculator,
CIE Spectral Display,
ColorChecker Calculator,
Color Difference Calculator,
Chromatic Adaptation Calculator,
Lab Gamut Display,
Munsell Calculator)
Charles Poynton's Color Technology Page
(
Color FAQ,
Gamma FAQ)
James M. Palmer's Radiometry and Photometry FAQ
Norwegian Color Research Laboratory
Computational Vision Laboratory @ Simon Fraser University
Color Constancy: Research Website on Illuminant Estimation
Organizations:
CIE - International Commission on Illumination
OSA = Optical Society of America
ICC - International Color Consortium
ICA = International Colour Association
ISCC = Inter-Society Color Council
AATCC = American Association of Textile Chemists and Colorists
SDC = Society of Dyers and Colourists
Colour Index International
CAUS = The Color Association of the United States
EOS = European Optical Society
Companies:
Color Blindness:
Colour Blind Resource Centre
colorvisiontesting.com
Colors for the Color Blind
IBM aDesigner
What do colour-blind people see? (by Hans Brettel @ ENST.fr)
Tools:
ICC Profile Inspector
Microsoft Color Control Panel Applet for Windows XP
COLORLAB
Colorlab Toolbox @ UJoensuu
OptProp - a color properties toolbox (Jerker Wagberg)
(
demo)
Gerbil
Kobus Barnard's source code for computational color constancy
Retinex in Matlab
Python-Colormath
QualityCrowd
(
QualityCrowd 2 @ GitHub)
Databases
Image Quality Assessment Test Databases:
KADID-10k Image Database
KonIQ-10k Image Database
IQA-Experts-300 Image Database
KonPatch-30k Image Database
LIVE Image Quality Assessment Database
LIVE In the Wild Image Quality Challenge Database
IRCCyN/IVC Image Quality Database
IRCCyN/IVC LAR-Coded Art Image Quality Database
MICT Image Quality Evaluation Database (Toyama Database)
TAMPERE IMAGE DATABASE (TID) 2013
TAMPERE IMAGE DATABASE (TID) 2008
Categorical Subjective Image Quality (CSIQ) Database @ OSU Vision Lab
BTH WIQ (Wireless Imaging Quality) Database
ACQUINE: Automatic Rating of Photo Aesthetics
TUD Image Quality Database: Perceived Ringing
EPFL-MMSP 3D Image Quality Database
Video Quality Assessment Test Databases:
KoNViD-1k Video Database
Consumer Digital Video Library (CDVL)
VQEG FR-TV Phase 1 Test Scenes @ CRC VQEG FTP Site
VQEG Test Sequences @ vqeg.its.bldrdoc.gov
LIVE Video Quality Database
LIVE Wireless Video Quality Assessment Database
USC MCL-V Database
EPFL-PoliMI Video Quality Assessment Database
IRCCyN IVC 1080i Database
IRCCyN/IVC SD RoI (Region-of-Interest) Database
Poly@NYU Video Quality Database
Poly@NYU Packet Loss Database
EPFL-MMSP Scalable Video Database
IRCCyN/IVC Eyetracker SD 2009_12 Database
Video Subjective Test Database @ Uni-Plymouth.UK
TUM HDTV Video Quality Data Sets
MOBILE◦3DTV - Database of impaired videos
EPFL-MMSP 3D Video Quality Database
Ausiovisual Quality Database for Video Calls in Wireless Applications @ Uni-Plymouth.UK
Eyetracking Databases:
IRCCyN/IVC Eyetracker Data for the Berkeley Segmentation Dataset
IRCCyN/IVC Eyetracker Database 1 (200605)
IRCCyN/IVC Eyetracker SD Database (200811)
IRCCyN/IVC Eyetracker SD Database (200912)
LIVE DOVES (a Database Of Visual Eye movementS)
BTH VAIQ (Visual Attention for Image Quality) Database
TUD Eye Tracking Database 1 (on LIVE Database)
TUD Eye Tracking Database 2: Task Effect on Saliency
TUD Eye Tracking Database: Interactions
MIT CSAIL Eyetracking Dataset
Gert Kootstra's Eye-Tracking |Data
NUSEF (NUS Eye-Fixation Database)
USC CRCNS eye-1 Dataset
USC iLab Eyetracking Video Dataset
UniLuebeck-INB Video Eyetracking Dataset
DIEM Dataset
Color Spectral Databases:
Spectra Database @ Lappeenranta University of Technology
Advanced Spaceborne Thermal Emission Reflection Radiometer (ASTER)
USGS Digital Spectral Library
Floral Reflectance Database (FReD)
The Vrhel Spectral Data Set
Simon Fraser University's Data for Computer Vision and Computational Colour Science
Joensuu Spectral Database
Joensuu Spectral Image Database
Nascimento et al.'s Hyperspectral Images of Natural Scenes 2002
Imaging Devices and Displays:
Camera Response Functions: Database (DoRF) and Model (EMOR) @ ColumbiaU
Other Databases:
The Barcelona Calibrated Images Database
Test Images for Computational Colour Constancy @ Simon Fraser University
Multi-Illuminant Dataset @ University of Erlangen-Nuremberg
All information on this website is for personal use and Shujun Li is not responsible for any misuse of information provided. The listed links on any page do not indicate any personal recommendations for any purposes for the visitors of this website, as each link is included for a different reason meaningful for Shujun Li's personal use. Logo files of websites are used to facilitate recognition of the external links, and does not represent endorsement of the corresponding websites for the content of this website. If the use of any logo file violates the copyrights or policies of any individuals or organisations, please contact Shujun Li so that he can removes the logo file or the whole link. Please also help report broken links and broken images on this website.