[SIS-MIA] [EXTERNAL] [BULK] Subjective Video Quality Assessement Brief Guideline

Thu Oct 2 10:30:20 EDT 2025

Falk,

This is excellent!  In our testing, will we use our reference clips, both ideal and degraded, as the clips to be evaluated? That would give a direct correlation between this test and the VMAF test scores.

Also, you mentioned in the Influencing Factors section that test participants have a tendency to not use the ends of the scale as they expect there may be better or worse samples to come. Could this be overcome by showing a reference clip with no issues followed by the same clip with the worst rating we plan to show at the beginning of the test? I believe what you describe has a high probability of happening. One of my daughters was a gymnast and always hated being the first one to do any event. Whoever went first would get a median score, not matter how well they performed, which led to meet scores being artificially low in many cases. This was the norm, not the exception.  If we can mitigate that, I think it will help and give us more uniform scoring.

My thought is to summarize the testing method for the yellow book. Instead of the influencing factors you listed, put in that our testing, conducted both in Germany and the US, follows ITU guidelines for subjective video ratings.

[cid:image001.png at 01DB7BB7.4AC15F20]

Walt Lindblom

Video Engineer, NASA Imagery Experts Group

AEGIS

Leidos Inc.

MSFC Building 4485

256-684-0580

walt.lindblom at nasa.gov

From: SIS-MIA <sis-mia-bounces at mailman.ccsds.org> on behalf of Falk.Schiffner--- via SIS-MIA <sis-mia at mailman.ccsds.org>
Date: Thursday, October 2, 2025 at 6:15 AM
To: sis-mia at mailman.ccsds.org <sis-mia at mailman.ccsds.org>
Subject: [EXTERNAL] [BULK] [SIS-MIA] Subjective Video Quality Assessement Brief Guideline

CAUTION: This email originated from outside of NASA.  Please take care when clicking links or opening attachments.  Use the "Report Message" button to report suspicious messages to the NASA SOC.

Hello Everybody,
as said at the last meetings I provide a brief introduction to subjective video quality assessment. Hope the instructions are clear (did not do a spelling check, sorry!) If there are any questions on that topic, please contact me for clarification!

See you soon and hope that everybody is well off!

Best Falk

———————————————————————————————————————
German Aerospace Center (DLR e.V.)
Space Operations & Astronaut Training | Communication & Ground Stations
Rutherfordstrasse 2 | 12489 Berlin

Dr.-Ing.  F a l k   R.   S c h i f f n e r
Ground Operations Group
System Engineer DTN / CCSDS Delegate (DTN, Audio-Video Assessment)
Telefon: +49 (0)30 670558177 | Email: falk.schiffner at dlr.de<mailto:falk.schiffner at dlr.de>
www.DLR.de<http://www.dlr.de/>

[cosmickiss]

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.ccsds.org/pipermail/sis-mia/attachments/20251002/c3f3d588/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 16548 bytes
Desc: image001.jpg
URL: <http://mailman.ccsds.org/pipermail/sis-mia/attachments/20251002/c3f3d588/attachment-0001.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 6563 bytes
Desc: image001.png
URL: <http://mailman.ccsds.org/pipermail/sis-mia/attachments/20251002/c3f3d588/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 360 bytes
Desc: image002.png
URL: <http://mailman.ccsds.org/pipermail/sis-mia/attachments/20251002/c3f3d588/attachment-0003.png>