[Sis-mia] [BULK] Re: [EXTERNAL] RE: RTP over DTN streaming tests - preliminary outcomes look good

Mon Apr 29 18:05:09 UTC 2024

Hello Rodney,

Yes, several of us will be dialing in to discuss the results, do you know which particular block of the day the media group content will be discussed?

Prash just completed all of the bit analysis for the configurations, so we are going to review the results this afternoon.

As well, we are putting together our plans to conduct further tests throughout the summertime.

Regards,
Daniel

Dr. Daniel E. Raible, KE8ESB
Electronics Engineer, Optics and Photonics Branch (LCP)
NASA John H. Glenn Research Center at Lewis Field
21000 Brookpark Road, Mail Stop 77-2
Cleveland, OH 44135-3191
phone: (216) 433-3367 fax: (216) 433-8705

From: Grubbs, Rodney P. (MSFC-AS50)[EMERITUS PROGRAM] <rodney.p.grubbs at nasa.gov>
Sent: Monday, April 29, 2024 1:55 PM
To: Raible, Daniel E. (GRC-LCP0) <daniel.e.raible at nasa.gov>; Mayer, Jeremy P. (JSC-OT/ESA)[EUROPEAN SPACE AGENCY] <jeremy.mayer at dlr.de>; sis-mia at mailman.ccsds.org; Lindblom, Walter E. (MSFC-IS64)[AEGIS] <walt.lindblom at nasa.gov>; George, Sandy (MSFC-IS64)[AEGIS] <sandy.george at nasa.gov>; St. Peter, Beth (MSFC-HP10) <elizabeth.m.st.peter at nasa.gov>
Cc: Schweinsberg, Ethan {He, Him} (GRC-LSS0) <ethan.e.schweinsberg at nasa.gov>; Nazario, Margaret {Meg} (GRC-LCP0) <margaret.l.nazario at nasa.gov>; Short, Bob (GRC-LCN0) <robert.s.short at nasa.gov>; McKeehan, Shaun M. (GRC-LSX0) <shaun.mckeehan at nasa.gov>; Kollar, Tad {he, him} (GRC-LSX0)[BQMI] <tad.kollar at nasa.gov>; Aylward, Hugh E. (GRC-VO00)[eMITS] <hugh.e.aylward at nasa.gov>; Firak, James M. (GRC-VO00)[eMITS] <james.m.firak at nasa.gov>; Hylton, Alan G. (GSFC-4570) <alan.g.hylton at nasa.gov>; Nowakowski, John J. (GRC-MSC0) <john.j.nowakowski at nasa.gov>; Dudukovich, Rachel M. (GRC-LCI0) <rachel.m.dudukovich at nasa.gov>; Burroughs, Michael A. (GSFC-700.N)[AEGIS] <michael.a.burroughs at nasa.gov>; Tomko, Brian J. (GRC-LSX0) <brian.j.tomko at nasa.gov>; Choksi, Prash (GRC-LCA0) <prash.choksi at nasa.gov>; vernyikyle4 at gmail.com
Subject: Re: [BULK] Re: [Sis-mia] [EXTERNAL] RE: RTP over DTN streaming tests - preliminary outcomes look good

I finally have my NASA identity restored. Just in time.
Daniel, all this is good news. New data. Will you or someone from the team be able to join us tomorrow (Tuesday) for our CCSDS MIA meeting to share this data and answer questions? Anyone from the GRC team planning to attend in person?

“Live Life Forward”
Rodney Grubbs, NASA Emeritus & ESDMD Consultant
Chair, CCSDS Motion Imagery & Applications Working Group
931-229-6030 (Personal phone)

Note: I retired from NASA on March 31, 2023. My Emeritus status only relates to supporting NASA/MSFC’s CCSDS matters.

From: SIS-MIA <sis-mia-bounces at mailman.ccsds.org<mailto:sis-mia-bounces at mailman.ccsds.org>> on behalf of "Raible, Daniel E. (GRC-LCP0) via SIS-MIA" <sis-mia at mailman.ccsds.org<mailto:sis-mia at mailman.ccsds.org>>
Reply-To: "Raible, Daniel E. (GRC-LCP0)" <daniel.e.raible at nasa.gov<mailto:daniel.e.raible at nasa.gov>>
Date: Saturday, April 27, 2024 at 4:09 AM
To: "Mayer, Jeremy P. (JSC-OT/ESA)[EUROPEAN SPACE AGENCY]" <jeremy.mayer at dlr.de<mailto:jeremy.mayer at dlr.de>>, "sis-mia at mailman.ccsds.org<mailto:sis-mia at mailman.ccsds.org>" <sis-mia at mailman.ccsds.org<mailto:sis-mia at mailman.ccsds.org>>, "Lindblom, Walter E. (MSFC-IS64)[AEGIS]" <walt.lindblom at nasa.gov<mailto:walt.lindblom at nasa.gov>>, "George, Sandy (MSFC-IS64)[AEGIS]" <sandy.george at nasa.gov<mailto:sandy.george at nasa.gov>>, "St. Peter, Beth (MSFC-HP10)" <elizabeth.m.st.peter at nasa.gov<mailto:elizabeth.m.st.peter at nasa.gov>>
Cc: "Schweinsberg, Ethan {He, Him} (GRC-LSS0)" <ethan.e.schweinsberg at nasa.gov<mailto:ethan.e.schweinsberg at nasa.gov>>, "Nazario, Margaret {Meg} (GRC-LCP0)" <margaret.l.nazario at nasa.gov<mailto:margaret.l.nazario at nasa.gov>>, "Short, Bob (GRC-LCN0)" <robert.s.short at nasa.gov<mailto:robert.s.short at nasa.gov>>, "McKeehan, Shaun M. (GRC-LSX0)" <shaun.mckeehan at nasa.gov<mailto:shaun.mckeehan at nasa.gov>>, "Kollar, Tad {he, him} (GRC-LSX0)[BQMI]" <tad.kollar at nasa.gov<mailto:tad.kollar at nasa.gov>>, "Aylward, Hugh E. (GRC-VO00)[eMITS]" <hugh.e.aylward at nasa.gov<mailto:hugh.e.aylward at nasa.gov>>, "Firak, James M. (GRC-VO00)[eMITS]" <james.m.firak at nasa.gov<mailto:james.m.firak at nasa.gov>>, "Hylton, Alan G. (GSFC-4570)" <alan.g.hylton at nasa.gov<mailto:alan.g.hylton at nasa.gov>>, "Nowakowski, John J. (GRC-MSC0)" <john.j.nowakowski at nasa.gov<mailto:john.j.nowakowski at nasa.gov>>, "Dudukovich, Rachel M. (GRC-LCI0)" <rachel.m.dudukovich at nasa.gov<mailto:rachel.m.dudukovich at nasa.gov>>, "Burroughs, Michael A. (GSFC-700.N)[AEGIS]" <michael.a.burroughs at nasa.gov<mailto:michael.a.burroughs at nasa.gov>>, "Tomko, Brian J. (GRC-LSX0)" <brian.j.tomko at nasa.gov<mailto:brian.j.tomko at nasa.gov>>, "Choksi, Prash (GRC-LCA0)" <prash.choksi at nasa.gov<mailto:prash.choksi at nasa.gov>>, "vernyikyle4 at gmail.com<mailto:vernyikyle4 at gmail.com>" <vernyikyle4 at gmail.com<mailto:vernyikyle4 at gmail.com>>
Subject: [BULK] Re: [Sis-mia] [EXTERNAL] RE: RTP over DTN streaming tests - preliminary outcomes look good

Jeremy,

Yes, that is correct.  This particular battery of tests were done in more controlled conditions, as a way to evaluate our HDTN streaming implementation across the range of video configurations.

Concurrently in another facility we have been running a separate experiment streaming a single camera feed 24/7 across a LunaNet HDTN scenario.  Over there we do things such as induce delays, change contact plans, reroute, etc to evaluate performance more at a network systems level.  Those more complex scenarios are the ones we plan to upscale to our field demonstrations from May-July.

Working with the video teams on this has been really educational for us, and I know will greatly inform our upcoming space networking tests.  We’ve also been able to recently procure some 4K camera equipment and processors with hardware decoders which we can incorporate into the flight tests to increase their fidelity.  Right now we are working on tying our delay/network emulator box into the field tests so we can conduct such things live with the flight test for LCRD and such.

Regards,
Daniel

Dr. Daniel E. Raible, KE8ESB
Electronics Engineer, Optics and Photonics Branch (LCP)
NASA John H. Glenn Research Center at Lewis Field
21000 Brookpark Road, Mail Stop 77-2
Cleveland, OH 44135-3191
phone: (216) 433-3367 fax: (216) 433-8705

From: Jeremy.Mayer at dlr.de<mailto:Jeremy.Mayer at dlr.de> <Jeremy.Mayer at dlr.de<mailto:Jeremy.Mayer at dlr.de>>
Sent: Saturday, April 27, 2024 4:49 AM
To: Raible, Daniel E. (GRC-LCP0) <daniel.e.raible at nasa.gov<mailto:daniel.e.raible at nasa.gov>>; sis-mia at mailman.ccsds.org<mailto:sis-mia at mailman.ccsds.org>; Lindblom, Walter E. (MSFC-IS64)[AEGIS] <walt.lindblom at nasa.gov<mailto:walt.lindblom at nasa.gov>>; George, Sandy (MSFC-IS64)[AEGIS] <sandy.george at nasa.gov<mailto:sandy.george at nasa.gov>>; St. Peter, Beth (MSFC-HP10) <elizabeth.m.st.peter at nasa.gov<mailto:elizabeth.m.st.peter at nasa.gov>>
Cc: Schweinsberg, Ethan {He, Him} (GRC-LSS0) <ethan.e.schweinsberg at nasa.gov<mailto:ethan.e.schweinsberg at nasa.gov>>; Nazario, Margaret {Meg} (GRC-LCP0) <margaret.l.nazario at nasa.gov<mailto:margaret.l.nazario at nasa.gov>>; Short, Bob (GRC-LCN0) <robert.s.short at nasa.gov<mailto:robert.s.short at nasa.gov>>; Nowakowski, John J. (GRC-MSC0) <john.j.nowakowski at nasa.gov<mailto:john.j.nowakowski at nasa.gov>>; Kollar, Tad {he, him} (GRC-LSX0)[BQMI] <tad.kollar at nasa.gov<mailto:tad.kollar at nasa.gov>>; Aylward, Hugh E. (GRC-VO00)[eMITS] <hugh.e.aylward at nasa.gov<mailto:hugh.e.aylward at nasa.gov>>; Firak, James M. (GRC-VO00)[eMITS] <james.m.firak at nasa.gov<mailto:james.m.firak at nasa.gov>>; Hylton, Alan G. (GSFC-4570) <alan.g.hylton at nasa.gov<mailto:alan.g.hylton at nasa.gov>>; McKeehan, Shaun M. (GRC-LSX0) <shaun.mckeehan at nasa.gov<mailto:shaun.mckeehan at nasa.gov>>; Burroughs, Michael A. (GSFC-700.N)[AEGIS] <michael.a.burroughs at nasa.gov<mailto:michael.a.burroughs at nasa.gov>>; Tomko, Brian J. (GRC-LSX0) <brian.j.tomko at nasa.gov<mailto:brian.j.tomko at nasa.gov>>; Choksi, Prash (GRC-LCA0) <prash.choksi at nasa.gov<mailto:prash.choksi at nasa.gov>>; vernyikyle4 at gmail.com<mailto:vernyikyle4 at gmail.com>; Dudukovich, Rachel M. (GRC-LCI0) <rachel.m.dudukovich at nasa.gov<mailto:rachel.m.dudukovich at nasa.gov>>
Subject: [EXTERNAL] RE: RTP over DTN streaming tests - preliminary outcomes look good

CAUTION: This email originated from outside of NASA.  Please take care when clicking links or opening attachments.  Use the "Report Message" button to report suspicious messages to the NASA SOC.

Hi,
Looks good! Just to confirm one thing, these were done without induced packet loss/delay, correct?

Thanks,
Jeremy

From: SIS-MIA <sis-mia-bounces at mailman.ccsds.org<mailto:sis-mia-bounces at mailman.ccsds.org>> On Behalf Of Raible, Daniel E. (GRC-LCP0) via SIS-MIA
Sent: Samstag, 27. April 2024 10:46
To: Grubbs, Rodney P. (MSFC-AS50)[EMERITUS PROGRAM] via SIS-MIA <sis-mia at mailman.ccsds.org<mailto:sis-mia at mailman.ccsds.org>>; Lindblom, Walter E. (MSFC-IS64)[AEGIS] <walt.lindblom at nasa.gov<mailto:walt.lindblom at nasa.gov>>; George, Sandy (MSFC-IS64)[AEGIS] <sandy.george at nasa.gov<mailto:sandy.george at nasa.gov>>; St. Peter, Beth (MSFC-HP10) <elizabeth.m.st.peter at nasa.gov<mailto:elizabeth.m.st.peter at nasa.gov>>
Cc: Schweinsberg, Ethan {He, Him} (GRC-LSS0) <ethan.e.schweinsberg at nasa.gov<mailto:ethan.e.schweinsberg at nasa.gov>>; Nazario, Margaret {Meg} (GRC-LCP0) <margaret.l.nazario at nasa.gov<mailto:margaret.l.nazario at nasa.gov>>; Short, Bob (GRC-LCN0) <robert.s.short at nasa.gov<mailto:robert.s.short at nasa.gov>>; Nowakowski, John J. (GRC-MSC0) <john.j.nowakowski at nasa.gov<mailto:john.j.nowakowski at nasa.gov>>; Kollar, Tad {he, him} (GRC-LSX0)[BQMI] <tad.kollar at nasa.gov<mailto:tad.kollar at nasa.gov>>; Aylward, Hugh E. (GRC-VO00)[eMITS] <hugh.e.aylward at nasa.gov<mailto:hugh.e.aylward at nasa.gov>>; Firak, James M. (GRC-VO00)[eMITS] <james.m.firak at nasa.gov<mailto:james.m.firak at nasa.gov>>; Hylton, Alan G. (GSFC-4570) <alan.g.hylton at nasa.gov<mailto:alan.g.hylton at nasa.gov>>; McKeehan, Shaun M. (GRC-LSX0) <shaun.mckeehan at nasa.gov<mailto:shaun.mckeehan at nasa.gov>>; Burroughs, Michael A. (GSFC-700.N)[AEGIS] <michael.a.burroughs at nasa.gov<mailto:michael.a.burroughs at nasa.gov>>; Tomko, Brian J. (GRC-LSX0) <brian.j.tomko at nasa.gov<mailto:brian.j.tomko at nasa.gov>>; Choksi, Prash (GRC-LCA0) <prash.choksi at nasa.gov<mailto:prash.choksi at nasa.gov>>; Kyle Vernyi <vernyikyle4 at gmail.com<mailto:vernyikyle4 at gmail.com>>; Dudukovich, Rachel M. (GRC-LCI0) <rachel.m.dudukovich at nasa.gov<mailto:rachel.m.dudukovich at nasa.gov>>
Subject: [Sis-mia] RTP over DTN streaming tests - preliminary outcomes look good

Hello Rodney and All,

Wanted to give you a preliminary status update.  We had a lot of help getting things going, which we greatly appreciate, so I am including some extra folks in the cc.

Firstly thanks Walt, Beth and Sandy for hooking us up with the gear to conduct the tests.  Hugh, Jim and Mike offered huge assistance in configuring all the equipment and keeping organized with hitting the test points.

We used the available camera in the video lab and supporting equipment, imaged an oscillating fan with streamers and shadows for some dynamics, and swapped things out as necessary to complete the following configurations across our DTN nodes running the media streaming application:

720P30 h.264 @ 2 Mbps
720P60 h.264 @ 4 Mbps
1080P30 h.265 @ 4 Mpbs, 6 Mbps and 8 Mbps
1080P60 h.265 @ 6 Mbps and 8 Mbps
2160P30 h.265 @ 6 Mpbs and 8 Mbps
2160P60 h.265 @ 10, 11, 12, 20 & 30 Mbps

The hardware encoder had some trouble getting down to 8 Mbps, I think it was hovering more around 9.7, so we took some extra data points in the vicinity.  As things wrapped up today, each of these test points successfully passed the visual inspections, with the exception of 2 ‘bonus’ points we took with the encoders cranked up to 20 & 30 Mbps.  These were done as a curiosity, just to drive our system harder to see it degrade, and we did start to finally observe some blocking and dropped frames at those extreme cases, but for all the ‘in-bound’ configurations everything looked great!  I think we’re ready to go flying.

We have copies of all the source and destination media files from the data bundles traversing through the DTN network.  Prash is going to now start comparing them more objectively, starting with bitwise checks.  I don’t know how much we are going to be able to get done before your CCSDS briefing which I believe is on Tuesday, but we’ll keep moving forward and keep you apprised.  Looking longer term, we would like to do some PSNR, SSIM and VMAF evaluations, combine these results with the field testing we’ll be performing this summer with the ISS and NASA aircraft laser links, and properly publish the results.  When we get to that phase I’ll be reaching out to everyone for proper attribution and such as we pull together the paper.

Thanks to everyone for pitching in!  And thanks to Tad, Prash, Nadia and Shaun for supporting on the HDTN side.  Have a great weekend, all!

Regards,
Daniel

Dr. Daniel E. Raible, KE8ESB
Electronics Engineer, Optics and Photonics Branch (LCP)
NASA John H. Glenn Research Center at Lewis Field
21000 Brookpark Road, Mail Stop 77-2
Cleveland, OH 44135-3191
phone: (216) 433-3367 fax: (216) 433-8705

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.ccsds.org/pipermail/sis-mia/attachments/20240429/72baa0ed/attachment-0001.htm>