[Sls-mhdc] Your feedback about Action Item MHDC-A-1404-3(f) : results in GB

Wed Nov 5 10:11:52 UTC 2014

Dear all,

Thank you Aaron for this new version and your comments and suggestions.

I've uploaded a new version with new text and figures. I've also tried to include most of Aaron's suggestions or at least to present both alternatives (particularly for figures) in order to discuss them during the meeting.

For the graphs, I've already decided to separate Multispectral from hyperspectral, so I can't agree more with Aaron there. I also think that one single CCSDS123 configuration must be enough and clearer for comparison.
For the type of graph,  I've also included a classical bar chart for discussion as suggested. Nevertheless , I feel that for general purpose comparison between compressors (especially in this new version with separate MX and HX results) the stacked bar charts are really easy to read because we also have the numerical values. 
Of course, the missing results for ESA predictor still remain a problem for those figures (it's not the case for classical bar charts).

Anyhow, I'm completely open about the way we present the results, so maybe we can choose all together during the meeting taking this just as a starting point.

Regards,

Roberto

-----Message d'origine-----
De : Kiely, Aaron B (332B) [mailto:aaron.b.kiely at jpl.nasa.gov] 
Envoyé : mardi 4 novembre 2014 23:37
À : Camarero Roberto
Cc : sls-mhdc at mailman.ccsds.org
Objet : Re: [Sls-mhdc] Your feedback about Action Item MHDC-A-1404-3(f) : results in GB

Hi Everyone,

I have uploaded to the CWE a revised draft:

  CWE Private / Lossles-GreenBook / 120xg-2014Nov.doc

This version combines Robert's latest draft with Enrico's revised text on band re-ordering.  I've also added my own suggestions for revisions on the band re-ordering text.  My thoughts on Roberto's table and graphs are below rather than in the document.

Roberto, thanks for your table and graphs.  Looking at all of this has helped me to form an opinion.  Here's what I think:

Tables:

I think we should include tables of results so that a reader can read the numbers instead of having to interpolate from a graph.

We took the time to collect a lot of results, so I think we might as well include them all (e.g., all different options of CCSDS-123 for which we collected results).  But such a comprehensive table with all results would be too much for section 6.2 and probably should instead be an Annex.  We should include full-frame and segmented results in the tables.

I am undecided about whether to also include tables in section 6.2 (I could be convinced either way), but if we do, they should be of a more summary nature:
- Only include average for each image type (as you have done currently), not each individual image
- For CCSDS-123, just include the defaults.

I have mixed feelings about highlighting the best result in each row of a table.  Sometimes the best might beat others by only a tiny amount, and so highlighting the best may give more credit to a particular method than it really deserves.  We could leave out this sort of highlighting entirely, or (with a bit more work) apply a more complex color coding scheme to every cell (something like what's done in Table 2 in section 4.1.5).

Graphs:

I tend to think that graphs should be provided for both full-frame and segmented results, but only averages for each image type.  I think graphs for multispectral and hyperspectral images should be separated, which would also give more space for each graph and make it easier to read.

For CCSDS-123 results, it is only in a few cases where using something other than the "default" compression settings would give any significant performance improvement, and the few cases where it would make a difference one can see in section 4.2.2.1.  So to simplify the graphs, rather than showing four different flavors of CCSDS-123 (mostly with about the same results), I think it's simpler to just keep the default version.

I'm not really enthusiastic about the stacked bar charts in the two figures. (It took me a while to figure out what's being displayed.)  The chart basically invites you to compare the sum of the compressed bit rates for each compressor, but that implies a weighting of the different image types that is pretty arbitrary.  It's also harder to compare compressors for a given image type than the older more straightforward bar chart.  The corpus includes very different images - CRISM and M3 images with severe streaking artifacts, three flavors of very clean AVIRIS images, IASI and AIRS images that are very small spatially but with an enormous number of bands, and multispectral images with a rather small number of bands.  Some users are going to be completely uninterested in some of these images but it's harder for such a user to see the results of interest because they're all mixed together.  Also, this sort of display inherently draws more attention to imagers with higher bit depth (or that tend to be compressed to higher bit rates), and there's not a particularly good reason to do so.

I think a bar chart putting the different compressors together for a given image (like the older one) is easier to follow.  That would also solve the problem of missing results in some cases, since the corresponding bars would simply be missing.

Regards,
Aaron

On Oct 30, 2014, at 9:17 AM, Camarero Roberto <Roberto.Camarero at cnes.fr> wrote:

> Dear all,
> 
> I have uploaded a new version of the green book (120x2g-2014Oct22_RC) with some proposals about chapter 6.2 (results).
> The text is not written yet, but I wanted to have your feedback (in particular about figures) before going any further.
> You will find some comments with my impressions directly in the table and figures.
> 
> Regards,
> 
> Roberto
> 
> PS: I have taken 120x2g-2014Oct22 from Aaron, because it seemed to me 
> that it had more new content than 120x2g-2014Oct10_EM_v2 
> (unfortunately last changes from Enrico are not included)
> 
> -----Message d'origine-----
> De : sls-mhdc-bounces at mailman.ccsds.org 
> [mailto:sls-mhdc-bounces at mailman.ccsds.org] De la part de 
> sls-mhdc-request at mailman.ccsds.org
> Envoyé : vendredi 24 octobre 2014 18:00 À : sls-mhdc at mailman.ccsds.org 
> Objet : Sls-mhdc Digest, Vol 77, Issue 7
> 
> Send Sls-mhdc mailing list submissions to
> 	sls-mhdc at mailman.ccsds.org
> 
> To subscribe or unsubscribe via the World Wide Web, visit
> 	http://mailman.ccsds.org/cgi-bin/mailman/listinfo/sls-mhdc
> or, via email, send a message with subject or body 'help' to
> 	sls-mhdc-request at mailman.ccsds.org
> 
> You can reach the person managing the list at
> 	sls-mhdc-owner at mailman.ccsds.org
> 
> When replying, please edit your Subject line so it is more specific than "Re: Contents of Sls-mhdc digest..."
> 
> 
> Today's Topics:
> 
>   1. RE: Draft agenda for London meeting (Shen-En.Qian at asc-csa.gc.ca)
>   2. green book (Enrico Magli)
> 
> 
> ----------------------------------------------------------------------
> 
> Message: 1
> Date: Thu, 23 Oct 2014 17:05:20 +0000
> From: <Shen-En.Qian at asc-csa.gc.ca>
> Subject: [Sls-mhdc] RE: Draft agenda for London meeting
> To: <aaron.b.kiely at jpl.nasa.gov>
> Cc: sls-mhdc at mailman.ccsds.org
> Message-ID:
> 	<02FACAB3022DF94B90D34A2A1A900536C7ECD6FA at EXSTHMBX1.csa.space.gc.ca>
> Content-Type: text/plain; charset="iso-8859-1"
> 
> Dear Aaron and Working group members,
> 
> I will not participate in this upcoming meeting in London due to the constraint of our Canadian government travel budget reduction. I personally would like to continue to contribute to the CCSDS and to work with the group members. The pushing from CCSDS to CSA senior management might help.
> 
> I am sorry for missing this opportunity. Have a productive and great meeting in London.
> 
> Best regards,
> _______________________________________
> Shen-En Qian, PhD, F-ACE, F-SPIE
> Chercheur scientifique principal | Senior Scientist Sciences et 
> technologies spatiales | Space Science & Technology Agence spatiale 
> canadienne | Canadian Space Agency 6767, Route de l'A?roport, 
> Longueuil (St-Hubert), QC, Canada, J3Y 8Y9 T?l/Tel : (450) 926-4618 | 
> T?l?c/Fax: (450) 926-4575 Courriel/E-mail : 
> [shen-en.qian at asc-csa.gc.ca<mailto:shen-en.qian at space.gc.ca>]
> Site web/Web site : [www.asc-csa.gc.ca<http://www.space.gc.ca/>]
> Gouvernement du Canada | Government of Canada
> 
> From: sls-mhdc-bounces at mailman.ccsds.org 
> [mailto:sls-mhdc-bounces at mailman.ccsds.org] On Behalf Of Kiely, Aaron 
> B (332B)
> Sent: Tuesday, October 21, 2014 7:24 PM
> To: sls-mhdc at mailman.ccsds.org
> Subject: [Sls-mhdc] Draft agenda for London meeting
> 
> Dear Working Group,
> 
> Attached is a draft agenda for the London meeting.
> 
> Please send me your suggestions for changes/additions.  We can revise the agenda as many times as necessary.
> 
> In particular, there may be a more logical order to the agenda items and I hope that those of you more familiar with the topics can suggest an improved order.
> 
> Regards,
> Aaron
> -------------- next part -------------- An HTML attachment was 
> scrubbed...
> URL: 
> http://mailman.ccsds.org/pipermail/sls-mhdc/attachments/20141023/ed71f
> acc/attachment-0001.htm
> 
> ------------------------------
> 
> Message: 2
> Date: Fri, 24 Oct 2014 09:34:31 +0200
> From: Enrico Magli <enrico.magli at polito.it>
> Subject: [Sls-mhdc] green book
> To: "sls-mhdc at mailman.ccsds.org" <sls-mhdc at mailman.ccsds.org>
> Message-ID: <544A0107.5000404 at polito.it>
> Content-Type: text/plain; charset=utf-8; format=flowed
> 
> Dear all,
> 
> I have uploaded a new version of the green book on CWE (EM_v2), where I modified the section on band re-ordering, as discussed before.
> 
> I found a way to manage the MS Word document that seems to work for me. 
> Instead of navigating the document using the scrollbar on the right, or the page up/down keys, I "navigate by section". I.e., see the small circle at the bottom right corner of the MS Word window, between the two "double-arrow" buttons? Click it and select "Browse by section", then navigate using the two buttons. Hope this helps.
> 
> Regards,
> Enrico
> 
> 
> 
> ------------------------------
> 
> _______________________________________________
> Sls-mhdc mailing list
> Sls-mhdc at mailman.ccsds.org
> http://mailman.ccsds.org/cgi-bin/mailman/listinfo/sls-mhdc
> 
> 
> End of Sls-mhdc Digest, Vol 77, Issue 7
> ***************************************
> 
> _______________________________________________
> Sls-mhdc mailing list
> Sls-mhdc at mailman.ccsds.org
> http://mailman.ccsds.org/cgi-bin/mailman/listinfo/sls-mhdc