[Moims-dai] NASA Guidance (Records Schedule) for Project/Program Files
tahoe_mike at sbcglobal.net
Tue Jan 5 23:01:15 UTC 2016
Hi Mark and others
On 1/5/2016 11:52 AM, Mark Conrad wrote:
> Second, the schedule identifies 8 stages of a project - Formulation,
> Approval, Design Development, Manufacture, Fabrication and
> Assembly, Pre-launch System Integration and Verification, Implementation
> and Operations, Observational Data, and Evaluation and Termination.
Related to this, there was an action item from the meeting on the 22nd
Action: clarify why we need another lifecycle
I spent many hours going through all the lifecycles in:
and looking at other archiving documents provided a summary in late 2014
for the DAI group which is included below.
Most lifecycles don't really consider the interactions of the three
participants (sponsor/project/archive). I wanted our lifecycle to point
out the importance of the sponsor and archive being involved in the
initiation of the project and then to point out the need for bringing in
requirements and tools to the specify and design stages. The
Exploitation activities aren't covered in most lifecycles. I didn't
think that all the themes in the LTDP (PDSC definition and appraisal,
archive operation and organization, security, ingestion, maintenance,
access and interoperability, exploitation and reprocessing, purge
prevention) were applicable to this document so came up with a shorter
list of activities.
Another thing to mention, the topics/issues came from a list David
provided from his work on the Active Data Management Plan, plus
evaluation of all the LTDP Common Guidelines, plus evaluation of all the
activities in the PAIMAS standard, plus looking at the ESDIS Earth
Science Content Specification, plus other issues that group members raised.
I've gone through all the reference documents we have seen and the
articles in our bibliography and tried to summarize the unique life
cycles that are presented. Here are some summaries with more details below:
David's: Planning and Creation Stage->Consolidation Stage->Long Term
Preservation Stage->Adding Value, Re-Use and Sustainability
Management->Archival Storage->Access->Preservation Planning
DCC: Conceptualize->create or receive->appraise and
select->ingest->preservation action-> store->access->use and
SDMW: Plan->Collect->Integrate and transform->Publish->Discover and
inform->Archive or discard
DMF: Planning and Production->Data Management Activities
Can we come up with an optimal set of categories based on all these
More detail from the various documents:
1. The LTDP preservation workflow includes:
Initialization (appraisal, define designated community, specification of
preservation/curation requirements, consolidation procedure, tailoring
content, consult with community, cost and risk assessment),
Consolidation (implement consolidation, gather missing content and
update), Implementation (data ingestion and catalog generation,
Operations (operations and maintenance, curation and stewardship -
2. The OAIS model includes Ingest, Data Management, Archival Storage,
Access, Management and Preservation Planning. It is missing Planning
(meaning enterprise planning), Collecting (Mission Operations, building
and running the enterprise), Analyzing (producing knowledge) and maybe
Packaging. All these occur prior to OAIS, but OAIS should be involved.
Consolidation could be part of Ingest or possibly an separate activity
outside the OAIS. Adding Value could be part of or a combination of
Preservation Planning or Access. This model syncs up with RASIM which
builds advanced information management objects in terms of five services
which correlate with OAIS components, archive service (ingest),
repository service (archival storage), registry service (data
management), product service (access plus archival storage), and query
service (access plus data management).
3. The Data Curation Centre life cycle includes conceptualize, create
or receive, appraise and select (with potential to dispose), ingest,
preservation action (migrate or reappraise), store, access, use and
reuse, transform (with potential to migrate).
4. The NOAA Environmental Data Life Cycle Functions include planning
new systems, then stewardship which includes observing operations,
archive, access, use. Overarching themes are governance, requirements
management, architecture management, security; developing rich metadata;
and mechanisms for user and requirements and feedback. Each of the
major categories has many sub-activities.
5. The Global Change Science Requirements for Long-Term Archiving
Workshop (USGCRP) identified the following components: User
Involvement, Data Administration, Documentation, Data Ingest and
Data Preservation and Maintenance, Data Processing/Reprocessing, Data
Access and User Support.
6. The USGS Life Cycle includes Plan, Acquire, Process, Analyze,
Preserve, Publish/Share with three activities running through all
phases: Describe (Metadata and Documentation), Manage Quality, Backup
7. The ESA Heterogenous Missions Accessibility Report really focuses on
data access and not the other phases.
8. The Harnessing the Power of Digital Data: Taking the Next Step,
Science Data Management Workshop report provides a number of models:
FGDC life cycle: Define, Inventory/Evaluate, Obtain, Access, Maintain,
Linear data lifecycle: Plan, Collect, Integrate and Transform, Publish,
Discovery with two activities running through all phases, Governance and
Stewardship and Communications.
Basic science model: plan, collect, integrate and transform, publish,
discover and inform, archive or discard.
The topics that are identified in the report include: data governance,
stewardship, sharing, access, security, version control, metadata
management, content and format, document and content management,
preservation, transfer of responsibility, data architecture, database
operations management, reference and master data management, data
warehousing and business intelligence, data quality management,
provenance, usability, value added services, workflow systems.
9. The LPDAAC Lifecycle Plan identifies the phases: Inception, Active
Archive, Long-Term Archive which each have four elements,
characterization, critical data and information, applicable standards,
The WBS is broken into phases, inception-planning (embed in producer
team, provide data management plan), inception-production (laison to
science stakeholders, collection inception checklist, support
production, repeat experiment, determine approach to tools/services,
authorize to migrate, provide NASA data template), active archive
transition from producer (obtain authorization to migrate, plan
migration, install new product line, migrate, advertise new products,
assume primary access and discovery role), active archive transition to
long-term (obtain authorization to migrate, plan migration), long term
archive transition to long-term (enable migration, execute migration,
advertise new products, transfer primary access and discovery role,
obtain authorization for certification, sunset products).
10. DataOne includes Collect, Assure, Describe, Deposit, Preserve,
Discover, Integrate, Analyze
11. Jeff de La Beaujardière's Data Management Framework
Planning and Production (Requirements Definition, Planning, Development,
Data Management Activities (Collection, Processing, Quality Control,
Documentation, Dissemination, Cataloging, Preservation, Stewardship,
Usage Tracking, Final Disposition);
Usage Activities (Discovery, Reception, Analysis, Product Generation,
User Feedback, Citation, Tagging, Gap Analysis).
More information about the MOIMS-DAI