Skip to content
GitLab
Projects Groups Topics Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in
  • E ESGF Publishing
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributor statistics
    • Graph
    • Compare revisions
    • Locked files
  • Issues 3
    • Issues 3
    • List
    • Boards
    • Service Desk
    • Milestones
    • Iterations
    • Requirements
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Artifacts
    • Schedules
    • Test cases
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Terraform modules
    • Model experiments
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • CI/CD
    • Insights
    • Issue
    • Repository
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Nationellt superdatorcentrumNationellt superdatorcentrum
  • ESGFESGF
  • ESGF Publishing
  • Milestones
  • `.md` workbook generation script
Closed
Milestone

`.md` workbook generation script
Milestone ID: 411

An automatic template workbook generation, to be used as a semi-automatic publication guideline, strikes as a middleground between a fully automatic pipeline (which could be really dangerous, when failing) and a fully hand-written one.

Thus, near field we have;

In a first simple script - take a couple of predefined template files, with arguments specifying

  • publication number
  • publication type
  • smhi data directory
  • node staging area
  • node final path

and inject the output of the .out files from

  • Receive checks
  • Variable checks

Our end-game is thus;

  • Generate from a template, based on http://localhost:4000/IS-ENES/2020-04-22-CMIP6_data_publication_request_70/
  • Using results from receive and variable checks
  • Suggesting a default staging area (into which to rsync the data)
    • Add option to specify
  • Suggesting a default final path
    • Add option to specify it
  • Possibly even parsing in an e-mail body supplied via sftp or the like to the node (to be done later, AI fun)

First steps are to create a .md template generator based on the receive and variable checks.

A later feature is that this could also be e-mailed from tetralith to the agent, when ready (if no errors resulted).

  • Issues 7
  • Merge requests 0
  • Participants 0
  • Labels 0
100% complete
100%
Start date
No start date
None
Due date
No due date
7
Issues 7 New issue
Open: 0 Closed: 7
None
Total issue weight
None
0
Merge requests 0
Open: 0 Closed: 0 Merged: 0
0
Releases
None
Reference: NSC/esgf/esgf_publishing%"`.md` workbook generation script"