• Login
     
    View Item 
    •   ORFEO Home
    • Royal Meteorological Institute of Belgium
    • RMI publications
    • View Item
    •   ORFEO Home
    • Royal Meteorological Institute of Belgium
    • RMI publications
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Report on workflow analysis for specific LAM applications

    Thumbnail
    View/Open
    Published (1.958Mb)
    Authors
    Van Bever, Joris
    Smet, Geert
    Degrauwe, Daan
    Discipline
    Earth and related Environmental sciences
    Subject
    Numerical Weather Prediction
    Ensemble forecasting
    Exascale computing
    Audience
    Scientific
    Date
    2018-05-30
    Metadata
    Show full item record
    Description
    Deliverable D4.6 for project ESCAPE (Energy-efficient Scalable Algorithms for Weather Prediction at Exascale). In this deliverable we focus on the RMI-EPS ensemble prediction suite. We first provide a detailed report on the workflow of the suite in which 5 main categories of jobs are defined; pre-processing, lateral boundary conditions (LBCs), data assimilation, forecast and post-processing. Combined Energy and wall-clock time measurements of the entire RMI-EPS suite were performed. They indicate that the wall-clock times are relatively spread between the various defined job categories, with the forecast accounting for the largest fraction at about 35%. As far as energy consumption is concerned, the forecast part dwarfs everything else and is responsible for up to 99% of the total energy consumption. This means that energy optimizations for the forecast part will translate almost proportionally into optimizations of the whole suite, while the maximum theoretical speed-up due to forecast optimizations cannot exceed a factor of about 3/2. Therefore, in terms of energy consumption, optimizations should first focus on the forecast part. For wall-clock time performance gains, however, optimizations (and possibly additional dwarfs) can be considered for the categories outside of the forecast part. Finally, we report on our efforts to build a synthetic model of the suite through the Kronos workload simulator (cfr. The H2020 NEXTGenIO project). Such a synthetic model allows predicting the I/O and MPI behavior of the suite while subjected to hypothetical workloads on existing hardware. This is meant as a proof of concept and the necessary workflow is described without providing results of actual simulations.
    Citation
    Van Bever, J.; Smet, G.; Degrauwe, D. (2018-05-30). Report on workflow analysis for specific LAM applications, Tech. rep., ESCAPE, https://goo.gl/oRJaHx, 2018b.
    Identifiers
    uri: https://orfeo.belnet.be/handle/internal/7279
    Type
    Report
    Peer-Review
    No
    Language
    eng
    Links
    NewsHelpdeskBELSPO OA Policy

    Browse

    All of ORFEOCommunities & CollectionsBy Issue DateAuthorsTitlesDisciplinesThis CollectionBy Issue DateAuthorsTitlesDisciplines
     

    DSpace software copyright © 2002-2016  DuraSpace
    Send Feedback | Cookie Information
    Theme by 
    Atmire NV