Poster 84: ESTEE: A Simulation Toolkit for Distributed Workflow Execution
TimeThursday, 21 November 20198:30am - 5pm
DescriptionTask graphs provide a simple way to describe scientific workflows (sets of tasks with dependencies) that can be executed on both HPC clusters and in the cloud. An important aspect of executing such graphs is the used scheduling algorithm. Many scheduling heuristics have been proposed in existing works; nevertheless, they are often tested in oversimplified environments. We introduce a simulation environment designed for prototyping and benchmarking task schedulers. Our simulation environment, scheduler source codes, and graph datasets are open in order to be fully reproducible. To demonstrate usage of Estee, as an example, we compare the performance of various workflow schedulers in an environment using two different network models.