COSCO Framework
COSCO is an AI based coupled-simulation and container orchestration framework for integrated Edge, Fog and Cloud Computing Environments. It's a simple python based software solution, where academics or industrialists can develop, simulate, test and deploy their scheduling policies. Further, this repo presents a novel gradient-based optimization strategy using deep neural networks as surrogate functions and co-simulations to facilitate decision making.
Advantages of COSCO
- Hassle free development of AI based scheduling algorithms in integrated edge, fog and cloud infrastructures.
- Provides seamless integration of scheduling policies with simulated back-end for enhanced decision making.
- Supports container migration physical deployments (not supported by other frameworks) using CRIU utility.
- Multiple deployment support as per needs of the developers. (Vagrant VM testbed, VLAN Fog environment, Cloud based deployment using Azure/AWS/OpenStack)
- Equipped with a smart real-time graph generation of utilization metrics using InfluxDB and Grafana.
- Real time metrics monitoring, logging and consolidated graph generation using custom Stats logger.
The basic architecture of COSCO has two main packages:
Simulator: It's a discrete event simulator and runs in a standalone system.
Framework: It’s a kind of tool to test the scheduling algorithms in a physical(real time) fog/cloud environment with real world applications.
Supported workloads: (Simulator) Bitbrains and Azure2017/2019; (Framework) DeFog and AIoTBench.
Our main COSCO work uses the Bitbrains and DeFog workloads. An extended work, MCDS (see workflow branch), accepted in IEEE TPDS uses scientific workflows. Check paper and code.
Novel Scheduling Algorithms
We present two novel algorithms in this work: GOBI and GOBI*. GOBI uses a neural network as a surrogate model and gradient based optimization using backpropagation of gradients to input. With advances like cosine annealing and momentum allow us to converge to an optima quickly. Moreover, GOBI* leverages a coupled simulation engine like a digital-twin to further improve the surrogate accuracy and subsequently the scheduling decisions. Experiments conducted using real-world data on fog applications using the GOBI and GOBI* methods, show a significant improvement in terms of energy consumption, response time, Service Level Objective and scheduling time by up to 15, 40, 4, and 82 percent respectively when compared to the state-of-the-art algorithms.
Supplementary video
A detailed course on using the COSCO framework for deep learning based scheduling (deep surrogate optimization and co-simulation) in fog environments is available as a youtube playlist.
Quick Start Guide
To run the COSCO framework, install required packages using
python3 install.py
To run the code with the required scheduler, modify line 106 of main.py to one of the several options including LRMMTR, RF, RL, RM, Random, RLRMMTR, TMCR, TMMR, TMMTR, GA, GOBI.
scheduler = GOBIScheduler('energy_latency_'+str(HOSTS))
To run the simulator, use the following command
python3 main.py
Gitpod
You can directly run tests on the results using a Gitpod Workspace without needing to install anything on your local machine. Click "Open in Gitpod" below and test the code by running python3 main.py.
Wiki
Access the wiki for detailed installation instructions, implementing a custom scheduler and replication of results. All execution traces and training data is available at Zenodo under CC License.
Links
| Items | Contents |
|---|---|
| Paper | https://ieeexplore.ieee.org/document/9448450 (with the "Code Reviewed Badge") |
| Pre-print | https://arxiv.org/pdf/2104.14392.pdf |
| Documentation | https://github.com/imperial-qore/COSCO/wiki |
| Video | https://youtu.be/RZOWTj0rfBQ |
| Tutorial | https://www.youtube.com/playlist?list=PLN_nzHzuaOBQijEwy2Fy8c09-dWYVe4XO |
| Extensions | QoS aware scheduling (TPDS'22, code), Energy aware sustainable computing (JSS'21, code), EdgeAI (SIGMETRICS'21, NeurIPS'21) and fault-tolerance (Infocom'22, code) |
| Contact | Shreshth Tuli (@shreshthtuli) |
| Funding | Imperial President's scholarship, H2020-825040 (RADON) |
Cite this work
Our work is published in IEEE TPDS journal. Cite using the following bibtex entry.
@article{tuli2021cosco,
author={Tuli, Shreshth and Poojara, Shivananda R. and Srirama, Satish N. and Casale, Giuliano and Jennings, Nicholas R.},
journal={IEEE Transactions on Parallel and Distributed Systems},
title={{COSCO: Container Orchestration Using Co-Simulation and Gradient Based Optimization for Fog Computing Environments}},
year={2022},
volume={33},
number={1},
pages={101-116},
}
License
BSD-3-Clause. Copyright (c) 2021, Shreshth Tuli. All rights reserved.
See License file for more details.
![Why metrics['slaviolations'] can only be 1?](https://avatars.githubusercontent.com/u/64058368?v=4)
318 Dec 06, 2022
769 Dec 27, 2022
24 Dec 17, 2022
1.4k Jan 05, 2023
1 Jan 26, 2022
427 Dec 27, 2022
1.5k Dec 30, 2022
46 Dec 19, 2022
64 Nov 16, 2022
5 Aug 25, 2020
6.9k Jan 01, 2023
245 Dec 16, 2022
697 Jan 05, 2023
66 Dec 15, 2022
7 Feb 10, 2022
6 Dec 21, 2022
63 May 22, 2021
3 Sep 08, 2022
77 Nov 25, 2022
45 Dec 31, 2022