In this example, we will show you how to add a manifest.json file to an already existing repo so it can run on cybergis-compute.
Easy as it sounds, add a manifest.json file to this repo. This will define how your project will run on the HPC. In this example, we will keep this as simple as possible, but for more reading, check out https://github.com/cybergis/cybergis-compute-hello-world/blob/main/README.md for a more in-depth example of information that can be added to the manifest file.
Add this to the manifest.json file:
{
"name": "hello world",
"container": "python",
"pre_processing_stage": "python preprocessing.py",
"execution_stage": "python main.py",
"post_processing_stage": "python postprocessing.py",
"slurm_input_rules": {
"time": {
"max": 50,
"min": 10,
"default_value": 20,
"step": 1,
"unit": "Minutes"
},
"num_of_task": {
"max": 6,
"min": 1,
"default_value": 4,
"step": 1
}
},
"require_upload_data": false
}
For security reasons, all the repos that can be run on Cyber-GIS compute must be verified by the Compute team. For this example, we have already verified your repo, but ordinarily you would need to reach out at this point in the process.
Now, you can head over to CyberGISX to run your code. Make a new notebook and add this code
Cell 1:
from cybergis_compute_client import CyberGISCompute
cybergis = CyberGISCompute(url="cgjobsup.dev.cigi.illinois.edu", isJupyter=True, protocol="HTTPS", port=443, suffix="v2")
Cell 2:
cybergis.show_ui()