Comments (2)
An additional point here is that while $HOME usually has a lot of space, /tmp
does not. As an example, if I run the command that prints out disk usage (df -h
) in a terminal on the openscapes hub, I get:
(notebook) jovyan@jupyter-yuvipanda:~$ df -h
Filesystem Size Used Avail Use% Mounted on
overlay 80G 24G 57G 30% /
tmpfs 64M 0 64M 0% /dev
tmpfs 16G 0 16G 0% /sys/fs/cgroup
fs-b25253b5.efs.us-west-2.amazonaws.com:/prod/yuvipanda 8.0E 3.2T 8.0E 1% /home/jovyan
shm 64M 0 64M 0% /dev/shm
/dev/nvme0n1p1 80G 24G 57G 30% /etc/hosts
fs-b25253b5.efs.us-west-2.amazonaws.com:/prod/_shared 8.0E 3.2T 8.0E 1% /home/jovyan/shared-readwrite
fs-b25253b5.efs.us-west-2.amazonaws.com:/prod/_shared 8.0E 3.2T 8.0E 1% /home/rstudio/shared
fs-b25253b5.efs.us-west-2.amazonaws.com:/prod/_shared 8.0E 3.2T 8.0E 1% /home/rstudio/shared-readwrite
fs-b25253b5.efs.us-west-2.amazonaws.com:/prod/_shared 8.0E 3.2T 8.0E 1% /home/jovyan/shared
tmpfs 30G 16K 30G 1% /mnt/ghsa-w3vc-fx9p-wp4v/check-patch-run
tmpfs 30G 12K 30G 1% /run/secrets/kubernetes.io/serviceaccount
tmpfs 30G 4.0K 30G 1% /run/secrets/eks.amazonaws.com/serviceaccount
tmpfs 16G 0 16G 0% /proc/acpi
tmpfs 16G 0 16G 0% /sys/firmware
There's a bunch of extra stuff here (including stuff that says tmpfs
but you can ignore that), but primary use to us is two:
Filesystem Size Used Avail Use% Mounted on
overlay 80G 24G 57G 30% /
fs-b25253b5.efs.us-west-2.amazonaws.com:/prod/yuvipanda 8.0E 3.2T 8.0E 1% /home/jovyan
We can tell that the temporary directory is under /
because of the following python code:
>>> import tempfile
>>> tempfile.gettempdir()
'/tmp'
>>>
And looking at the list of various mountpoints in the df -h
output, you can see that /
is the one that /tmp
is under. If there was a specific mount for /tmp
it would show up there!
Anyway, the thing to note here is that there is 57G available for all users on a single node when using /tmp
. You can't see other people's /tmp, but it does take up space! And which two users are placed on a node is not upto the users, so it is possible for a user to use up all the space available for /tmp
in a particular node.
from docs.
I've discussed some potential solutions in 2i2c-org/infrastructure#3833, but don't believe we should put more effort into them at this point.
from docs.
Related Issues (20)
- Create a user off-boarding checklist for hub admins
- Document Grafana access for communities HOT 1
- [BUG] readthedocs actions doesn't provide a working URL to deploy preview when updating docs
- Upgrade Hub Service Guide to Jupyter Book HOT 3
- [EPIC] Port existing Hub Service Guide content to Jupyter Book HOT 8
- Document that the configurator is not available if using profileLists
- Write technical content for guiding communities on how to build custom images for their hubs. HOT 7
- Add how to edit users in admin/howto/manage-users/
- Directive to replace custom Python, e.g. list of running hubs and feature tables HOT 5
- [EPIC] Update workflows for the Hub Service Guide (docs.2i2c.org) to aid support work
- How-to guide for adding persistent storage buckets HOT 6
- How-to guide for tracking usage and costs in Grafana HOT 1
- Update how-to-guides/add-packages-to-image.md
- Move https://github.com/yuvipanda/example-inherit-from-community-image to 2i2c-org and change into template HOT 2
- Create how-to on using dask-gateway for communities HOT 6
- Document use of cloud object storage HOT 4
- Document how to test JupyterHub images locally
- Create redirect from old customise image docs to new customise image docs HOT 3
- Tutorial for data transfer workflow for large datasets
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from docs.