Good afternoon everyone,
*IMPORTANT: Cluster Output Paths* As we indicated last week, from today it will not be possible to write to /groups from the cluster, only /scratch/groups. This step has been taken to prevent the /groups partition filling up with data which does not belong in there. If /groups fills up, all users are affected.
To illustrate the point, during last week (when writing to /groups remained possible) one cluster job generated ~300Gb of data in /groups which belonged in /scratch/groups. The partition was therefore completely filled up. The consequence was that another user was unable to run their stimulus code, which depends on there being space in /groups to log output, and their scanning was delayed significantly.
More generally, it is important to recognise that storage resources are limited, and that when the full capacity of partitions is reached many more people than those who wrote the data may be affected. It would be appreciated if users who anticipate writing large amounts of data, could first estimate how much data will be written and then ask us how best to accommodate the data. In general, we would also like to remind users of the importance of storing the correct data in the correct areas; this will avoid us having to take urgent remedial actions in cases where other users have been affected.
*YNiC User Inductions* If you are aware of any new students/staff that will require access to YNiC and/or an IT account, they must attend a YNiC user induction. Our final induction date before the Christmas break will be Wednesday 11th December at 2pm. Please ask them to contact support@ynic.york.ac.uk to sign up.
Hope you have a great week! Kind regards Lauren
Hello
We've had a few questions around the restriction of write access to /groups and so here are the answers for everyone to clear up any confusion.
* Any labs areas mounted under /groups/labs still have write access. * The change is to prevent write access to group folders in /groups/Projects * You can still write to /groups from any desktop/Stim PC in YNiC and the remote desktops.
Thanks
Joe
On 25/11/2019 13:27, Lauren Welbourne via ynic-users wrote:
Good afternoon everyone,
*_IMPORTANT: Cluster Output Paths_* As we indicated last week, from today it will not be possible to write to /groups from the cluster, only /scratch/groups. This step has been taken to prevent the /groups partition filling up with data which does not belong in there. If /groups fills up, all users are affected.
To illustrate the point, during last week (when writing to /groups remained possible) one cluster job generated ~300Gb of data in /groups which belonged in /scratch/groups. The partition was therefore completely filled up. The consequence was that another userwas unable to run their stimulus code, which depends on there being space in /groups to log output, and their scanning was delayed significantly.
More generally, it is important to recognise that storage resources are limited, and that when the full capacity of partitions is reached many more people than those who wrote the data may be affected. It would be appreciated if users who anticipate writing large amounts of data,could first estimate how much data will be written and then ask us how best to accommodate the data. In general, we would also like to remind users of the importance of storing the correct data in the correct areas; this will avoid us having to take urgent remedial actions in cases where other users have been affected.
*_YNiC User Inductions_* If you are aware of any new students/staff that will require access to YNiC and/or an IT account, they must attend a YNiC user induction. Our final induction date before the Christmas break will be Wednesday 11th December at 2pm. Please ask them to contact support@ynic.york.ac.uk mailto:support@ynic.york.ac.uk to sign up.
Hope you have a great week! Kind regards Lauren
-- Lauren Welbourne, PhD Senior Research Technician lauren.welbourne@york.ac.uk mailto:lauren.welbourne@york.ac.uk
York Neuroimaging Centre University of York Innovation Way Heslington York YO10 5NY
-
Joe Lyons -
Lauren Welbourne