Editing
CCU:New GPU Cluster
(section)
Jump to navigation
Jump to search
Warning:
You are not logged in. Your IP address will be publicly visible if you make any edits. If you
log in
or
create an account
, your edits will be attributed to your username, along with other benefits.
Anti-spam check. Do
not
fill this in!
== Copy data from the old cluster into the new filesystem == The shared file system can be mounted as an nfs volume on the old cluster, so you can create a pod which mounts both the new filesystem as well as your PVs from the old cluster. Please use the following pod configuration as a template and add additional mounts for the PVs you want to copy over. Note that if you want to copy over '''local''' PVs which live on different nodes, then you have to create two different pods, as otherwise the mounts conflict and the pod will forever be pending. <syntaxhighlight> apiVersion: v1 kind: Pod metadata: name: <your-username>-transfer-pod namespace: exc-cb spec: # vecna is a good node as it has the fastest connection to the new file system. # however, if you have to copy local PVs, then the pod needs to be on the respective node. # nodeSelector: # kubernetes.io/hostname: vecna containers: - name: ubuntu image: ubuntu:20.04 command: ["sleep", "1d"] volumeMounts: - mountPath: /abyss/shared name: cephfs-shared readOnly: false volumes: - name: cephfs-shared nfs: path: /cephfs/abyss/shared server: ccu-node1 </syntaxhighlight> Afterwards, run a shell in the container and copy your stuff over to /abyss/shared/users/<your-username>. The following should do the trick. Note that this is not a secure directory as everyone has full read/write access, so copy over to your own home directory on the new cluster as soon as possible. <syntaxhighlight> > kubectl exec -it <your-username>-transfer-pod /bin/bash # cd /abyss/shared/users/<your-username> # cp -r <all-my-stuff> ./ </syntaxhighlight>
Summary:
Please note that all contributions to Collective Computational Unit may be edited, altered, or removed by other contributors. If you do not want your writing to be edited mercilessly, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource (see
CCU:Copyrights
for details).
Do not submit copyrighted work without permission!
Cancel
Editing help
(opens in new window)
Navigation menu
Personal tools
Not logged in
Talk
Contributions
Create account
Log in
Namespaces
Project page
Discussion
English
Views
Read
Edit
View history
More
Search
Navigation
Collective Computational Unit
Main page
Projects
Tutorials
GPU Cluster
Core Facilitys
Mediawiki
Recent changes
Random page
Help
Tools
What links here
Related changes
Page information