Working With Remote

If you need to synchronize files with a remote directory such as, e.g., the KI4All cluster, the first option of choice is to use the version control software git. This is especially true for files that undergo frequent changes, such as source code.

However, git cannot handle large amounts of data such as large result or input files. For such data, it is recommended to exchange data directly via copy-paste, without using git.

When copying data, indexing is an expensive operation. Therefore, compress your data to a zip archive before copying. Some basic commands can be found below.

Compress a folder using zip:

zip -r my_arch.zip /path/to/my_folder

Copy a local zip archive to remote (here: the KI4All Cluster):

scp /path/to/my_arch.zip user@ki4alllogin.irmb.bau.tu-bs.de:/path/to/remote/destination/

Copy a zip archive from remote to local system:

scp user@ki4alllogin.irmb.bau.tu-bs.de:/path/to/my_arch.zip /path/to/local/destination/