Doing computational research often means generating lots of data that needs to be processed and analyzed. In some fields, file sizes often go well into the gigabytes or even terabytes. If you have to work from home or are doing a short stay away from your workspace, downloading the full dataset to work on it locally is not only cumbersome, but inefficient. Are there any alternatives? Of course!
The full series will cover three separate parts that can be used complementarily if desired.
- Remote file access
- Access via
ssh
to your remote PC, even when it is inside a private network only accessible from an intermediate server. - Mount the data stored in your remote PC over SSH with
sshfs
so the software in your home computer believe that the data is actually stored locally.
- Access via
- Remote data analysis
- Set up a Jupyter Notebook environment to perform content-rich and interactive analysis in your remote PC from home. No data downloads involved!
- Remote graphical interfaces and desktop
- Use X forwarding.
- Configure a remote desktop solution to access your full graphical environment, if you really need it.
While I have tried to remain field-agnostic during these three parts, I have found these guidelines to be particularly useful for molecular structure visualization and molecular dynamics trajectory analysis.
I am aware that none of this is new; just a bunch of popular tools and commands put to do what they are meant to. However, I wanted to have all that scattered documentation gathered in a single place for quick checks when I need it in the future, and thought that maybe somebody else could find it useful! Ready?
Table of contents
You can reach me over Twitter or a GitHub issue to let me know what you think, if you want :)