From f0c19b7e055bac61c3a2b0058d08a3e6bbecfd04 Mon Sep 17 00:00:00 2001 From: Dirk Sarpe <dirk.sarpe@idiv.de> Date: Thu, 4 Apr 2019 19:25:24 +0200 Subject: [PATCH] started a separate section for data handling --- rstudio1.md | 7 +++++-- 1 file changed, 5 insertions(+), 2 deletions(-) diff --git a/rstudio1.md b/rstudio1.md index bba2f35..542a772 100644 --- a/rstudio1.md +++ b/rstudio1.md @@ -31,8 +31,6 @@ RStudio stores several files like suspended sessions, graph history etc. in `~/. ### /data You can create your own directories here and place data inside. By default others can read the directories you created here, but not write in them. If you need any special permission let us know via it-support@idiv.de. To directly jump to another directory select the *Files* pane and click on the three dots (…) located on the right hand side of the current file path. Now enter the path you want to browse, e.g. `/data/`. Additionally there should be a symbolic link in your home directory called data, which points to the /data directory. -Please note that R is able to work with compressed files. This is especially useful if you are the typical csv/txt file user. Those files usually contain highly redundant data. Therefore compression can be very effective, e.g. the file which triggered me to write this was a txt file of 4 GB the gz compressed file had 98 MB. Many tools to read or write (e.g. read.table, fread from data.table) allow transparent use of compressed files, i.e. you just specify the compressed file instead of the uncompressed file. - ### iDiv group shares If you are part of an iDiv group you can access your group share on the rstudio server at `/data/GROUPNAME-group-share/`. If your group share is not available yet please contact [it-support@idiv.de](mailto:it-support@idiv.de). @@ -47,6 +45,11 @@ su - $USER You will be asked to enter your password again and afterwards your network home will be available at `~/winhome`. However, it will only stay connected until you log out or quit your current session. If you have any longer running jobs you might want to consider either moving stuff from the ~/winhome to /data or open a [tmux](tmux.md) session from which you detach (Ctrl+b, d) before you disconnect. +## R and data +### compression + +Please note that R is able to work with compressed files. This is especially useful if you are the typical csv/txt file user. Those files usually contain highly redundant data. Therefore compression can be very effective, e.g. the file which triggered me to write this was a txt file of 4 GB the gz compressed file had 98 MB. Many tools to read or write (e.g. save, save.image, read.table, fread from data.table) allow transparent use of compressed files, i.e. you just specify the compressed file instead of the uncompressed file. + ## Data transfer You can use either use the web IDE to upload and export files. -- GitLab