From d482023d759fbc5eef1851c2d857618e12bf5ff9 Mon Sep 17 00:00:00 2001
From: Natalie Elphick
Date: Fri, 12 Apr 2024 17:32:41 -0700
Subject: [PATCH] final edits
---
docs/Working_on_Wynton_Part_1.html | 65 +++--
docs/Working_on_Wynton_Part_2.html | 25 +-
.../Working_on_Wynton_Part_1.Rmd | 252 ++++++++----------
.../Working_on_Wynton_Part_2.Rmd | 21 +-
4 files changed, 189 insertions(+), 174 deletions(-)
diff --git a/docs/Working_on_Wynton_Part_1.html b/docs/Working_on_Wynton_Part_1.html
index 98066a3..13f2af2 100644
--- a/docs/Working_on_Wynton_Part_1.html
+++ b/docs/Working_on_Wynton_Part_1.html
@@ -585,10 +585,16 @@ document.addEventListener('DOMContentLoaded', function(e) {
Introductions
-Natalie Elphick
-Bioinformatician I
-Alex Pico (TA)
-Bioinformatics Core Director
+Instructor:
+ Natalie Elphick
+ Bioinformatician I
+TAs:
+ Alex Pico
+ Bioinformatics Core Director
+ Ayushi Agrawal
+ Bioinformatician III
+ Min-Gyoung Shin
+ Bioinformatician III
@@ -781,8 +787,8 @@ requests
Certain input/output patterns can be problematic
-
-BeeGFS - I/O patterns
+
+BeeGFS - I/O patterns
- Anything that requires lots of metadata operations can feel slow
@@ -791,21 +797,18 @@ and directory searches (conda)
Keep the number of reads and writes to a single directory to a
reasonable number
-If using conda, putting the conda application inside a Apptainer
-(formerly singularity) container will result in better performance
-
-BeeGFS - Tips
+
+BeeGFS - Takehome Message
- Prefer fewer, large files over many small ones
-- Distribute reading and writing over several directories
-
-- Including compute job output and error files
-
-- Use local scratch (/scratch) when possible
+- Distribute reading and writing over several directories
+- Use local scratch (/scratch) when possible
- Don’t include anything in /wynton in your default
LD_LIBRARY_PATH
+- If using conda, putting the conda application inside a Apptainer
+(formerly singularity) container will result in better performance
@@ -872,18 +875,22 @@ contacting Gladstone IT
knowledge base page
-
-Storage Advice
+
+Storage Advice
- Always back up anything you store under
/wynton
-- Back up your data on /gladstone if you have access
-to it
+
- If you have access to it keep all of your data on
+/gladstone
-- A large number of jobs reading and writing to these directories will
+
- A large number of jobs reading and writing to these directories may
be slower since it is NFS mounted not BeeGFS
-- Use the scratch directories to store temporary files
+- Use the scratch directories to store temporary files
+
+- e.g. A large amount of .fastq that you do not need after the
+alignment step
+
@@ -906,6 +913,13 @@ be slower since it is NFS mounted not BeeGFS
{local}$ scp alice@dt1.wynton.ucsf.edu:/path/to/local_file.tsv /destination/path
+
+Hands-on
+
+- Use scp to copy this file
+into your home directory on Wynton
+
+
GUI SFTP Clients
@@ -955,8 +969,7 @@ UCSF Box instructions
Poll 1
-Which of these can you not log in to from your
-computer?
+Poll 1 - Which of these can you not SSH in to?
- Login Nodes
- Development Nodes
@@ -967,7 +980,7 @@ computer?
Poll 2
The /wynton directory is backed up on a nightly
-basis so do not need to back up the data you store here.
+basis, so there is no need to back up anything stored here.
- True
- False
@@ -1136,7 +1149,7 @@ run:
diff --git a/docs/Working_on_Wynton_Part_2.html b/docs/Working_on_Wynton_Part_2.html
index 1d5b705..1984afa 100644
--- a/docs/Working_on_Wynton_Part_2.html
+++ b/docs/Working_on_Wynton_Part_2.html
@@ -585,10 +585,14 @@ document.addEventListener('DOMContentLoaded', function(e) {
Introductions
-Natalie Elphick
-Bioinformatician I
-Alex Pico (TA)
-Bioinformatics Core Director
+Instructor:
+ Natalie Elphick
+ Bioinformatician I
+TAs:
+ Alex Pico
+ Bioinformatics Core Director
+ Michela Traglia
+ Senior Statistician
Target Audience
@@ -939,8 +943,8 @@ cancelled
Poll 3
-Anything that you can run on a compute node can be run on a
-development node.
+Any submitted job to compute nodes can also be run on development
+nodes.
- True
- False
@@ -1155,6 +1159,8 @@ into Wynton