Data transfers using either scp, sftp, or ftp are available to
observers. SCP and SFTP are the prefered methods for transfering
data because they are more secure. Please observer the following
guidelines when transferring data:
- Transfer data during daylight hours. Never transfer data while someone else is
observing!
Running FTP while you (or someone else) are observing can
slow down the network, disk access, cpu speeds, etc.
Please be considerate of other observers' needs.
- Transfer data from the summit. Keck's internet
connection is via the summit; thus, transfers are faster
from the summit. Observers should transfer data while
logged into the instrument host computer using the assigned
instrument observing account.
- Remain at Keck until your transfer is complete. If
there are problems with the data transfer, staff are not required
to address the problem. Observers are encouraged to remain at Keck
until their data transfer is complete. Note that there is no incoming FTP access to Keck
computers. If you plan to transfer data to an external site
via FTP, then you must do so before you leave.
- Transfer data from Keck to an observer's home
institution. Although scp and ftp are supported, Keck's
firewall will prevent you from accessing the machines remotely
unless you complete the firewall authentication procedure first.
To transfer data, we recomended that you initiate the transfer
from the summit host back to your home institution. If this is
not possible, then you can contact your WMKO support astronomer
for instructions on accessing the Keck firewall.
- Your session could be terminated at any time. Staff
and the next night's observers require use of the comuters during
the day. If for some reason, someone needs to use the computer
that is transfering your data, the data transfer could be
terminated. In addition, if the data transfer is determined to be
causing problems at the summit or at HQ, staff and observers are
permitted to terminate your data transfer.
Please follow these steps to transfer data from a Keck machine
to an outside machine using scp:
- Use the rlogin command to start a shell on a
summit instrument computer. Note that running your
scp session from a computer at HQ in Waimea will
significantly reduce the transfer efficiency because the
data will have to make an additional round trip from the
summit to HQ before going to the enternal host machine.
- cd to your data directory.
Use the "cd" command to move to your data
directory. "cdata" is an alias to your data directory on an instrument
machine.
Note that data disks can be accessed using the
syntax "/s/sdataXXX".
- Execute the scp command to transfer the
data, as in
scp *.fits staypuftmarshmellowman@gu.edu:myData/
- When the transfer completes, exit the rlogin session by
typing "exit" at the command prompt.
Observers can copy data directly to their laptops while at Keck. In
this case, it's best to initiate the transfer from the laptop in order
to avoid having to figure out the address of the laptop. If you have
the scp program installed on your laptop, please follow
these steps to pull data onto your laptop from a Keck machine:
- Open a window on your laptop and navigate to the
directory where you would like to store your data.
- Execute the scp command to transfer the entire
contents of your data directory to the current directory on your
laptop, as in:
scp -r account@host:/path/ .
where account is the name of your observing account,
host is the name of the instrument host, and path is
the pathname to your data. For example, to copy data from the
directory /sdata123/2010jan01/lris1 as user
lris1, enter:
scp -r lris1@lrisserver:/sdata123/2010jan01/lris1 .
- When the transfer completes, exit the rlogin session by
typing "exit" at the command prompt.
Observers can copy data to or from Keck from external machines
(whether laptops or workstations) using scp. Please
follow these steps to copy data from Keck computers to your
external machine:
- Obtain access through the Keck firewall. Please contact
your WMKO Support Astronomer for instructions.
- Open a window on your computer navigate to the directory
where you would like to store your data.
- Execute the scp command to transfer the entire
contents of your data directory to the current directory on your
computer, as in:
scp -r account@host:/path/ .
where account is the name of your observing account,
host is the name of the instrument host, and path is
the pathname to your data. For example, to copy data from the
directory /sdata123/2010jan01/lris1 as user
lris1, enter:
scp -r lris1@lrisserver:/sdata123/2010jan01/lris1 .
Please follow these steps to transfer data using sftp:
- Use the rlogin command to start a shell on a
summit instrument computer. Note that running your
sftp session from a computer at HQ in Waimea will reduce the
transfer efficiency.
- cd to your data directory.
Use the "cd" command to move to your data
directory. "cdata" is an alias to your data directory on an instrument
machine.
Note that data disks can be accessed using the
syntax "/s/sdataXXX".
- Use the cd to move to the directory where you
would like your data stored.
- Type
put *.fits
to transfer all of the FITS
images in the directory.
- When the transfer has completed, you may use the command
lcd directory
to move to another directory
on the Keck machine, and use put again to copy the
data.
- When done transferring all files, type quit to
end your FTP session.
- scp the data (ex: scp *.fits staypuftmarshmellowman@gu.edu:myData/)
- Exit the rlogin session by typing "exit" at the command prompt.
- Use the rlogin command to start a shell on a
summit computer. Running your FTP session from a
computer at HQ in Waimea will drastically reduce the
transfer efficiency!
- cd to your data directory.
Use the cd command to move to your data
directory. "cdata" is an alias to your data directory on an instrument
machine.
Note that data disks can be accessed using the
syntax /s/sdataXXX.
- Run the ftp command to start an FTP session.
- Use the command
open my_home_site
to
open an FTP connection to your home site. Provide the proper
account name and password to log in.
- Use the cd to move to the directory where you
would like your data stored.
- Issue the command binary to set binary
transfer mode.
- Issue the command prompt to turn off
verification of each file transfer.
- Type
put *.fits
to transfer all of the FITS
images in the directory.
- When the transfer has completed, you may use the command
lcd directory
to move to another directory
on the Keck machine, and use put again to copy the
data.
- When done transferring all files, type quit to
end your FTP session.
- As above, if you are using ftp or sftp to transfer to a host
with an ftp server, initiate your transfer from the instrument host
and use 'put.'
However, if you are transferring to a laptop with no ftp server,
then you can use the laptop's ftp client and connect to a
summit ftp server and use 'get'.
However, note the following:
With the advent of MaxOS 10.5, a compatibility issue has surfaced
between that system's ftp client and the (much older)
ftp server running on most of our summit instrument computers.
So, for example, using a 10.5 Mac to make an ftp connection
directly to the NIRSPEC host, waimea, to transfer data from
/sdata603, will result in the first file transferring very slowly
and then the transfer stops altogether.
To work around this problem, make an ftp connection to
svncserver2 (svncserver1 for a K1 instrument like LRIS) and then
use the "/s" method to access the data disk (e.g., for the
NIRSPEC example, cd /s/sdata603).