NGData image for data movement

Aims

* Take NgdataVDT? base image and optimize for data transfer, catering for site specific configuration of filesystems and other local needs

• At local site at this stage: Deploy ngdata image per cluster i.e. --

  gridftp.<cluster>.<org>

  points to first copy of this image

• Advantageous for cluster filesystems to be mounted with maximum bandwidth to ngdata

NGData Mount Point Info

Big thanks to all those who emailed me

Site Specific Notes

SAPAC

• Grid user home directories are currently separate from other users.
• We plan to mount all user directories on grid VMs soon.
• The protocol/speed may change sometime before July when the new cluster and storage is online.

iVEC

Gram Setup

• Both pbs and fork schedulers file:// protocol is "gridftp fs map"'ed.
  • PBS: file:// = gsiftp://cognac.ivec.org/
  • Fork: file:// = gsiftp://cognac.ivec.org/

• This is set in the /usr/local/globus/etc/gram-service/globus_gram_fs_map_config.xml file. The same setup is mimic-ed in the testing machines.
• Data machines (ngdata, ngsrb, etc) are running on a xen bridge on different card to globus boxes (ng2, ng2test, etc).

• In summary - there is 2 physical connections running, one for data, one for services.

[root@nggateway ~]# brctl show
bridge name     bridge id               STP enabled     interfaces
xenbr0          8000.feffffffffff       no              ng1.11
                                                        ng2.15
                                                        ng2condor.21
                                                        ng2srb.25
                                                        ng2test.31
                                                        ng2vdt.35
                                                        peth0
                                                        vif0.0
xenbr1          8000.feffffffffff       no              ngdata.41
                                                        nggums.61
                                                        ngportal.45
                                                        ngportal2.55
                                                        ngsrb.51
                                                        opendap.71
                                                        peth1
                                                        vif0.1

VPAC

[root@ngdata ~]# df -k |grep -v none
Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/sda1              4128448   1092604   2826132  28% /
/dev/sda3             16513960     89164  15585936   1% /tmp
stg4:/home/san01     488244896 379961344 108283552  78% /home/san01
stg3:/home/san02     488244896 418960960  69283936  86% /home/san02
stg4:/home/san03     488244896 398846528  89398368  82% /home/san03
stg3:/home/san04     488244896 389679200  98565696  80% /home/san04
stg4:/home/san05     488244896 382409088 105835808  79% /home/san05
stg3:/home/san06     488244896 433958528  54286368  89% /home/san06
stg3:/home/san08     488244896 434544352  53700544  90% /home/san08

• Link-speed is 100Mb .. temporary measure until we re-enable connection over internal storage-network .. at which stage it will rise to 1Gb.

-- JosephAntony - 18 Apr 2007