The PPD dCache Storage ElementDCache is the main disk storage system in us on the PPD Unix/Linux systems. It allows us to aggregate the storage space on many servers and present this as a unified namespace to users. Files in dCache can be read using the SRM "grid" protocol or the "local" protocols dcap and xrootd. For writing files only the SRM grid protocolcan be used and requires you to have a valid voms proxy for a supported VO. The dCache namespace can also be browsed like a normal filesystem on the PPD linux nodes but the contents of the files cannot be accessed through this (i.e. ls or find will work cp, open or mv will fail). VOs and/or groups have area to store files under their name dCache namespace in /pnfs/pp.rl.ac.uk/data/Inspecting a file using the pnfs mountSimply use ls as you would with a local file. ls -l /pnfs/pp.rl.ac.uk/data/vo/path/to/fileConverting a local file path in PNFS to a URL to access the fileFor srm addsrm://heplnx204.pp.rl.ac.uk to the path beginning /pnfs
i.e.
srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file
For dcap add dcap://dcap.pp.rl.ac.uk to the path beginning /pnfs
i.e.
dcap://dcap.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file
Note that the hosts are different heplnx204.pp.rl.ac.uk for srm and dcap.pp.rl.ac.uk for dcap
Copying/Reading a file using the Grid toolsTo copy a file into dCache without registering it in a Logical File Cataloguelcg-cp -v file:/path/to/local/file srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/put/file
To copy a file into dCache and register it with a Logical File Catalogue use the lcg-cr command instea, VOs that use the LFC may have some rules about how the LFC namespace and the SRM namespace should be related to one another.
Reading a file using local protocolscopying a file out of dCache using dcap: | ||||||||
Changed: | ||||||||
< < | dccp dcap://heplnx203.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file | |||||||
> > | dccp dcap://dcap.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file | |||||||
Or, if pnfs is locally mounted:
dccp /pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file
Access a file directly from dCache using root: | ||||||||
Changed: | ||||||||
< < | root dcap://dcacp.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file | |||||||
> > | xrdcp root://dcap.pp.rl.ac.uk///pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file | |||||||
Deleting a file from dCacheIf the file is not registered in the LFC: | ||||||||
Changed: | ||||||||
< < | lcg-del -l srm://dcap.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file | |||||||
> > | lcg-del -l srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file | |||||||
If it is registered in the LFC remove the "-l" option: | ||||||||
Changed: | ||||||||
< < | lcg-del srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file | |||||||
> > | lcg-del srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file | |||||||
-- ChrisBrew / RobHarper - 2010-03-12
|
The PPD dCache Storage ElementDCache is the main disk storage system in us on the PPD Unix/Linux systems. It allows us to aggregate the storage space on many servers and present this as a unified namespace to users. Files in dCache can be read using the SRM "grid" protocol or the "local" protocols dcap and xrootd. For writing files only the SRM grid protocolcan be used and requires you to have a valid voms proxy for a supported VO. The dCache namespace can also be browsed like a normal filesystem on the PPD linux nodes but the contents of the files cannot be accessed through this (i.e. ls or find will work cp, open or mv will fail). VOs and/or groups have area to store files under their name dCache namespace in /pnfs/pp.rl.ac.uk/data/Inspecting a file using the pnfs mountSimply use ls as you would with a local file. ls -l /pnfs/pp.rl.ac.uk/data/vo/path/to/fileConverting a local file path in PNFS to a URL to access the fileFor srm addsrm://heplnx204.pp.rl.ac.uk to the path beginning /pnfs
i.e.
srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file | ||||||||
Changed: | ||||||||
< < | For dcap add dcap://heplnx209.pp.rl.ac.uk to the path beginning /pnfs | |||||||
> > | For dcap add dcap://dcap.pp.rl.ac.uk to the path beginning /pnfs | |||||||
i.e. | ||||||||
Changed: | ||||||||
< < | dcap://heplnx203.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file | |||||||
> > | dcap://dcap.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file | |||||||
Changed: | ||||||||
< < | Note that the hosts are different heplnx204.pp.rl.ac.uk for srm and heplnx203.pp.rl.ac.uk for dcap | |||||||
> > | Note that the hosts are different heplnx204.pp.rl.ac.uk for srm and dcap.pp.rl.ac.uk for dcap | |||||||
Copying/Reading a file using the Grid toolsTo copy a file into dCache without registering it in a Logical File Cataloguelcg-cp -v file:/path/to/local/file srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/put/file
To copy a file into dCache and register it with a Logical File Catalogue use the lcg-cr command instea, VOs that use the LFC may have some rules about how the LFC namespace and the SRM namespace should be related to one another.
Reading a file using local protocolscopying a file out of dCache using dcap:dccp dcap://heplnx203.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file
Or, if pnfs is locally mounted:
dccp /pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file
Access a file directly from dCache using root: | ||||||||
Changed: | ||||||||
< < | root dcap://heplnx203.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file | |||||||
> > | root dcap://dcacp.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file | |||||||
Deleting a file from dCacheIf the file is not registered in the LFC: | ||||||||
Changed: | ||||||||
< < | lcg-del -l srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file | |||||||
> > | lcg-del -l srm://dcap.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file | |||||||
If it is registered in the LFC remove the "-l" option:
lcg-del srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file
-- ChrisBrew / RobHarper - 2010-03-12
|
The PPD dCache Storage ElementDCache is the main disk storage system in us on the PPD Unix/Linux systems. It allows us to aggregate the storage space on many servers and present this as a unified namespace to users. Files in dCache can be read using the SRM "grid" protocol or the "local" protocols dcap and xrootd. For writing files only the SRM grid protocolcan be used and requires you to have a valid voms proxy for a supported VO. The dCache namespace can also be browsed like a normal filesystem on the PPD linux nodes but the contents of the files cannot be accessed through this (i.e. ls or find will work cp, open or mv will fail). VOs and/or groups have area to store files under their name dCache namespace in /pnfs/pp.rl.ac.uk/data/Inspecting a file using the pnfs mountSimply use ls as you would with a local file. ls -l /pnfs/pp.rl.ac.uk/data/vo/path/to/fileConverting a local file path in PNFS to a URL to access the fileFor srm addsrm://heplnx204.pp.rl.ac.uk to the path beginning /pnfs
i.e.
srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file
For dcap add dcap://heplnx209.pp.rl.ac.uk to the path beginning /pnfs
i.e. | ||||||||
Changed: | ||||||||
< < | dcap://heplnx209.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file | |||||||
> > | dcap://heplnx203.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file | |||||||
Changed: | ||||||||
< < | Note that the hosts are different heplnx204.pp.rl.ac.uk for srm and heplnx209.pp.rl.ac.uk for dcap | |||||||
> > | Note that the hosts are different heplnx204.pp.rl.ac.uk for srm and heplnx203.pp.rl.ac.uk for dcap | |||||||
Copying/Reading a file using the Grid toolsTo copy a file into dCache without registering it in a Logical File Catalogue | ||||||||
Changed: | ||||||||
< < | l cg-cp -v file:/path/to/local/file srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/put/file | |||||||
> > | lcg-cp -v file:/path/to/local/file srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/put/file | |||||||
To copy a file into dCache and register it with a Logical File Catalogue use the lcg-cr command instea, VOs that use the LFC may have some rules about how the LFC namespace and the SRM namespace should be related to one another.
Reading a file using local protocolscopying a file out of dCache using dcap: | ||||||||
Changed: | ||||||||
< < | dccp dcap://heplnx209.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file | |||||||
> > | dccp dcap://heplnx203.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file | |||||||
Or, if pnfs is locally mounted:
dccp /pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file
Access a file directly from dCache using root: | ||||||||
Changed: | ||||||||
< < | root dcap://heplnx209.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file | |||||||
> > | root dcap://heplnx203.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file | |||||||
Deleting a file from dCacheIf the file is not registered in the LFC:lcg-del -l srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file
If it is registered in the LFC remove the "-l" option:
lcg-del srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file
-- ChrisBrew / RobHarper - 2010-03-12
|
The PPD dCache Storage ElementDCache is the main disk storage system in us on the PPD Unix/Linux systems. It allows us to aggregate the storage space on many servers and present this as a unified namespace to users. Files in dCache can be read using the SRM "grid" protocol or the "local" protocols dcap and xrootd. For writing files only the SRM grid protocolcan be used and requires you to have a valid voms proxy for a supported VO. The dCache namespace can also be browsed like a normal filesystem on the PPD linux nodes but the contents of the files cannot be accessed through this (i.e. ls or find will work cp, open or mv will fail). VOs and/or groups have area to store files under their name dCache namespace in /pnfs/pp.rl.ac.uk/data/Inspecting a file using the pnfs mountSimply use ls as you would with a local file. ls -l /pnfs/pp.rl.ac.uk/data/vo/path/to/fileConverting a local file path in PNFS to a URL to access the fileFor srm addsrm://heplnx204.pp.rl.ac.uk to the path beginning /pnfs
i.e.
srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file
For dcap add dcap://heplnx209.pp.rl.ac.uk to the path beginning /pnfs
i.e.
dcap://heplnx209.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file
Note that the hosts are different heplnx204.pp.rl.ac.uk for srm and heplnx209.pp.rl.ac.uk for dcap
Copying/Reading a file using the Grid toolsTo copy a file into dCache without registering it in a Logical File Catalogue l cg-cp -v file:/path/to/local/file srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/put/file To copy a file into dCache and register it with a Logical File Catalogue use thelcg-cr command instea, VOs that use the LFC may have some rules about how the LFC namespace and the SRM namespace should be related to one another.
Reading a file using local protocolscopying a file out of dCache using dcap:dccp dcap://heplnx209.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file | ||||||||
Added: | ||||||||
> > |
Or, if pnfs is locally mounted:
dccp /pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file | |||||||
Access a file directly from dCache using root:
root dcap://heplnx209.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file
Deleting a file from dCacheIf the file is not registered in the LFC:lcg-del -l srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file
If it is registered in the LFC remove the "-l" option:
lcg-del srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file
-- ChrisBrew / RobHarper - 2010-03-12
|
The PPD dCache Storage Element | ||||||||
Changed: | ||||||||
< < | DCache is the main disk storage system in us on the PPD Unix/Linux systems. It allows us to aggregate the storage space on many servers and present this as a unified namespace to users. Files in dCache can be accessed/written using the SRM "grid" protocol or the "local" protocols dcap and xrootd. The dCache namespace can also be browsed like a normal filesystem on the PPD linux nodes but the contents of the files cannot be accessed through this (i.e. ls or find will work cp, open or mv will fail). | |||||||
> > | DCache is the main disk storage system in us on the PPD Unix/Linux systems. It allows us to aggregate the storage space on many servers and present this as a unified namespace to users. | |||||||
Added: | ||||||||
> > | Files in dCache can be read using the SRM "grid" protocol or the "local" protocols dcap and xrootd. For writing files only the SRM grid protocolcan be used and requires you to have a valid voms proxy for a supported VO. The dCache namespace can also be browsed like a normal filesystem on the PPD linux nodes but the contents of the files cannot be accessed through this (i.e. ls or find will work cp, open or mv will fail). | |||||||
VOs and/or groups have area to store files under their name dCache namespace in /pnfs/pp.rl.ac.uk/data/
Inspecting a file using the pnfs mount | ||||||||
Added: | ||||||||
> > | Simply use ls as you would with a local file.
ls -l /pnfs/pp.rl.ac.uk/data/vo/path/to/file
Converting a local file path in PNFS to a URL to access the fileFor srm addsrm://heplnx204.pp.rl.ac.uk to the path beginning /pnfs
i.e.
srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file
For dcap add dcap://heplnx209.pp.rl.ac.uk to the path beginning /pnfs
i.e.
dcap://heplnx209.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file
Note that the hosts are different heplnx204.pp.rl.ac.uk for srm and heplnx209.pp.rl.ac.uk for dcap | |||||||
Copying/Reading a file using the Grid toolsTo copy a file into dCache without registering it in a Logical File Catalogue | ||||||||
Changed: | ||||||||
< < | lcg-cp -v file:/path/to/local/file srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/put/file | |||||||
> > | l cg-cp -v file:/path/to/local/file srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/put/file | |||||||
Changed: | ||||||||
< < | To copy a file into dCache and register it with a Logical File Catalogue | |||||||
> > | To copy a file into dCache and register it with a Logical File Catalogue use the lcg-cr command instea, VOs that use the LFC may have some rules about how the LFC namespace and the SRM namespace should be related to one another. | |||||||
Deleted: | ||||||||
< < | ... | |||||||
Reading a file using local protocolscopying a file out of dCache using dcap: | ||||||||
Changed: | ||||||||
< < | dccp dcap://heplnx209.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file | |||||||
> > | dccp dcap://heplnx209.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file | |||||||
Access a file directly from dCache using root: | ||||||||
Changed: | ||||||||
< < | root dcap://heplnx209.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file | |||||||
> > | root dcap://heplnx209.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file | |||||||
Changed: | ||||||||
< < | -- ChrisBrew / RobHarper - 2010-03-02 | |||||||
> > | Deleting a file from dCache | |||||||
Added: | ||||||||
> > |
If the file is not registered in the LFC:
lcg-del -l srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file
If it is registered in the LFC remove the "-l" option:
lcg-del srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/file
-- ChrisBrew / RobHarper - 2010-03-12 | |||||||
|
The PPD dCache Storage ElementDCache is the main disk storage system in us on the PPD Unix/Linux systems. It allows us to aggregate the storage space on many servers and present this as a unified namespace to users. Files in dCache can be accessed/written using the SRM "grid" protocol or the "local" protocols dcap and xrootd. The dCache namespace can also be browsed like a normal filesystem on the PPD linux nodes but the contents of the files cannot be accessed through this (i.e. ls or find will work cp, open or mv will fail). VOs and/or groups have area to store files under their name dCache namespace in /pnfs/pp.rl.ac.uk/data/Inspecting a file using the pnfs mountCopying/Reading a file using the Grid toolsTo copy a file into dCache without registering it in a Logical File Catalogue lcg-cp -v file:/path/to/local/file srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/put/file To copy a file into dCache and register it with a Logical File Catalogue ...Reading a file using local protocolscopying a file out of dCache using dcap: | ||||||||
Changed: | ||||||||
< < | dccp dcap://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file | |||||||
> > | dccp dcap://heplnx209.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file | |||||||
Access a file directly from dCache using root: | ||||||||
Changed: | ||||||||
< < | root dcap://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file | |||||||
> > | root dcap://heplnx209.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file | |||||||
Changed: | ||||||||
< < | -- ChrisBrew - 2009-10-28 | |||||||
> > | -- ChrisBrew / RobHarper - 2010-03-02 | |||||||
|
The PPD dCache Storage ElementDCache is the main disk storage system in us on the PPD Unix/Linux systems. It allows us to aggregate the storage space on many servers and present this as a unified namespace to users. Files in dCache can be accessed/written using the SRM "grid" protocol or the "local" protocols dcap and xrootd. The dCache namespace can also be browsed like a normal filesystem on the PPD linux nodes but the contents of the files cannot be accessed through this (i.e. ls or find will work cp, open or mv will fail). VOs and/or groups have area to store files under their name dCache namespace in /pnfs/pp.rl.ac.uk/data/Inspecting a file using the pnfs mountCopying/Reading a file using the Grid tools | ||||||||
Changed: | ||||||||
< < | Copying/Reading a file using local protocols | |||||||
> > | To copy a file into dCache without registering it in a Logical File Catalogue | |||||||
Added: | ||||||||
> > |
lcg-cp -v file:/path/to/local/file srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/put/file
To copy a file into dCache and register it with a Logical File Catalogue
...
Reading a file using local protocolscopying a file out of dCache using dcap: dccp dcap://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file ./file Access a file directly from dCache using root: root dcap://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/vo/path/to/your/file | |||||||
-- ChrisBrew - 2009-10-28
|
The PPD dCache Storage ElementDCache is the main disk storage system in us on the PPD Unix/Linux systems. It allows us to aggregate the storage space on many servers and present this as a unified namespace to users. Files in dCache can be accessed/written using the SRM "grid" protocol or the "local" protocols dcap and xrootd. The dCache namespace can also be browsed like a normal filesystem on the PPD linux nodes but the contents of the files cannot be accessed through this (i.e. ls or find will work cp, open or mv will fail). | ||||||||
Changed: | ||||||||
< < | VOs and/or groups have area to store files under the name dCache namespace in /pnfs/pp.rl.ac.uk/data/ | |||||||
> > | VOs and/or groups have area to store files under their name dCache namespace in /pnfs/pp.rl.ac.uk/data/ | |||||||
Inspecting a file using the pnfs mountCopying/Reading a file using the Grid toolsCopying/Reading a file using local protocols-- ChrisBrew - 2009-10-28
|
| ||||||||
Added: | ||||||||
> > | The PPD dCache Storage Element | |||||||
DCache is the main disk storage system in us on the PPD Unix/Linux systems. It allows us to aggregate the storage space on many servers and present this as a unified namespace to users. Files in dCache can be accessed/written using the SRM "grid" protocol or the "local" protocols dcap and xrootd. The dCache namespace can also be browsed like a normal filesystem on the PPD linux nodes but the contents of the files cannot be accessed through this (i.e. ls or find will work cp, open or mv will fail). VOs and/or groups have area to store files under the name dCache namespace in /pnfs/pp.rl.ac.uk/data/ | ||||||||
Changed: | ||||||||
< < | +---Inspecting a file using the pnfs mount | |||||||
> > | Inspecting a file using the pnfs mount | |||||||
Changed: | ||||||||
< < | +---Copying/Reading a file using the Grid tools | |||||||
> > | Copying/Reading a file using the Grid tools | |||||||
Changed: | ||||||||
< < | +---Copying/Reading a file using local protocols | |||||||
> > | Copying/Reading a file using local protocols | |||||||
Deleted: | ||||||||
< < | ||||||||
-- ChrisBrew - 2009-10-28
|
|