Difference: DataStorage (2 vs. 3)

Revision 32010-04-27 - AlastairDewhurst

 
META TOPICPARENT name="WebHome"

Data Storage

Changed:
<
<
This page describes where to store your data in order to run over it.
>
>
This page describes where to store your data in order to run over it. In general all data files should be stored on dCache. A small amount of data can be stored on the local cluster for development purposes. afs space can be used to put output files/code that you may wish to share with others.
 
Changed:
<
<

Locally

For small to medium amounts of data it is recommended that you store it in either:
>
>

On the local cluster

For small to medium amounts of data it is recommended that you store it in either:
Deleted:
<
<
 /opt/ppd/scratch /opt/ppd/month
Added:
>
>
Each has a capacity of 1.6 TB.

On AFS

There is an /afs cell at RAL which you can find at:
/afs/rl.ac.uk/
 
Deleted:
<
<
Each has a capacity of 1.6 TB.
 
Added:
>
>

On the dCache storage element locally

Detail instructions on using the dCache element can be found on the DCacheStorageElement page.
 
Changed:
<
<

On the Grid (at RAL)

>
>

On the dCache storage element on the grid

  The advantage of storing data on the grid is that there is alot more avaliable storage space. By Storing data on the grid at RAL local users will be able to run over the data interactively for developing software as well as looking at smaller samples as well as running over the same data as a grid job. The dis-advantage is that you don't have full control over your data and some things can take time.
Changed:
<
<
If you wish to copy either ATLAS data that is already on the grid to RAL you can download a small amount using DQ2-get. If you want to run over a larger sample you can request data replication via [[http://panda.cern.ch:25980/server/pandamon/query?mode=ddm_req][Data Replication]
>
>
If you wish to copy either ATLAS data that is already on the grid to RAL you can download a small amount using DQ2-get. If you want to run over a larger sample you can request data replication via [[http://panda.cern.ch:25980/server/pandamon/query?mode=ddm_req][Data Replication]
 
dq2-put -L SITENAME -s SOURCEDIRECTORY DATASETNAME
Changed:
<
<
>
>
The SITENAME is: UKI-SOUTHGRID-RALPP_SCRATCHDISK The DATASETNAME needs to follow the Dataset naming rules.
Deleted:
<
<
The SITENAME is: UKI-SOUTHGRID-RALPP_SCRATCHDISK The DATASETNAME needs to follow the Dataset naming rules.
 
Changed:
<
<
>
>
-- AlastairDewhurst - 2010-01-29</verbatim>
Deleted:
<
<

-- AlastairDewhurst - 2010-01-29

 
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback