Difference: SouthGridPhEDExNotes (16 vs. 17)

Revision 172017-03-27 - ChrisBrew

 
META TOPICPARENT name="Documentation"

Notes on runnning PhEDEx for SouthGrid Sites

Main CMS PhEDEx TWiki Pages

Changed:
<
<
    • Agent configuration is in _ under that directory
>
>
    • Agent configuration is in <PhEDExInstance>_<SiteName> under that directory
 
  • Stop all agents for a site:
    • From /opt/ppd/cms/phedex
Changed:
<
<
    • ./stop_phedex _
>
>
    • ./stop_phedex <PhEDExInstance>_<SiteName>
 
  • Start all agents for a site:
    • From /opt/ppd/cms/phedex
Changed:
<
<
    • ./start_phedex _
>
>
    • ./start_phedex <PhEDExInstance>_<SiteName>
 
  • Start/Stop a single agent
Changed:
<
<
    • /opt/ppd/cms/phedex/PHEDEX/Utilities/Master -config /opt/ppd/cms/phedex/_/Config
>
>
    • /opt/ppd/cms/phedex/PHEDEX/Utilities/Master -config /opt/ppd/cms/phedex/<PhEDExInstance>_<SiteName>/Config <AgentName>
 

Proxy Management

  • On a RALPP Linux UI:
    • Upload long lived proxy to RAL MyProxy
      • myproxy-init -n -d -c 672
    • Get cmsphedex role Proxy
      • voms-proxy-init --voms cms:/cms/Role=cmsphedex
  • Login on the PhEDEx box

PhEDEx Checks

Daily Checks

Occasional Checks

Block Download Verify

  • Log onto the PhEDEx box
  • cd /opt/ppd/cms/phedex
  • . PHEDEX/etc/profile.d/init.sh
  • PHEDEX/Utilities/BlockDownloadVerify-injector.pl --node T2_UK_SGrid_RALPP --block '%' --dbconfig /opt/ppd/cms/phedex/Prod_T2_UK_SGrid_RALPP/Prod/T2UKSGRIDRALPP --test size
  • PHEDEX/Utilities/BlockDownloadVerify-report.pl --db /opt/ppd/cms/phedex/Prod_T2_UK_SGrid_RALPP/DBParam:Prod/T2UKSGRIDRALPP --node T2_UK_SGrid_RALPP --detail --days 7 > Prod_T2_UK_SGrid_RALPP/ConsistencyCheck/DownloadVerify-$(date +%Y-%m-%d)-report.txt
  • grep Fail Prod_T2_UK_SGrid_RALPP/ConsistencyCheck/DownloadVerify-$(date +%Y-%m-%d)-report.txt | grep LFN= | cut -d ' ' -f 3 | sort

Storage Consistency Check

  • cd /pnfs/pp.rl.ac.uk/data/cms/store/
  • find mc data generator results hidata himc lumi relval -type f -mtime +30 -print > /opt/ppd/cms/phedex/Prod_T2_UK_SGrid_RALPP/ConsistencyCheck/file_list-$(date +%Y-%m-%d).txt
  • cd /opt/ppd/cms/phedex
  • . PHEDEX/etc/profile.d/init.sh
  • sed -i -e 's|^\(.*\)|/store/\1|' Prod_T2_UK_SGrid_RALPP/ConsistencyCheck/file_list-$(date +%Y-%m-%d).txt
  • PHEDEX/Utilities/StorageConsistencyCheck --db /opt/ppd/cms/phedex/Prod_T2_UK_SGrid_RALPP/DBParam:Prod/T2UKSGRIDRALPP -se_name heplnx204.pp.rl.ac.uk -lfnlist Prod_T2_UK_SGrid_RALPP/ConsistencyCheck/file_list-$(date +%Y-%m-%d).txt | tee Prod_T2_UK_SGrid_RALPP/ConsistencyCheck/StorageConsistencyCheck-$(date +%Y-%m-%d).out

Other Checks

-- ChrisBrew - 2010-10-27

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback