Notes on runnning PhEDEx for SouthGrid Sites

Main CMS PhEDEx TWiki Pages

  • SouthGrid PhEDEx Agents run on heplnv144.pp.rl.ac.uk
  • Log in from RALPPD Linux with:
  • Installation is in /opt/ppd/cms/phedex
    • Agent configuration is in _ under that directory
  • Stop all agents for a site:
    • From /opt/ppd/cms/phedex
    • ./stop_phedex _
  • Start all agents for a site:
    • From /opt/ppd/cms/phedex
    • ./start_phedex _
  • Start/Stop a single agent
    • /opt/ppd/cms/phedex/PHEDEX/Utilities/Master -config /opt/ppd/cms/phedex/_/Config

Proxy Management

  • On a RALPP Linux UI:
    • Upload long lived proxy to RAL MyProxy
      • myproxy-init -n -d -c 672
    • Get cmsphedex role Proxy
      • voms-proxy-init --voms cms:/cms/Role=cmsphedex
  • Login on the PhEDEx box

PhEDEx Checks

Daily Checks

Occasional Checks

Block Download Verify

  • Log onto the PhEDEx box
  • cd /opt/ppd/cms/phedex
  • . PHEDEX/etc/profile.d/init.sh
  • PHEDEX/Utilities/BlockDownloadVerify-injector.pl --node T2_UK_SGrid_RALPP --block '%' --dbconfig /opt/ppd/cms/phedex/Prod_T2_UK_SGrid_RALPP/Prod/T2UKSGRIDRALPP --test size
  • PHEDEX/Utilities/BlockDownloadVerify-report.pl --db /opt/ppd/cms/phedex/Prod_T2_UK_SGrid_RALPP/DBParam:Prod/T2UKSGRIDRALPP --node T2_UK_SGrid_RALPP --detail --days 7 > Prod_T2_UK_SGrid_RALPP/ConsistencyCheck/DownloadVerify-$(date +%Y-%m-%d)-report.txt
  • grep Fail Prod_T2_UK_SGrid_RALPP/ConsistencyCheck/DownloadVerify-$(date +%Y-%m-%d)-report.txt | grep LFN= | cut -d ' ' -f 3 | sort

Storage Consistency Check

  • cd /pnfs/pp.rl.ac.uk/data/cms/store/
  • find mc data generator results hidata himc lumi relval -type f -mtime +30 -print > /opt/ppd/cms/phedex/Prod_T2_UK_SGrid_RALPP/ConsistencyCheck/file_list-$(date +%Y-%m-%d).txt
  • cd /opt/ppd/cms/phedex
  • sed -i -e 's|^\(.*\)|/store/\1|' Prod_T2_UK_SGrid_RALPP/ConsistencyCheck/file_list-$(date +%Y-%m-%d).txt
  • PHEDEX/Utilities/StorageConsistencyCheck --db /opt/ppd/cms/phedex/Prod_T2_UK_SGrid_RALPP/DBParam:Prod/T2UKSGRIDRALPP -se_name heplnx204.pp.rl.ac.uk -lfnlist Prod_T2_UK_SGrid_RALPP/ConsistencyCheck/file_list-$(date +%Y-%m-%d).txt | tee Prod_T2_UK_SGrid_RALPP/ConsistencyCheck/StorageConsistencyCheck-$(date +%Y-%m-%d).out

Other Checks

-- ChrisBrew - 2010-10-27

Edit | Attach | Watch | Print version | History: r18 < r17 < r16 < r15 < r14 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r15 - 2014-02-25 - ChrisBrew
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback