Message boards :
CMS Application :
WMAgent Jobs
Message board moderation
Author | Message |
---|---|
Send message Joined: 20 Jun 14 Posts: 372 Credit: 238,712 RAC: 0 |
New CMS tasks will from now on receive jobs from the WMAgent rather than CRAB. This means that a different system is being used to inject the jobs. It is a big step towards integration with CMS computing operations. |
Send message Joined: 14 Jan 10 Posts: 1268 Credit: 8,421,616 RAC: 2,139 |
How many events did Ivan put in 1 wmagent job? |
Send message Joined: 29 Aug 05 Posts: 997 Credit: 6,264,307 RAC: 71 |
How many events did Ivan put in 1 wmagent job? There are 4,000 events in these jobs, and the output files are larger than the CRAB3 jobs, so watch your bandwidth usage. I haven't had a chance to tune these jobs yet, things are moving pretty fast on the ground. I want to find another useful workflow, these are an older script I was given to try to get WMAgent working. Now it is, we are moving closer to full CMS production. |
Send message Joined: 14 Jan 10 Posts: 1268 Credit: 8,421,616 RAC: 2,139 |
There are 4,000 events in these jobs, ... Thanks Ivan! I got the answer myself meanwhile. First job ended with: Begin processing the 4000th record. Run 1, Event 18612000, LumiSection 74448 at 12-Jan-2017 16:32:20.772 CET . . . MemoryReport> Peak virtual size 938.547 Mbytes Key events increasing vsize: [13] run: 1 lumi: 74433 event: 18608013 vsize = 816.039 deltaVsize = 0.25 rss = 552.418 delta = 0.117188 [5] run: 1 lumi: 74433 event: 18608005 vsize = 815.789 deltaVsize = 1.25 rss = 552.301 delta = 1.28125 [74] run: 1 lumi: 74433 event: 18608074 vsize = 848.438 deltaVsize = 31.8984 rss = 584.578 delta = 32.2773 [282] run: 1 lumi: 74434 event: 18608282 vsize = 903.254 deltaVsize = 29.3164 rss = 641.176 delta = 56.5977 [251] run: 1 lumi: 74434 event: 18608251 vsize = 865.938 deltaVsize = 8.25 rss = 603.043 delta = 18.4648 [3919] run: 1 lumi: 74448 event: 18611919 vsize = 937.797 deltaVsize = -0.75 rss = 641.961 delta = -2.55078 [3883] run: 1 lumi: 74448 event: 18611883 vsize = 938.297 deltaVsize = -0.25 rss = 642.379 delta = -2.13281 [3827] run: 1 lumi: 74448 event: 18611827 vsize = 938.547 deltaVsize = 1.25 rss = 644.512 delta = -2.92188 TimeReport> Time report complete in 13849 seconds Time Summary: - Min event: 0.00384307 - Max event: 1045.72 - Avg event: 3.46225 - Total job: 13849 CPU Summary: - Min event: 0 - Max event: 650.53 - Avg event: 3.11171 - Total job: 12604 - Total event: 12446.8 |
Send message Joined: 29 Aug 05 Posts: 997 Credit: 6,264,307 RAC: 71 |
|
Send message Joined: 29 Aug 05 Posts: 997 Credit: 6,264,307 RAC: 71 |
Yes, I haven't massaged the output of these jobs yet, because I haven't worked out exactly where their config file is! I've now found that the config files live on a CouchDB database instance and are referred to by a random-looking hexadecimal string as a key. Still trying to find out how to access it and whether it's possible to modify it... |
©2024 CERN