[GE users] high CPU load for sge_qmaster

Sean Dilda agrajag at dragaera.net
Mon May 2 14:47:20 BST 2005


Stephan Grell - Sun Germany - SSG - Software Engineer wrote:
> Hi,
> this could mean two things:
> 
> - somehow the wait for a message to process does not work and the MT
> thread goes wild
> 
> - you have incomming messages.
> 
> You can check for incomming messages via qping -dump
> 
> Could you please post that output. The jumping EDT time sugests,that
> there are at least some messages going forth and back.
> 
> You can also test, if the bahavior changes, when you are shuting down
> the execds.

Using Christian's suggestions for how to use qping -dump.  There are 
definitely messages going through.  I've attached two dumps.  The first 
one is 'normal', the other one is while shutting down the execd for 
core-n60.  My cluster is heavily loaded right now, so I only have a few 
execds that I can take down right now.

I also have another dump I can send you.  I ran it for 5 minutes and it 
contains just over 3,000 lines.


    [ Part 2: "Attached Text" ]

h:13
h:12
open connection to "head4/qmaster/1" ... no error happened
           time|local          |d.|remote                   |format|ack type|               msg tag|msg id|msg rid|msg len|       msg time|
---------------|---------------|--|-------------------------|------|--------|----------------------|------|-------|-------|---------------|
09:41:52.479253|head4/qmaster/1|->|head4/debug_client/23927 |   crm|     nak|                     0|     0|      0|    218|09:41:52.479253|
09:41:52.479999|head4/qmaster/1|<-|bio-n094/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5027|      0|   2146|09:41:52.479999|
09:41:52.502021|head4/qmaster/1|<-|cod-n035/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5026|      0|   1993|09:41:52.502021|
09:41:52.523750|head4/qmaster/1|<-|bio-n078/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5023|      0|   2412|09:41:52.523750|
09:41:52.561002|head4/qmaster/1|<-|stat-n06/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5058|      0|   2146|09:41:52.561002|
09:41:52.606856|head4/qmaster/1|<-|bio-n025/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5026|      0|   2260|09:41:52.606856|
09:41:52.640461|head4/qmaster/1|<-|core-n35/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5035|      0|   1892|09:41:52.640461|
09:41:53.269252|head4/qmaster/1|<-|cod-n011/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5026|      0|   1993|09:41:53.269252|
09:41:53.284838|head4/qmaster/1|<-|bio-n082/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5027|      0|   2145|09:41:53.284838|
09:41:53.338851|head4/qmaster/1|<-|bio-n066/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5032|      0|   2251|09:41:53.338851|
09:41:53.355783|head4/qmaster/1|<-|cbcb-n30/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5030|      0|   2146|09:41:53.355783|
09:41:53.458714|head4/qmaster/1|<-|bio-n098/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5023|      0|   2514|09:41:53.458714|
09:41:53.586266|head4/qmaster/1|<-|bio-n003/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5069|      0|   2145|09:41:53.586266|
09:41:54.068528|head4/qmaster/1|<-|cbcb-n09/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5032|      0|   2251|09:41:54.068528|
09:41:54.074935|head4/qmaster/1|<-|stat-n32/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5022|      0|   2251|09:41:54.074935|
09:41:54.098854|head4/qmaster/1|<-|bio-n064/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5022|      0|   2412|09:41:54.098854|
09:41:54.289125|head4/qmaster/1|<-|nsoe-n07/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5032|      0|   2146|09:41:54.289125|
09:41:54.373374|head4/qmaster/1|<-|bio-n033/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5023|      0|   2513|09:41:54.373374|
09:41:54.632977|head4/qmaster/1|<-|stat-n26/execd/1         |   sim|     nak|                     0|  2595|      0|     25|09:41:54.632977|
09:41:54.636304|head4/qmaster/1|->|stat-n26/execd/1         |  sirm|     nak|                     0|   775|      0|    317|09:41:54.636304|
09:41:54.660794|head4/qmaster/1|<-|bio-n065/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5025|      0|   2260|09:41:54.660794|
09:41:54.670195|head4/qmaster/1|<-|stat-n26/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  2596|      0|   2146|09:41:54.670195|
09:41:54.698563|head4/qmaster/1|<-|stat-n39/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5025|      0|   2146|09:41:54.698563|
09:41:54.870923|head4/qmaster/1|<-|nsoe-n05/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5030|      0|   2146|09:41:54.870923|
09:41:54.982561|head4/qmaster/1|<-|bio-n023/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5029|      0|   2262|09:41:54.982561|
09:41:55.155143|head4/qmaster/1|<-|cod-n023/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5026|      0|   1993|09:41:55.155143|
09:41:55.203763|head4/qmaster/1|<-|cod-n019/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5026|      0|   1986|09:41:55.203763|
09:41:55.726462|head4/qmaster/1|<-|nsoe-n04/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5022|      0|   2251|09:41:55.726462|
09:41:55.962063|head4/qmaster/1|<-|cod-n017/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5026|      0|   1993|09:41:55.962063|
09:41:56.015373|head4/qmaster/1|<-|bio-n011/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5029|      0|   2146|09:41:56.015373|
09:41:56.030526|head4/qmaster/1|<-|chg-n05/execd/1          |   bin|     nak|    TAG_REPORT_REQUEST|  5033|      0|   2116|09:41:56.030526|
09:41:56.038971|head4/qmaster/1|<-|nsoe-n01/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5031|      0|   2145|09:41:56.038971|
09:41:56.114182|head4/qmaster/1|<-|bio-n045/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5028|      0|   2146|09:41:56.114182|
09:41:56.185440|head4/qmaster/1|<-|stat-n09/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5027|      0|   2146|09:41:56.185440|
09:41:56.370463|head4/qmaster/1|<-|cbcb-n13/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5043|      0|   1891|09:41:56.370463|
09:41:56.395675|head4/qmaster/1|<-|stat-n34/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5034|      0|   2262|09:41:56.395675|
09:41:56.666170|head4/qmaster/1|<-|compeb-n16/execd/1       |   bin|     nak|    TAG_REPORT_REQUEST|  5023|      0|   1690|09:41:56.666170|
09:41:56.821440|head4/qmaster/1|<-|stat-n35/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5030|      0|   2235|09:41:56.821440|
09:41:56.963988|head4/qmaster/1|<-|opt-n06/execd/1          |   bin|     nak|    TAG_REPORT_REQUEST|  5022|      0|   1616|09:41:56.963988|
09:41:56.966254|head4/qmaster/1|<-|cod-n001/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5026|      0|   1993|09:41:56.966254|
09:41:57.011922|head4/qmaster/1|<-|core-n49/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5034|      0|   2142|09:41:57.011922|
09:41:57.020603|head4/qmaster/1|<-|core-n42/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  2610|      0|   2142|09:41:57.020603|
09:41:57.064719|head4/qmaster/1|<-|core-n32/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5059|      0|   1638|09:41:57.064719|
09:41:57.122430|head4/qmaster/1|<-|core-n47/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5035|      0|   2142|09:41:57.122430|
09:41:57.296480|head4/qmaster/1|<-|bio-n044/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5029|      0|   2260|09:41:57.296480|
09:41:57.474422|head4/qmaster/1|<-|stat-n12/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5028|      0|   2146|09:41:57.474422|
09:41:57.641336|head4/qmaster/1|<-|cod-n010/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5025|      0|   1986|09:41:57.641336|
09:41:57.708824|head4/qmaster/1|<-|core-n37/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5032|      0|   2142|09:41:57.708824|
09:41:57.785347|head4/qmaster/1|<-|opt-n04/execd/1          |   bin|     nak|    TAG_REPORT_REQUEST|  5021|      0|   1616|09:41:57.785347|
09:41:57.788215|head4/qmaster/1|<-|opt-n03/execd/1          |   bin|     nak|    TAG_REPORT_REQUEST|  5021|      0|   1616|09:41:57.788215|
09:41:57.790845|head4/qmaster/1|<-|cod-n012/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5023|      0|   1887|09:41:57.790845|
09:41:57.803912|head4/qmaster/1|<-|stat-n07/execd/1         |   sim|     nak|                     0|  2621|      0|     25|09:41:57.803912|
09:41:57.807096|head4/qmaster/1|->|stat-n07/execd/1         |  sirm|     nak|                     0|   784|      0|    317|09:41:57.807096|
09:41:57.843323|head4/qmaster/1|<-|stat-n07/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  2622|      0|   2236|09:41:57.843323|
09:41:58.008309|head4/qmaster/1|<-|bio-n031/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5022|      0|   2412|09:41:58.008309|
09:41:58.053215|head4/qmaster/1|<-|stat-n30/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5024|      0|   2341|09:41:58.053215|
09:41:58.140218|head4/qmaster/1|<-|bio-n058/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5026|      0|   2146|09:41:58.140218|
09:41:58.253337|head4/qmaster/1|<-|bio-n083/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5023|      0|   2503|09:41:58.253337|
09:41:58.294625|head4/qmaster/1|<-|core-n23/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5037|      0|   1892|09:41:58.294625|
09:41:58.354641|head4/qmaster/1|<-|bio-n019/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5026|      0|   2517|09:41:58.354641|
09:41:58.357156|head4/qmaster/1|<-|cbcb-n11/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5031|      0|   2146|09:41:58.357156|
09:41:58.374893|head4/qmaster/1|<-|cod-n036/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5027|      0|   1986|09:41:58.374893|
09:41:58.411101|head4/qmaster/1|<-|cod-n038/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5025|      0|   1888|09:41:58.411101|
09:41:58.457485|head4/qmaster/1|<-|cod-n007/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5027|      0|   1993|09:41:58.457485|
09:41:58.570473|head4/qmaster/1|<-|bio-n062/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5023|      0|   2412|09:41:58.570473|
09:41:58.625341|head4/qmaster/1|<-|bio-n087/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5024|      0|   2401|09:41:58.625341|
09:41:58.695922|head4/qmaster/1|<-|cbcb-n29/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5034|      0|   2251|09:41:58.695922|
09:41:58.812614|head4/qmaster/1|<-|bio-n016/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5024|      0|   2150|09:41:58.812614|
09:41:58.823227|head4/qmaster/1|<-|bio-n004/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5027|      0|   2618|09:41:58.823227|
09:41:58.870750|head4/qmaster/1|<-|core-n33/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5054|      0|   1890|09:41:58.870750|
09:41:58.942902|head4/qmaster/1|<-|core-n22/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5036|      0|   2142|09:41:58.942902|
09:41:58.980672|head4/qmaster/1|<-|bio-n049/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5031|      0|   2153|09:41:58.980672|
09:41:59.258934|head4/qmaster/1|<-|bio-n038/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5033|      0|   1638|09:41:59.258934|
09:41:59.332065|head4/qmaster/1|<-|cbcb-n21/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5041|      0|   1891|09:41:59.332065|
09:41:59.375877|head4/qmaster/1|<-|cbcb-n17/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  2616|      0|   2146|09:41:59.375877|
09:41:59.378482|head4/qmaster/1|<-|core-n36/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5057|      0|   2141|09:41:59.378482|
09:41:59.385716|head4/qmaster/1|<-|bio-n077/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5023|      0|   2514|09:41:59.385716|
09:41:59.722282|head4/qmaster/1|<-|core-n50/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5035|      0|   2142|09:41:59.722282|
09:41:59.851409|head4/qmaster/1|<-|bio-n059/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5022|      0|   1638|09:41:59.851409|
09:41:59.951866|head4/qmaster/1|<-|cod-n033/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5026|      0|   1986|09:41:59.951866|
09:41:59.987133|head4/qmaster/1|<-|bio-n099/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5029|      0|   2146|09:41:59.987133|
09:41:59.991661|head4/qmaster/1|<-|core-n59/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5036|      0|   2142|09:41:59.991661|
09:42:00.167230|head4/qmaster/1|<-|bio-n024/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5023|      0|   2412|09:42:00.167230|
09:42:00.177207|head4/qmaster/1|<-|core-n48/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5068|      0|   1892|09:42:00.177207|
09:42:00.187120|head4/qmaster/1|<-|cod-n039/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5024|      0|   1887|09:42:00.187120|
09:42:00.385464|head4/qmaster/1|<-|bio-n080/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5025|      0|   2159|09:42:00.385464|
09:42:00.581721|head4/qmaster/1|<-|core-n46/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5037|      0|   1890|09:42:00.581721|
09:42:00.669753|head4/qmaster/1|<-|bio-n055/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5027|      0|   2260|09:42:00.669753|
09:42:00.694773|head4/qmaster/1|<-|bio-n070/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5029|      0|   2618|09:42:00.694773|
09:42:00.864477|head4/qmaster/1|<-|core-n29/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5034|      0|   2142|09:42:00.864477|
09:42:01.196441|head4/qmaster/1|<-|core-n52/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5341|      0|   1892|09:42:01.196441|
09:42:01.767714|head4/qmaster/1|<-|stat-n31/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5027|      0|   2146|09:42:01.767714|


    [ Part 3: "Attached Text" ]

h:13
h:12
open connection to "head4/qmaster/1" ... no error happened
           time|local          |d.|remote                   |format|ack type|               msg tag|msg id|msg rid|msg len|       msg time|
---------------|---------------|--|-------------------------|------|--------|----------------------|------|-------|-------|---------------|
09:42:18.740866|head4/qmaster/1|->|head4/debug_client/23928 |   crm|     nak|                     0|     0|      0|    218|09:42:18.740866|
09:42:18.843890|head4/qmaster/1|<-|cbcb-n07/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5037|      0|   1891|09:42:18.843890|
09:42:18.853930|head4/qmaster/1|<-|cbcb-n15/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5037|      0|   2146|09:42:18.853930|
09:42:19.514624|head4/qmaster/1|<-|core-n21/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5036|      0|   2146|09:42:19.514624|
09:42:19.871255|head4/qmaster/1|<-|compeb-n17/execd/1       |   bin|     nak|    TAG_REPORT_REQUEST|  5031|      0|   2206|09:42:19.871255|
09:42:20.024108|head4/qmaster/1|<-|core-n60/qconf/0         |    cm|     nak|                     0|     0|      0|    226|09:42:20.024108|
09:42:20.026240|head4/qmaster/1|->|core-n60/qconf/23929     |   crm|     nak|                     0|     0|      0|    210|09:42:20.026240|
09:42:20.057210|head4/qmaster/1|<-|core-n60/qconf/23929     |   bin|     ack|      TAG_SEC_ANNOUNCE|     1|      0|   1092|09:42:20.057210|
09:42:20.059123|head4/qmaster/1|->|core-n60/qconf/23929     |    am|     nak|                     0|     1|      0|     35|09:42:20.059123|
09:42:20.059693|head4/qmaster/1|<-|core-n60/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|     8|      0|   1638|09:42:20.059693|
09:42:20.067031|head4/qmaster/1|->|core-n60/qconf/23929     |   bin|     nak|       TAG_SEC_RESPOND|     2|      1|   1380|09:42:20.067031|
09:42:20.102771|head4/qmaster/1|<-|core-n60/qconf/23929     |   bin|     ack|       TAG_GDI_REQUEST|     2|      0|    140|09:42:20.102771|
09:42:20.105418|head4/qmaster/1|->|core-n60/qconf/23929     |    am|     nak|                     0|     3|      0|     35|09:42:20.105418|
09:42:20.106454|head4/qmaster/1|->|core-n60/qconf/23929     |   bin|     nak|       TAG_GDI_REQUEST|     4|      2|    143|09:42:20.106454|
09:42:20.145900|head4/qmaster/1|<-|core-n60/qconf/23929     |   ccm|     nak|                     0|     3|      0|     25|09:42:20.145900|
09:42:20.148238|head4/qmaster/1|->|core-n60/qconf/23929     |  ccrm|     nak|                     0|     5|      0|     27|09:42:20.148238|
09:42:20.197725|head4/qmaster/1|<-|core-n60/qconf/0         |    cm|     nak|                     0|     0|      0|    226|09:42:20.197725|
09:42:20.199764|head4/qmaster/1|->|core-n60/qconf/23930     |   crm|     nak|                     0|     0|      0|    210|09:42:20.199764|
09:42:20.237237|head4/qmaster/1|<-|core-n60/qconf/23930     |   bin|     ack|      TAG_SEC_ANNOUNCE|     1|      0|   1092|09:42:20.237237|
09:42:20.239073|head4/qmaster/1|->|core-n60/qconf/23930     |    am|     nak|                     0|     1|      0|     35|09:42:20.239073|
09:42:20.246160|head4/qmaster/1|->|core-n60/qconf/23930     |   bin|     nak|       TAG_SEC_RESPOND|     2|      1|   1380|09:42:20.246160|
09:42:20.274683|head4/qmaster/1|<-|bio-n030/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5047|      0|   2145|09:42:20.274683|
09:42:20.282255|head4/qmaster/1|<-|core-n60/qconf/23930     |   bin|     ack|       TAG_GDI_REQUEST|     2|      0|    138|09:42:20.282255|
09:42:20.283981|head4/qmaster/1|->|core-n60/qconf/23930     |    am|     nak|                     0|     3|      0|     35|09:42:20.283981|
09:42:20.285609|head4/qmaster/1|->|core-n60/qconf/23930     |   bin|     nak|       TAG_GDI_REQUEST|     4|      2|   2212|09:42:20.285609|
09:42:20.321426|head4/qmaster/1|<-|bio-n012/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5037|      0|   2146|09:42:20.321426|
09:42:20.326309|head4/qmaster/1|<-|core-n60/qconf/23930     |   ccm|     nak|                     0|     3|      0|     25|09:42:20.326309|
09:42:20.328640|head4/qmaster/1|->|core-n60/qconf/23930     |  ccrm|     nak|                     0|     5|      0|     27|09:42:20.328640|
09:42:20.347461|head4/qmaster/1|<-|core-n60/execd/1         |   ccm|     nak|                     0|     9|      0|     25|09:42:20.347461|
09:42:20.351154|head4/qmaster/1|->|core-n60/execd/1         |  ccrm|     nak|                     0|    10|      0|     27|09:42:20.351154|
09:42:20.540460|head4/qmaster/1|<-|stat-n05/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5033|      0|   2146|09:42:20.540460|
09:42:20.785391|head4/qmaster/1|<-|stat-n27/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5035|      0|   2145|09:42:20.785391|
09:42:21.120040|head4/qmaster/1|<-|nsoe-n08/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5035|      0|   2146|09:42:21.120040|
09:42:21.127476|head4/qmaster/1|->|head4/schedd/1           |   bin|     nak|    TAG_REPORT_REQUEST| 12511|      0| 523051|09:42:21.127476|
09:42:21.341999|head4/qmaster/1|<-|bio-n096/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5031|      0|   2146|09:42:21.341999|
09:42:21.380028|head4/qmaster/1|<-|chg-n07/execd/1          |   bin|     nak|    TAG_REPORT_REQUEST|  5033|      0|   2116|09:42:21.380028|
09:42:21.515146|head4/qmaster/1|<-|bio-n017/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5031|      0|   2146|09:42:21.515146|
09:42:21.773975|head4/qmaster/1|<-|stat-n24/execd/1         |   sim|     nak|                     0|  5030|      0|     25|09:42:21.773975|
09:42:21.776527|head4/qmaster/1|->|stat-n24/execd/1         |  sirm|     nak|                     0|  1495|      0|    317|09:42:21.776527|
09:42:21.811338|head4/qmaster/1|<-|stat-n24/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5031|      0|   2146|09:42:21.811338|
09:42:21.883515|head4/qmaster/1|<-|cbcb-n05/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5031|      0|   2146|09:42:21.883515|
09:42:21.905286|head4/qmaster/1|<-|cbcb-n14/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5035|      0|   2145|09:42:21.905286|
09:42:22.207214|head4/qmaster/1|<-|head4/schedd/1           |   bin|     nak|       TAG_ACK_REQUEST|  8201|      0|     56|09:42:22.207214|
09:42:22.262905|head4/qmaster/1|<-|core-n45/execd/1         |   sim|     nak|                     0|  5050|      0|     25|09:42:22.262905|
09:42:22.265752|head4/qmaster/1|->|core-n45/execd/1         |  sirm|     nak|                     0|  1511|      0|    317|09:42:22.265752|
09:42:22.308149|head4/qmaster/1|<-|core-n45/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5051|      0|   1638|09:42:22.308149|
09:42:22.396668|head4/qmaster/1|<-|head4/schedd/1           |   bin|     ack|       TAG_GDI_REQUEST|  8202|      0| 413842|09:42:22.396668|
09:42:22.399695|head4/qmaster/1|->|head4/schedd/1           |    am|     nak|                     0| 12512|      0|     38|09:42:22.399695|
09:42:22.481030|head4/qmaster/1|->|head4/schedd/1           |   bin|     nak|       TAG_GDI_REQUEST| 12513|   8202|  10553|09:42:22.481030|
09:42:22.536245|head4/qmaster/1|<-|cbcb-n01/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5042|      0|   1891|09:42:22.536245|
09:42:22.589339|head4/qmaster/1|<-|bio-n052/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5032|      0|   2146|09:42:22.589339|
09:42:22.731416|head4/qmaster/1|<-|bio-n079/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5032|      0|   2146|09:42:22.731416|
09:42:22.799380|head4/qmaster/1|<-|cbcb-n02/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  2622|      0|   1891|09:42:22.799380|
09:42:23.234118|head4/qmaster/1|<-|stat-n15/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5064|      0|   2146|09:42:23.234118|
09:42:23.346079|head4/qmaster/1|<-|cbcb-n12/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5036|      0|   2146|09:42:23.346079|
09:42:23.384937|head4/qmaster/1|<-|bio-n028/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5046|      0|   2146|09:42:23.384937|
09:42:23.590245|head4/qmaster/1|<-|bio-n042/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5028|      0|   2146|09:42:23.590245|
09:42:23.926615|head4/qmaster/1|<-|bio-n029/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5046|      0|   2146|09:42:23.926615|
09:42:23.985388|head4/qmaster/1|<-|cbcb-n20/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5044|      0|   2146|09:42:23.985388|
09:42:24.241101|head4/qmaster/1|<-|bio-n056/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5039|      0|   2146|09:42:24.241101|
09:42:24.306523|head4/qmaster/1|<-|cod-n002/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5027|      0|   1993|09:42:24.306523|
09:42:24.402327|head4/qmaster/1|<-|bio-n050/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5050|      0|   2145|09:42:24.402327|
09:42:24.416260|head4/qmaster/1|<-|bio-n060/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5022|      0|   2153|09:42:24.416260|
09:42:24.459059|head4/qmaster/1|<-|bio-n014/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5052|      0|   2146|09:42:24.459059|
09:42:24.939567|head4/qmaster/1|<-|bio-n088/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5028|      0|   1638|09:42:24.939567|
09:42:25.012324|head4/qmaster/1|<-|cbcb-n24/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5035|      0|   2146|09:42:25.012324|
09:42:25.217433|head4/qmaster/1|<-|core-n43/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5050|      0|   1892|09:42:25.217433|
09:42:25.405782|head4/qmaster/1|<-|chg-n03/execd/1          |   bin|     nak|    TAG_REPORT_REQUEST|  5048|      0|   2116|09:42:25.405782|
09:42:25.446342|head4/qmaster/1|<-|stat-n13/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5050|      0|   2146|09:42:25.446342|
09:42:25.450645|head4/qmaster/1|<-|bio-n100/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5049|      0|   2145|09:42:25.450645|
09:42:25.648497|head4/qmaster/1|<-|compeb-n20/execd/1       |   bin|     nak|    TAG_REPORT_REQUEST|  5030|      0|   2206|09:42:25.648497|
09:42:26.065306|head4/qmaster/1|<-|cbcb-n06/execd/1         |   bin|     nak|    TAG_REPORT_REQUEST|  5073|      0|   2145|09:42:26.065306|



    [ Part 4: "Attached Text" ]

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net



More information about the gridengine-users mailing list