[GE users] aha. the "! lGetHost(): got NULL element for EH_name !"" error is back

Stephan Grell - Sun Germany - SSG - Software Engineer stephan.grell at sun.com
Thu Mar 3 07:48:02 GMT 2005


Hi Chris,

you are using 6.0u1?

What about upgrading to 6.0u3? This issue might be fixed...

Cheers,
Stephan

Chris Dagdigian wrote:

>Hi folks,
>
>I saw this on an SGE6 cluster late last year, the thread is here:
>http://gridengine.sunsource.net/servlets/ReadMsg?msgId=21337
>
>I'm in the same boat now. Different cluster. No XSAN. SGE 6.0u1 qmaster 
>on Mac OS X will fail to start and the main interesting log message is:
>
>  "!! lGetHost(): got NULL element for EH_name !!"
>
>This was a working and functional cluster until upstream DNS 
>administrators blocked the public DNS name for forward and reverse 
>lookups. Then the Grid Engine went pear shaped and now will not start at 
>all.
>
>Consequently I think this error may be due to or influenced by resolver 
>or hostname lookup issues :)
>
>The main symptom I see in the process table is that the sgemaster 
>startup script seems to hang at the point where utilbin/qping is 
>attempting to check to see if a qmaster is already running.
>
>I'm attaching ~600 lines of text from running sgemaster under the "dl 2" 
>debug settings. The main error is the last line. The only change I've 
>made to the text file is to mask out the real public FDQN hostname (I 
>replaced it with "masked.bioteam.net".
>
>Any thoughts?
>
>-Chris
>
>
>
>  
>
>------------------------------------------------------------------------
>
>geode:/common/sge/default/common root# /common/sge/default/common/sgemaster start
>     0  17615 -1610571284 --> main() {
>     1  17615 -1610571284 --> sge_get_root_dir() {
>     2  17615 -1610571284 <-- sge_get_root_dir() ../libs/uti/sge_arch.c 218 }
>     3  17615 -1610571284 --> daemonize_qmaster() {
>     4  17615 -1610571284     sge_qmaster is not daemonized
>     5  17615 -1610571284 <-- daemonize_qmaster() ../daemons/qmaster/sge_qmaster_main.c 360 }
>     6  17615 -1610571284 --> sge_qmaster_thread_init() {
>     7  17615 -1610571284 --> sge_setup() {
>     8  17615 -1610571284 --> sge_getme() {
>     9  17615 -1610571284 --> sge_gethostbyname() {
>    10  17615 -1610571284     Getting host by name - Thread safe
>    11  17615 -1610571284 --> sge_copy_hostent() {
>    12  17615 -1610571284     1 names in h_addr_list
>    13  17615 -1610571284     0 names in h_aliases
>    14  17615 -1610571284 <-- sge_copy_hostent() ../libs/uti/sge_hostname.c 586 }
>    15  17615 -1610571284 <-- sge_gethostbyname() ../libs/uti/sge_hostname.c 508 }
>    16  17615 -1610571284     sge_getme:../libs/uti/sge_prog.c:469
>    17  17615 -1610571284     sge_getme:../libs/uti/sge_prog.c:476
>    18  17615 -1610571284     sge_getme:../libs/uti/sge_prog.c:495
>    19  17615 -1610571284 --> sge_get_default_cell() {
>    20  17615 -1610571284 <-- sge_get_default_cell() ../libs/uti/sge_arch.c 305 }
>    21  17615 -1610571284 --> sge_show_me() {
>    22  17615 -1610571284     me.who                      >6<
>    23  17615 -1610571284     me.sge_formal_prog_name     >qmaster<
>    24  17615 -1610571284     me.qualified_hostname       >geode.masked-hostname.bioteam.net<
>    25  17615 -1610571284     me.unqualified_hostname     >geode<
>    26  17615 -1610571284     me.uid                      >0<
>    27  17615 -1610571284     me.gid                      >0<
>    28  17615 -1610571284     me.daemonized               >0<
>    29  17615 -1610571284     me.user_name                >root<
>    30  17615 -1610571284     me.default_cell             >default<
>    31  17615 -1610571284 <-- sge_show_me() ../libs/uti/sge_prog.c 546 }
>    32  17615 -1610571284 <-- sge_getme() ../libs/uti/sge_prog.c 506 }
>    33  17615 -1610571284 --> sge_setup_paths() {
>    34  17615 -1610571284 --> sge_get_root_dir() {
>    35  17615 -1610571284 <-- sge_get_root_dir() ../libs/uti/sge_arch.c 218 }
>    36  17615 -1610571284     sge_root            >/common/sge<
>    37  17615 -1610571284     cell_root           >/common/sge/default<
>    38  17615 -1610571284     conf_file           >/common/sge/default/common/bootstrap<
>    39  17615 -1610571284     bootstrap_file      >/common/sge/default/common/configuration<
>    40  17615 -1610571284     act_qmaster_file    >/common/sge/default/common/act_qmaster<
>    41  17615 -1610571284     acct_file           >/common/sge/default/common/accounting<
>    42  17615 -1610571284     reporting_file      >/common/sge/default/common/reporting<
>    43  17615 -1610571284     local_conf_dir      >/common/sge/default/common/local_conf<
>    44  17615 -1610571284     shadow_masters_file >/common/sge/default/common/shadow_masters<
>    45  17615 -1610571284 <-- sge_setup_paths() ../libs/uti/setup_path.c 401 }
>    46  17615 -1610571284 --> sge_bootstrap() {
>    47  17615 -1610571284 --> sge_get_confval_array() {
>    48  17615 -1610571284 <-- sge_get_confval_array() ../libs/uti/sge_spool.c 649 }
>    49  17615 -1610571284     admin_user          >sge<
>    50  17615 -1610571284     default_domain      >none<
>    51  17615 -1610571284     ignore_fqdn         >true<
>    52  17615 -1610571284     spooling_method     >berkeleydb<
>    53  17615 -1610571284     spooling_lib        >libspoolb<
>    54  17615 -1610571284     spooling_params     >/common/sge/default/spool/spooldb<
>    55  17615 -1610571284     binary_path         >/common/sge/bin<
>    56  17615 -1610571284     qmaster_spool_dir   >/common/sge/default/spool/qmaster<
>    57  17615 -1610571284     security_mode        >none<
>    58  17615 -1610571284 <-- sge_bootstrap() ../libs/uti/sge_bootstrap.c 326 }
>    59  17615 -1610571284 --> featureset_initialize_from_string() {
>    60  17615 -1610571284 --> featureset_get_id() {
>    61  17615 -1610571284 <-- featureset_get_id() ../libs/sgeobj/sge_feature.c 392 }
>    62  17615 -1610571284 --> feature_activate() {
>    63  17615 -1610571284 <-- feature_activate() ../libs/sgeobj/sge_feature.c 284 }
>    64  17615 -1610571284 <-- featureset_initialize_from_string() ../libs/sgeobj/sge_feature.c 197 }
>    65  17615 -1610571284 <-- sge_setup() ../libs/gdi/setup.c 204 }
>    66  17615 -1610571284 --> reresolve_me_qualified_hostname() {
>    67  17615 -1610571284 --> sge_gethostbyname() {
>    68  17615 -1610571284     Getting host by name - Thread safe
>    69  17615 -1610571284 --> sge_copy_hostent() {
>    70  17615 -1610571284     1 names in h_addr_list
>    71  17615 -1610571284     0 names in h_aliases
>    72  17615 -1610571284 <-- sge_copy_hostent() ../libs/uti/sge_hostname.c 586 }
>    73  17615 -1610571284 <-- sge_gethostbyname() ../libs/uti/sge_hostname.c 508 }
>    74  17615 -1610571284     me.qualified_hostname: geode.masked-hostname.bioteam.net
>    75  17615 -1610571284 <-- reresolve_me_qualified_hostname() ../libs/gdi/setup.c 245 }
>    76  17615 -1610571284 --> sge_log() {
>    77  17615 -1610571284     ../daemons/qmaster/setup_qmaster.c 221 sge_qmaster_thread_init: qualified hostname "geode.masked-hostname.bioteam.net"
>    78  17615 -1610571284 <-- sge_qmaster_thread_init() ../daemons/qmaster/setup_qmaster.c 240 }
>    79  17615 -1610571284 --> prepare_enroll() {
>    80  17615 -1610571284 --> sge_security_initialize() {
>    81  17615 -1610571284 <-- sge_security_initialize() ../libs/gdi/sge_security.c 137 }
>    82  17615 -1610571284 --> sge_log() {
>    83  17615 -1610571284     ../libs/gdi/sge_any_request.c 225 starting up multi thread communication
>    84  17615 -1610571284 --> sge_get_alias_path() {
>    85  17615 -1610571284 --> sge_get_root_dir() {
>    86  17615 -1610571284 <-- sge_get_root_dir() ../libs/uti/sge_arch.c 218 }
>    87  17615 -1610571284 --> sge_get_default_cell() {
>    88  17615 -1610571284 <-- sge_get_default_cell() ../libs/uti/sge_arch.c 305 }
>    89  17615 -1610571284 <-- sge_get_alias_path() ../libs/uti/sge_arch.c 347 }
>    90  17615 -1610571284 --> reresolve_me_qualified_hostname() {
>    91  17615 -1610571284 --> sge_gethostbyname() {
>    92  17615 -1610571284     Getting host by name - Thread safe
>    93  17615 -1610571284 --> sge_copy_hostent() {
>    94  17615 -1610571284     1 names in h_addr_list
>    95  17615 -1610571284     0 names in h_aliases
>    96  17615 -1610571284 <-- sge_copy_hostent() ../libs/uti/sge_hostname.c 586 }
>    97  17615 -1610571284 <-- sge_gethostbyname() ../libs/uti/sge_hostname.c 508 }
>    98  17615 -1610571284 --> sge_gethostbyname() {
>    99  17615 -1610571284     Getting host by name - Thread safe
>   100  17615 -1610571284 --> sge_copy_hostent() {
>   101  17615 -1610571284     1 names in h_addr_list
>   102  17615 -1610571284     0 names in h_aliases
>   103  17615 -1610571284 <-- sge_copy_hostent() ../libs/uti/sge_hostname.c 586 }
>   104  17615 -1610571284 <-- sge_gethostbyname() ../libs/uti/sge_hostname.c 508 }
>   105  17615 -1610571284     me.qualified_hostname: geode.masked-hostname.bioteam.net
>   106  17615 -1610571284 <-- reresolve_me_qualified_hostname() ../libs/gdi/setup.c 245 }
>   107  17615 -1610571284     creating QMASTER handle
>   108  17615 -1610571284 --> sge_get_qmaster_port() {
>   109  17615 -1610571284     returning port value: 701
>   110  17615 -1610571284 <-- sge_get_qmaster_port() ../libs/uti/sge_hostname.c 149 }
>   111  17615 -1610571284 --> sge_log() {
>   112  17615 -1610571284     ../libs/gdi/sge_any_request.c 362 created communication handel for component name "qmaster"
>   113  17615 -1610571284 <-- prepare_enroll() ../libs/gdi/sge_any_request.c 384 }
>   114  17615 -1610571284 --> become_admin_user() {
>   115  17615 -1610571284 <-- become_admin_user() ../daemons/qmaster/sge_qmaster_main.c 433 }
>   116  17615 -1610571284 --> start_heartbeat() {
>   117  17615 -1610571284 --> inc_qmaster_heartbeat() {
>   118  17615 -1610571284 <-- inc_qmaster_heartbeat() ../daemons/common/qmaster_heartbeat.c 114 }
>   119  17615 -1610571284 --> te_add_event_handler() {
>   120  17615 -1610571284 --> timed_event_once_init() {
>   121  17615 -1610571284 <-- timed_event_once_init() ../daemons/qmaster/sge_qmaster_timed_event.c 779 }
>   122  17615 -1610571284     te_add_event_handler: handler #0 for event type 11
>   123  17615 -1610571284 <-- te_add_event_handler() ../daemons/qmaster/sge_qmaster_timed_event.c 158 }
>   124  17615 -1610571284 --> te_new_event() {
>   125  17615 -1610571284 <-- te_new_event() ../daemons/qmaster/sge_qmaster_timed_event.c 222 }
>   126  17615 -1610571284 --> te_add_event() {
>   127  17615 -1610571284     te_add_event: (t:11 w:1109784453 m:2 s:heartbeat-event)
>   128  17615 -1610571284     te_add_event: did signal delivery thread!
>   129  17615 -1610571284 <-- te_add_event() ../daemons/qmaster/sge_qmaster_timed_event.c 345 }
>   130  17615 -1610571284 --> te_free_event() {
>   131  17615 -1610571284 <-- te_free_event() ../daemons/qmaster/sge_qmaster_timed_event.c 259 }
>   132  17615 -1610571284 <-- start_heartbeat() ../daemons/qmaster/sge_qmaster_main.c 478 }
>   133  17615 -1610571284 --> setup_lock_service() {
>   134  17615 -1610571284 --> sge_set_lock_callback() {
>   135  17615 -1610571284 <-- sge_set_lock_callback() ../libs/lck/sge_lock.c 299 }
>   136  17615 -1610571284 --> sge_set_unlock_callback() {
>   137  17615 -1610571284 <-- sge_set_unlock_callback() ../libs/lck/sge_lock.c 334 }
>   138  17615 -1610571284 --> sge_set_id_callback() {
>   139  17615 -1610571284 <-- sge_set_id_callback() ../libs/lck/sge_lock.c 369 }
>   140  17615 -1610571284 <-- setup_lock_service() ../daemons/qmaster/sge_qmaster_main.c 741 }
>   141  17615 -1610571284 --> sge_setup_qmaster() {
>   142  17615 -1610571284 --> process_cmdline() {
>   143  17615 -1610571284 --> parse_cmdline_qmaster() {
>   144  17615 -1610571284 <-- parse_cmdline_qmaster() ../daemons/qmaster/setup_qmaster.c 457 }
>   145  17615 -1610571284 --> parse_qmaster() {
>   146  17615 -1610571284 <-- parse_qmaster() ../daemons/qmaster/setup_qmaster.c 513 }
>   147  17615 -1610571284 <-- process_cmdline() ../daemons/qmaster/setup_qmaster.c 406 }
>   148  17615 -1610571284 --> sge_log() {
>   149  17615 -1610571284     ../daemons/qmaster/setup_qmaster.c 167 begin with start up
>   150  17615 -1610571284 --> qmaster_unlock() {
>   151  17615 -1610571284 <-- qmaster_unlock() ../daemons/common/lock.c 78 }
>   152  17615 25193984 --> deliver_events() {
>   153  17615 25193984 --> sge_qmaster_thread_init() {
>   154  17615 25193984 --> sge_setup() {
>   155  17615 -1610571284 --> qmaster_init() {
>   156  17615 25193984 --> sge_getme() {
>   157  17615 -1610571284 --> sge_setup_qmaster() {
>   158  17615 25193984 --> sge_gethostbyname() {
>   159  17615 -1610571284 --> sge_initialize_persistence() {
>   160  17615 25193984     Getting host by name - Thread safe
>   161  17615 -1610571284 --> spool_create_dynamic_context() {
>   162  17615 25193984 --> sge_copy_hostent() {
>   163  17615 -1610571284 --> spool_dynamic_create_context() {
>   164  17615 25193984     1 names in h_addr_list
>   165  17615 25193984     0 names in h_aliases
>   166  17615 25193984 <-- sge_copy_hostent() ../libs/uti/sge_hostname.c 586 }
>   167  17615 25193984 <-- sge_gethostbyname() ../libs/uti/sge_hostname.c 508 }
>   168  17615 25193984     sge_getme:../libs/uti/sge_prog.c:469
>   169  17615 25193984     sge_getme:../libs/uti/sge_prog.c:476
>   170  17615 25193984     sge_getme:../libs/uti/sge_prog.c:495
>   171  17615 25193984 --> sge_get_default_cell() {
>   172  17615 25193984 <-- sge_get_default_cell() ../libs/uti/sge_arch.c 305 }
>   173  17615 25193984 --> sge_show_me() {
>   174  17615 25193984     me.who                      >6<
>   175  17615 25193984     me.sge_formal_prog_name     >qmaster<
>   176  17615 25193984     me.qualified_hostname       >geode.masked-hostname.bioteam.net<
>   177  17615 25193984     me.unqualified_hostname     >geode<
>   178  17615 25193984     me.uid                      >0<
>   179  17615 25193984     me.gid                      >0<
>   180  17615 25193984     me.daemonized               >0<
>   181  17615 25193984     me.user_name                >root<
>   182  17615 25193984     me.default_cell             >default<
>   183  17615 25193984 <-- sge_show_me() ../libs/uti/sge_prog.c 546 }
>   184  17615 25193984 <-- sge_getme() ../libs/uti/sge_prog.c 506 }
>   185  17615 25193984 --> sge_setup_paths() {
>   186  17615 25193984 --> sge_get_root_dir() {
>   187  17615 25193984 <-- sge_get_root_dir() ../libs/uti/sge_arch.c 218 }
>   188  17615 25193984     sge_root            >/common/sge<
>   189  17615 25193984     cell_root           >/common/sge/default<
>   190  17615 25193984     conf_file           >/common/sge/default/common/bootstrap<
>   191  17615 25193984     bootstrap_file      >/common/sge/default/common/configuration<
>   192  17615 25193984     act_qmaster_file    >/common/sge/default/common/act_qmaster<
>   193  17615 25193984     acct_file           >/common/sge/default/common/accounting<
>   194  17615 25193984     reporting_file      >/common/sge/default/common/reporting<
>   195  17615 25193984     local_conf_dir      >/common/sge/default/common/local_conf<
>   196  17615 25193984     shadow_masters_file >/common/sge/default/common/shadow_masters<
>   197  17615 25193984 <-- sge_setup_paths() ../libs/uti/setup_path.c 401 }
>   198  17615 25193984 --> sge_bootstrap() {
>   199  17615 25193984 --> sge_get_confval_array() {
>   200  17615 25193984 <-- sge_get_confval_array() ../libs/uti/sge_spool.c 649 }
>   201  17615 25193984     admin_user          >sge<
>   202  17615 25193984     default_domain      >none<
>   203  17615 25193984     ignore_fqdn         >true<
>   204  17615 25193984     spooling_method     >berkeleydb<
>   205  17615 25193984     spooling_lib        >libspoolb<
>   206  17615 25193984     spooling_params     >/common/sge/default/spool/spooldb<
>   207  17615 25193984     binary_path         >/common/sge/bin<
>   208  17615 25193984     qmaster_spool_dir   >/common/sge/default/spool/qmaster<
>   209  17615 25193984     security_mode        >none<
>   210  17615 25193984 <-- sge_bootstrap() ../libs/uti/sge_bootstrap.c 326 }
>   211  17615 25193984 --> featureset_initialize_from_string() {
>   212  17615 25193984 --> featureset_get_id() {
>   213  17615 25193984 <-- featureset_get_id() ../libs/sgeobj/sge_feature.c 392 }
>   214  17615 25193984 --> feature_activate() {
>   215  17615 25193984 <-- feature_activate() ../libs/sgeobj/sge_feature.c 284 }
>   216  17615 25193984 <-- featureset_initialize_from_string() ../libs/sgeobj/sge_feature.c 197 }
>   217  17615 25193984 <-- sge_setup() ../libs/gdi/setup.c 204 }
>   218  17615 25193984 --> reresolve_me_qualified_hostname() {
>   219  17615 25193984     me.qualified_hostname: geode.masked-hostname.bioteam.net
>   220  17615 25193984 <-- reresolve_me_qualified_hostname() ../libs/gdi/setup.c 245 }
>   221  17615 25193984 --> sge_log() {
>   222  17615 25193984     ../daemons/qmaster/setup_qmaster.c 221 sge_qmaster_thread_init: qualified hostname "geode.masked-hostname.bioteam.net"
>   223  17615 25193984 <-- sge_qmaster_thread_init() ../daemons/qmaster/setup_qmaster.c 240 }
>   224  17615 25193984 --> should_exit() {
>   225  17615 25193984 <-- should_exit() ../daemons/qmaster/sge_qmaster_timed_event.c 1094 }
>   226  17615 25193984 --> check_time() {
>   227  17615 25193984 <-- check_time() ../daemons/qmaster/sge_qmaster_timed_event.c 942 }
>   228  17615 25193984 --> event_from_list_elem() {
>   229  17615 25193984 <-- event_from_list_elem() ../daemons/qmaster/sge_qmaster_timed_event.c 990 }
>   230  17615 25193984     deliver_events: time:1109784423 next:1109784453 --> will wait
>   231  17615 -1610571284 <-- spool_dynamic_create_context() ../libs/spool/dynamic/sge_spooling_dynamic.c 181 }
>   232  17615 -1610571284 <-- spool_create_dynamic_context() ../libs/spool/loader/sge_spooling_loader.c 158 }
>   233  17615 -1610571284 --> spool_set_option() {
>   234  17615 -1610571284 <-- spool_set_option() ../libs/spool/sge_spooling.c 184 }
>   235  17615 -1610571284 --> spool_startup_context() {
>   236  17615 -1610571284 <-- spool_startup_context() ../libs/spool/sge_spooling.c 322 }
>   237  17615 -1610571284 --> te_add_event_handler() {
>   238  17615 -1610571284     te_add_event_handler: handler #1 for event type 8
>   239  17615 -1610571284 <-- te_add_event_handler() ../daemons/qmaster/sge_qmaster_timed_event.c 158 }
>   240  17615 -1610571284 --> te_new_event() {
>   241  17615 -1610571284 <-- te_new_event() ../daemons/qmaster/sge_qmaster_timed_event.c 222 }
>   242  17615 -1610571284 --> te_add_event() {
>   243  17615 -1610571284     te_add_event: (t:8 w:1109784423 m:1 s:(null))
>   244  17615 -1610571284     te_add_event: did signal delivery thread!
>   245  17615 -1610571284 <-- te_add_event() ../daemons/qmaster/sge_qmaster_timed_event.c 345 }
>   246  17615 -1610571284 --> te_free_event() {
>   247  17615 -1610571284 <-- te_free_event() ../daemons/qmaster/sge_qmaster_timed_event.c 259 }
>   248  17615 -1610571284 <-- sge_initialize_persistence() ../daemons/qmaster/sge_persistence_qmaster.c 94 }
>   249  17615 -1610571284 --> sge_log() {
>   250  17615 -1610571284     ../libs/sgeobj/sge_answer.c 890 loading spooling method "berkeleydb" from shared library "libspoolb.dylib"
>   251  17615 -1610571284 --> sge_log() {
>   252  17615 -1610571284     ../libs/sgeobj/sge_answer.c 890 setting spooling option "RECOVER" to "TRUE"
>   253  17615 -1610571284 --> sge_log() {
>   254  17615 -1610571284     ../libs/sgeobj/sge_answer.c 890 using BerkeleyDB version Sleepycat Software: Berkeley DB 4.2.52: (December  3, 2003)
>   255  17615 -1610571284 --> sge_read_configuration() {
>   256  17615 -1610571284 --> spool_read_list() {
>   257  17615 25193984     deliver_events: event list changed - next:1109784423 --> start over
>   258  17615 25193984 --> te_free_event() {
>   259  17615 25193984 <-- te_free_event() ../daemons/qmaster/sge_qmaster_timed_event.c 259 }
>   260  17615 25193984 --> should_exit() {
>   261  17615 25193984 <-- should_exit() ../daemons/qmaster/sge_qmaster_timed_event.c 1094 }
>   262  17615 25193984 --> check_time() {
>   263  17615 25193984 <-- check_time() ../daemons/qmaster/sge_qmaster_timed_event.c 942 }
>   264  17615 25193984 --> event_from_list_elem() {
>   265  17615 25193984 <-- event_from_list_elem() ../daemons/qmaster/sge_qmaster_timed_event.c 990 }
>   266  17615 25193984 --> scan_table_and_deliver() {
>   267  17615 25193984     scan_table_and_deliver: event (t:8 w:1109784423 m:1 s:(null))
>   268  17615 25193984 --> deliver_spooling_trigger() {
>   269  17615 25193984 --> te_get_when() {
>   270  17615 25193984 <-- te_get_when() ../daemons/qmaster/sge_qmaster_timed_event.c 527 }
>   271  17615 25193984 --> spool_trigger_context() {
>   272  17615 -1610571284 <-- spool_read_list() ../libs/spool/sge_spooling.c 1046 }
>   273  17615 -1610571284 --> sge_get_configuration_for_host() {
>   274  17615 -1610571284 --> sge_resolve_hostname() {
>   275  17615 -1610571284 <-- sge_resolve_hostname() ../libs/sgeobj/sge_host.c 311 }
>   276  17615 -1610571284 <-- sge_get_configuration_for_host() ../daemons/qmaster/configuration_qmaster.c 642 }
>   277  17615 -1610571284 --> sge_log() {
>   278  17615 -1610571284     ../daemons/qmaster/configuration_qmaster.c 129 local configuration geode.masked-hostname.bioteam.net not defined - using global configuration
>   279  17615 -1610571284 <-- sge_log() ../libs/uti/sge_log.c 516 }
>   280  17615 -1610571284 --> sge_get_configuration_for_host() {
>   281  17615 -1610571284 --> sge_resolve_hostname() {
>   282  17615 -1610571284 <-- sge_resolve_hostname() ../libs/sgeobj/sge_host.c 311 }
>   283  17615 -1610571284 <-- sge_get_configuration_for_host() ../daemons/qmaster/configuration_qmaster.c 642 }
>   284  17615 -1610571284 --> merge_configuration() {
>   285  17615 -1610571284 --> sge_set_defined_defaults() {
>   286  17615 -1610571284 <-- sge_set_defined_defaults() ../libs/sgeobj/sge_conf.c 261 }
>   287  17615 -1610571284 --> setConfFromCull() {
>   288  17615 -1610571284 --> sge_log() {
>   289  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "log_warning" for loglevel
>   290  17615 -1610571284 --> sge_log() {
>   291  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "/common/sge/default/spool" for execd_spool_dir
>   292  17615 -1610571284 --> sge_log() {
>   293  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "/usr/bin/mail" for mailer
>   294  17615 -1610571284 --> sge_log() {
>   295  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "/usr/bin/X11/xterm" for xterm
>   296  17615 -1610571284 --> sge_log() {
>   297  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "none" for load_sensor
>   298  17615 -1610571284 --> sge_log() {
>   299  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "none" for prolog
>   300  17615 -1610571284 --> sge_log() {
>   301  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "none" for epilog
>   302  17615 -1610571284 --> sge_log() {
>   303  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "posix_compliant" for shell_start_mode
>   304  17615 -1610571284 --> sge_log() {
>   305  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "sh,ksh,csh,tcsh" for login_shells
>   306  17615 -1610571284 --> sge_log() {
>   307  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "0" for min_uid
>   308  17615 -1610571284 --> sge_log() {
>   309  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "0" for min_gid
>   310  17615 -1610571284 --> sge_log() {
>   311  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "20000-20100" for gid_range
>   312  17615 -1610571284 --> sge_log() {
>   313  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "00:00:40" for load_report_time
>   314  17615 -1610571284 --> sge_log() {
>   315  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "false" for enforce_project
>   316  17615 -1610571284 --> sge_log() {
>   317  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "auto" for enforce_user
>   318  17615 -1610571284 --> sge_log() {
>   319  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "00:05:00" for max_unheard
>   320  17615 -1610571284 --> sge_log() {
>   321  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "log_warning" for loglevel
>   322  17615 -1610571284 --> sge_log() {
>   323  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "none" for administrator_mail
>   324  17615 -1610571284 --> sge_log() {
>   325  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "none" for set_token_cmd
>   326  17615 -1610571284 --> sge_log() {
>   327  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "none" for pag_cmd
>   328  17615 -1610571284 --> sge_log() {
>   329  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "none" for token_extend_time
>   330  17615 -1610571284 --> sge_log() {
>   331  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "none" for shepherd_cmd
>   332  17615 -1610571284 --> sge_log() {
>   333  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "none" for qmaster_params
>   334  17615 -1610571284 --> sge_log() {
>   335  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "none" for execd_params
>   336  17615 -1610571284 --> sge_log() {
>   337  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "accounting=true reporting=false flush_time=00:00:15 joblog=false sharelog=00:00:00" for reporting_params
>   338  17615 -1610571284 --> sge_log() {
>   339  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "100" for finished_jobs
>   340  17615 -1610571284 --> sge_log() {
>   341  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "/usr/libexec/telnetd" for qlogin_daemon
>   342  17615 -1610571284 --> sge_log() {
>   343  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "telnet" for qlogin_command
>   344  17615 -1610571284 --> sge_log() {
>   345  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "none" for rsh_daemon
>   346  17615 -1610571284 --> sge_log() {
>   347  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "none" for rsh_command
>   348  17615 -1610571284 --> sge_log() {
>   349  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "/usr/libexec/rlogind" for rlogin_daemon
>   350  17615 -1610571284 --> sge_log() {
>   351  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "none" for rlogin_command
>   352  17615 -1610571284 --> sge_log() {
>   353  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "00:00:00" for reschedule_unknown
>   354  17615 -1610571284 --> sge_log() {
>   355  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "2000" for max_aj_instances
>   356  17615 -1610571284 --> sge_log() {
>   357  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "75000" for max_aj_tasks
>   358  17615 -1610571284 --> sge_log() {
>   359  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "0" for max_u_jobs
>   360  17615 -1610571284 --> sge_log() {
>   361  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "0" for max_jobs
>   362  17615 -1610571284 --> sge_log() {
>   363  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "0" for reprioritize
>   364  17615 -1610571284 --> sge_log() {
>   365  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "0" for auto_user_oticket
>   366  17615 -1610571284 --> sge_log() {
>   367  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "0" for auto_user_fshare
>   368  17615 -1610571284 --> sge_log() {
>   369  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "none" for auto_user_default_project
>   370  17615 -1610571284 --> sge_log() {
>   371  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "100" for auto_user_delete_time
>   372  17615 -1610571284 --> sge_log() {
>   373  17615 -1610571284     ../libs/sgeobj/sge_conf.c 294 using "false" for delegated_file_staging
>   374  17615 -1610571284 <-- setConfFromCull() ../libs/sgeobj/sge_conf.c 395 }
>   375  17615 -1610571284 <-- merge_configuration() ../libs/sgeobj/sge_conf.c 686 }
>   376  17615 -1610571284 --> sge_show_conf() {
>   377  17615 -1610571284     conf.execd_spool_dir        >/common/sge/default/spool<
>   378  17615 -1610571284     conf.mailer                 >/usr/bin/mail<
>   379  17615 -1610571284     conf.prolog                 >none<
>   380  17615 -1610571284     conf.epilog                 >none<
>   381  17615 -1610571284     conf.shell_start_mode       >posix_compliant<
>   382  17615 -1610571284     conf.login_shells           >sh,ksh,csh,tcsh<
>   383  17615 -1610571284     conf.administrator_mail     >none<
>   384  17615 -1610571284     conf.min_gid                >0<
>   385  17615 -1610571284     conf.min_uid                >0<
>   386  17615 -1610571284     conf.load_report_time       >40<
>   387  17615 -1610571284     conf.max_unheard            >300<
>   388  17615 -1610571284     conf.loglevel               >4<
>   389  17615 -1610571284     conf.xterm                  >/usr/bin/X11/xterm<
>   390  17615 -1610571284     conf.load_sensor            >none<
>   391  17615 -1610571284     conf.enforce_project        >false<
>   392  17615 -1610571284     conf.enforce_user           >auto<
>   393  17615 -1610571284     conf.set_token_cmd          >none<
>   394  17615 -1610571284     conf.pag_cmd                >none<
>   395  17615 -1610571284     conf.token_extend_time      >0<
>   396  17615 -1610571284     conf.shepherd_cmd           >none<
>   397  17615 -1610571284     conf.qmaster_params         >none<
>   398  17615 -1610571284     conf.execd_params           >none<
>   399  17615 -1610571284     conf.gid_range              >20000-20100<
>   400  17615 -1610571284     conf.zombie_jobs            >100<
>   401  17615 -1610571284     conf.qlogin_daemon          >/usr/libexec/telnetd<
>   402  17615 -1610571284     conf.qlogin_command         >telnet<
>   403  17615 -1610571284     conf.rsh_daemon             >none<
>   404  17615 -1610571284     conf.rsh_command            >none<
>   405  17615 -1610571284     conf.rlogin_daemon          >/usr/libexec/rlogind<
>   406  17615 -1610571284     conf.rlogin_command         >none<
>   407  17615 -1610571284     conf.reschedule_unknown     >0<
>   408  17615 -1610571284     conf.max_aj_instances       >2000<
>   409  17615 -1610571284     conf.max_aj_tasks           >75000<
>   410  17615 -1610571284     conf.max_u_jobs             >0<
>   411  17615 -1610571284     conf.max_jobs               >0<
>   412  17615 -1610571284     conf.reprioritize           >0<
>   413  17615 -1610571284     conf.auto_user_oticket      >0<
>   414  17615 -1610571284     conf.auto_user_fshare       >0<
>   415  17615 -1610571284     conf.auto_user_default_project >none<
>   416  17615 -1610571284     conf.auto_user_delete_time  >100<
>   417  17615 -1610571284     conf.delegated_file_staging >false<
>   418  17615 -1610571284 <-- sge_show_conf() ../libs/sgeobj/sge_conf.c 761 }
>   419  17615 -1610571284 <-- sge_read_configuration() ../daemons/qmaster/configuration_qmaster.c 153 }
>   420  17615 -1610571284 --> reresolve_me_qualified_hostname() {
>   421  17615 -1610571284     me.qualified_hostname: geode.masked-hostname.bioteam.net
>   422  17615 -1610571284 <-- reresolve_me_qualified_hostname() ../libs/gdi/setup.c 245 }
>   423  17615 -1610571284 --> sge_log() {
>   424  17615 -1610571284     ../daemons/qmaster/setup_qmaster.c 797 uti_state_get_qualified_hostname() returned "geode.masked-hostname.bioteam.net"
>   425  17615 -1610571284     Complex Attributes----------------------
>   426  17615 -1610571284 --> spool_read_list() {
>   427  17615 -1610571284 <-- spool_read_list() ../libs/spool/sge_spooling.c 1046 }
>   428  17615 -1610571284     host_list----------------------------
>   429  17615 -1610571284 --> spool_read_list() {
>   430  17615 -1610571284 <-- spool_read_list() ../libs/spool/sge_spooling.c 1046 }
>   431  17615 -1610571284 --> spool_read_list() {
>   432  17615 -1610571284 <-- spool_read_list() ../libs/spool/sge_spooling.c 1046 }
>   433  17615 -1610571284 --> spool_read_list() {
>   434  17615 -1610571284 <-- spool_read_list() ../libs/spool/sge_spooling.c 1046 }
>   435  17615 -1610571284 --> host_list_locate() {
>   436  17615 -1610571284 <-- host_list_locate() ../libs/sgeobj/sge_host.c 84 }
>   437  17615 -1610571284 --> host_list_locate() {
>   438  17615 -1610571284 <-- host_list_locate() ../libs/sgeobj/sge_host.c 84 }
>   439  17615 -1610571284 --> host_list_locate() {
>   440  17615 -1610571284 <-- host_list_locate() ../libs/sgeobj/sge_host.c 84 }
>   441  17615 -1610571284 --> sge_add_host_of_type() {
>   442  17615 -1610571284 --> get_gdi_object() {
>   443  17615 -1610571284 <-- get_gdi_object() ../daemons/qmaster/sge_c_gdi.c 1900 }
>   444  17615 -1610571284 --> sge_gdi_add_mod_generic() {
>   445  17615 -1610571284 --> sge_resolve_host() {
>   446  17615 -1610571284 --> sge_resolve_hostname() {
>   447  17615 -1610571284 <-- sge_resolve_hostname() ../libs/sgeobj/sge_host.c 311 }
>   448  17615 -1610571284 <-- sge_resolve_host() ../libs/sgeobj/sge_host.c 265 }
>   449  17615 -1610571284 --> host_mod() {
>   450  17615 -1610571284 --> attr_mod_str() {
>   451  17615 -1610571284     got new adminhost
>   452  17615 -1610571284 <-- attr_mod_str() ../daemons/qmaster/sge_utility_qmaster.c 218 }
>   453  17615 -1610571284 <-- host_mod() ../daemons/qmaster/sge_host_qmaster.c 498 }
>   454  17615 -1610571284 --> host_spool() {
>   455  17615 -1610571284 --> spool_write_object() {
>   456  17615 -1610571284 <-- spool_write_object() ../libs/spool/sge_spooling.c 1237 }
>   457  17615 -1610571284 <-- host_spool() ../daemons/qmaster/sge_host_qmaster.c 551 }
>   458  17615 -1610571284 --> host_success() {
>   459  17615 -1610571284 --> event_master_once_init() {
>   460  17615 -1610571284 --> init_send_events() {
>   461  17615 -1610571284 <-- init_send_events() ../libs/evm/sge_event_master.c 2332 }
>   462  17615 -1610571284 <-- event_master_once_init() ../libs/evm/sge_event_master.c 2286 }
>   463  17615 -1610571284 --> add_list_event_for_client() {
>   464  17615 25201152 --> send_thread() {
>   465  17615 -1610571284 <-- add_list_event_for_client() ../libs/evm/sge_event_master.c 1742 }
>   466  17615 25201152 --> sge_qmaster_thread_init() {
>   467  17615 -1610571284 <-- host_success() ../daemons/qmaster/sge_host_qmaster.c 610 }
>   468  17615 25201152 --> sge_setup() {
>   469  17615 -1610571284 --> sge_log() {
>   470  17615 25201152 --> sge_getme() {
>   471  17615 -1610571284     ../daemons/qmaster/sge_c_gdi.c 1881 root at geode.masked-hostname.bioteam.net added "geode.masked-hostname.bioteam.net" to adminhost list
>   472  17615 25201152 --> sge_gethostbyname() {
>   473  17615 -1610571284 <-- sge_gdi_add_mod_generic() ../daemons/qmaster/sge_c_gdi.c 1885 }
>   474  17615 25201152     Getting host by name - Thread safe
>   475  17615 -1610571284 <-- sge_add_host_of_type() ../daemons/qmaster/sge_host_qmaster.c 184 }
>   476  17615 -1610571284     manager_list----------------------------
>   477  17615 -1610571284 --> spool_read_list() {
>   478  17615 -1610571284 <-- spool_read_list() ../libs/spool/sge_spooling.c 1046 }
>   479  17615 -1610571284 --> manop_is_manager() {
>   480  17615 -1610571284 <-- manop_is_manager() ../libs/sgeobj/sge_manop.c 74 }
>   481  17615 -1610571284     root
>   482  17615 -1610571284     sge
>   483  17615 -1610571284     www
>   484  17615 -1610571284     host group definitions-----------
>   485  17615 -1610571284 --> spool_read_list() {
>   486  17615 -1610571284 <-- spool_read_list() ../libs/spool/sge_spooling.c 1046 }
>   487  17615 -1610571284     operator_list----------------------------
>   488  17615 -1610571284 --> spool_read_list() {
>   489  17615 -1610571284 <-- spool_read_list() ../libs/spool/sge_spooling.c 1046 }
>   490  17615 -1610571284 --> manop_is_operator() {
>   491  17615 -1610571284 <-- manop_is_operator() ../libs/sgeobj/sge_manop.c 115 }
>   492  17615 -1610571284     sge
>   493  17615 -1610571284     userset_list------------------------------
>   494  17615 -1610571284 --> spool_read_list() {
>   495  17615 -1610571284 <-- spool_read_list() ../libs/spool/sge_spooling.c 1046 }
>   496  17615 -1610571284     calendar list ------------------------------
>   497  17615 -1610571284 --> spool_read_list() {
>   498  17615 -1610571284 <-- spool_read_list() ../libs/spool/sge_spooling.c 1046 }
>   499  17615 -1610571284     cluster_queue_list---------------------------------
>   500  17615 -1610571284 --> spool_read_list() {
>   501  17615 25201152 --> sge_copy_hostent() {
>   502  17615 25201152     1 names in h_addr_list
>   503  17615 25201152     0 names in h_aliases
>   504  17615 25201152 <-- sge_copy_hostent() ../libs/uti/sge_hostname.c 586 }
>   505  17615 25201152 <-- sge_gethostbyname() ../libs/uti/sge_hostname.c 508 }
>   506  17615 25201152     sge_getme:../libs/uti/sge_prog.c:469
>   507  17615 25201152     sge_getme:../libs/uti/sge_prog.c:476
>   508  17615 25201152     sge_getme:../libs/uti/sge_prog.c:495
>   509  17615 25201152 --> sge_get_default_cell() {
>   510  17615 25201152 <-- sge_get_default_cell() ../libs/uti/sge_arch.c 305 }
>   511  17615 25201152 --> sge_show_me() {
>   512  17615 25201152     me.who                      >6<
>   513  17615 25201152     me.sge_formal_prog_name     >qmaster<
>   514  17615 25201152     me.qualified_hostname       >geode.masked-hostname.bioteam.net<
>   515  17615 25201152     me.unqualified_hostname     >geode<
>   516  17615 25201152     me.uid                      >0<
>   517  17615 25201152     me.gid                      >0<
>   518  17615 25201152     me.daemonized               >0<
>   519  17615 25201152     me.user_name                >root<
>   520  17615 25201152     me.default_cell             >default<
>   521  17615 25201152 <-- sge_show_me() ../libs/uti/sge_prog.c 546 }
>   522  17615 25201152 <-- sge_getme() ../libs/uti/sge_prog.c 506 }
>   523  17615 25201152 --> sge_setup_paths() {
>   524  17615 25201152 --> sge_get_root_dir() {
>   525  17615 25201152 <-- sge_get_root_dir() ../libs/uti/sge_arch.c 218 }
>   526  17615 25201152     sge_root            >/common/sge<
>   527  17615 25201152     cell_root           >/common/sge/default<
>   528  17615 25201152     conf_file           >/common/sge/default/common/bootstrap<
>   529  17615 25201152     bootstrap_file      >/common/sge/default/common/configuration<
>   530  17615 25201152     act_qmaster_file    >/common/sge/default/common/act_qmaster<
>   531  17615 25201152     acct_file           >/common/sge/default/common/accounting<
>   532  17615 25201152     reporting_file      >/common/sge/default/common/reporting<
>   533  17615 25201152     local_conf_dir      >/common/sge/default/common/local_conf<
>   534  17615 25201152     shadow_masters_file >/common/sge/default/common/shadow_masters<
>   535  17615 25201152 <-- sge_setup_paths() ../libs/uti/setup_path.c 401 }
>   536  17615 25201152 --> sge_bootstrap() {
>   537  17615 25201152 --> sge_get_confval_array() {
>   538  17615 25201152 <-- sge_get_confval_array() ../libs/uti/sge_spool.c 649 }
>   539  17615 25201152     admin_user          >sge<
>   540  17615 25201152     default_domain      >none<
>   541  17615 25201152     ignore_fqdn         >true<
>   542  17615 25201152     spooling_method     >berkeleydb<
>   543  17615 25201152     spooling_lib        >libspoolb<
>   544  17615 25201152     spooling_params     >/common/sge/default/spool/spooldb<
>   545  17615 25201152     binary_path         >/common/sge/bin<
>   546  17615 25201152     qmaster_spool_dir   >/common/sge/default/spool/qmaster<
>   547  17615 25201152     security_mode        >none<
>   548  17615 25201152 <-- sge_bootstrap() ../libs/uti/sge_bootstrap.c 326 }
>   549  17615 25201152 --> featureset_initialize_from_string() {
>   550  17615 25201152 --> featureset_get_id() {
>   551  17615 25201152 <-- featureset_get_id() ../libs/sgeobj/sge_feature.c 392 }
>   552  17615 25201152 --> feature_activate() {
>   553  17615 25201152 <-- feature_activate() ../libs/sgeobj/sge_feature.c 284 }
>   554  17615 25201152 <-- featureset_initialize_from_string() ../libs/sgeobj/sge_feature.c 197 }
>   555  17615 25201152 <-- sge_setup() ../libs/gdi/setup.c 204 }
>   556  17615 25201152 --> reresolve_me_qualified_hostname() {
>   557  17615 25201152     me.qualified_hostname: geode.masked-hostname.bioteam.net
>   558  17615 25201152 <-- reresolve_me_qualified_hostname() ../libs/gdi/setup.c 245 }
>error: missing attribute "slots" in complexes
>error: unknown resource "slots"
>error: denied: attribute "slots" is no complex attribute
>   559  17615 25201152 --> sge_log() {
>   560  17615 -1610571284 <-- spool_read_list() ../libs/spool/sge_spooling.c 1046 }
>   561  17615 25201152     ../daemons/qmaster/setup_qmaster.c 221 sge_qmaster_thread_init: qualified hostname "geode.masked-hostname.bioteam.net"
>   562  17615 -1610571284 --> qinstance_state_set_unknown() {
>   563  17615 25201152 <-- sge_qmaster_thread_init() ../daemons/qmaster/setup_qmaster.c 240 }
>   564  17615 -1610571284 <-- qinstance_state_set_unknown() ../libs/sgeobj/sge_qinstance_state.c 525 }
>   565  17615 25201152 --> should_exit() {
>   566  17615 -1610571284 --> qinstance_state_set_unknown() {
>   567  17615 25201152 <-- should_exit() ../libs/evm/sge_event_master.c 2483 }
>   568  17615 -1610571284 <-- qinstance_state_set_unknown() ../libs/sgeobj/sge_qinstance_state.c 525 }
>   569  17615 -1610571284 --> qinstance_state_set_unknown() {
>   570  17615 -1610571284 <-- qinstance_state_set_unknown() ../libs/sgeobj/sge_qinstance_state.c 525 }
>   571  17615 -1610571284 --> qinstance_state_set_unknown() {
>   572  17615 -1610571284 <-- qinstance_state_set_unknown() ../libs/sgeobj/sge_qinstance_state.c 525 }
>   573  17615 -1610571284 --> qinstance_state_set_unknown() {
>   574  17615 -1610571284 <-- qinstance_state_set_unknown() ../libs/sgeobj/sge_qinstance_state.c 525 }
>   575  17615 -1610571284 --> qinstance_state_set_unknown() {
>   576  17615 -1610571284 <-- qinstance_state_set_unknown() ../libs/sgeobj/sge_qinstance_state.c 525 }
>   577  17615 -1610571284     pe_list---------------------------------
>   578  17615 -1610571284 --> spool_read_list() {
>   579  17615 -1610571284 <-- spool_read_list() ../libs/spool/sge_spooling.c 1046 }
>   580  17615 -1610571284     ckpt_list---------------------------------
>   581  17615 -1610571284 --> spool_read_list() {
>   582  17615 -1610571284 <-- spool_read_list() ../libs/spool/sge_spooling.c 1046 }
>   583  17615 -1610571284     job_list-----------------------------------
>   584  17615 -1610571284 --> spool_read_list() {
>   585  17615 -1610571284 <-- spool_read_list() ../libs/spool/sge_spooling.c 1046 }
>   586  17615 -1610571284 --> sge_log() {
>   587  17615 -1610571284     ../daemons/qmaster/setup_qmaster.c 910 read job database with 4 entries in 0 seconds
>   588  17615 -1610571284 <-- sge_log() ../libs/uti/sge_log.c 516 }
>   589  17615 -1610571284     JOB 51 PRIORITY 0
>   590  17615 -1610571284 --> job_suc_pre() {
>   591  17615 -1610571284 <-- job_suc_pre() ../daemons/qmaster/sge_job_qmaster.c 2007 }
>   592  17615 -1610571284     JOB 52 PRIORITY 0
>   593  17615 -1610571284 --> job_suc_pre() {
>   594  17615 -1610571284 <-- job_suc_pre() ../daemons/qmaster/sge_job_qmaster.c 2007 }
>   595  17615 -1610571284     JOB 53 PRIORITY 0
>   596  17615 -1610571284 --> job_suc_pre() {
>   597  17615 -1610571284 <-- job_suc_pre() ../daemons/qmaster/sge_job_qmaster.c 2007 }
>   598  17615 -1610571284     JOB 54 PRIORITY 0
>   599  17615 -1610571284 --> job_suc_pre() {
>   600  17615 -1610571284 <-- job_suc_pre() ../daemons/qmaster/sge_job_qmaster.c 2007 }
>   601  17615 -1610571284 --> debit_all_jobs_from_qs() {
>   602  17615 -1610571284 --> cqueue_list_locate_qinstance() {
>   603  17615 -1610571284 --> cqueue_name_split() {
>   604  17615 -1610571284 <-- cqueue_name_split() ../libs/sgeobj/sge_cqueue.c 247 }
>   605  17615 -1610571284 <-- cqueue_list_locate_qinstance() ../libs/sgeobj/sge_cqueue.c 1590 }
>   606  17615 -1610571284 --> host_list_locate() {
>   607  17615 -1610571284 <-- host_list_locate() ../libs/sgeobj/sge_host.c 84 }
>   608  17615 -1610571284 --> rc_debit_consumable() {
>   609  17615 -1610571284 <-- rc_debit_consumable() ../libs/sgeobj/sge_qinstance.c 685 }
>   610  17615 -1610571284 --> host_list_locate() {
>   611  17615 -1610571284 <-- host_list_locate() ../libs/sgeobj/sge_host.c 84 }
>   612  17615 -1610571284 --> sge_log() {
>   613  17615 -1610571284     ../libs/cull/cull_multitype.c 902 !!!!!!!!!! lGetHost(): got NULL element for EH_name !!!!!!!!!!
>   614  17615 -1610571284 <-- sge_log() ../libs/uti/sge_log.c 516 }
>/common/sge/default/common/sgemaster: line 465: 17615 Abort trap              $bin_dir/sge_qmaster
>  
>
>------------------------------------------------------------------------
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
>For additional commands, e-mail: users-help at gridengine.sunsource.net
>  
>


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net




More information about the gridengine-users mailing list