[GE users] move qmaster's spool location ? & performance

cjf001 john.foley at motorola.com
Fri Apr 23 21:12:06 BST 2010


OK, thanks, I may give it a try next week.

I don't think I have anything 'weird' turned on - I've pasted the
outputs of the "qconf -ssconf" and "qconf -sconf global"
commands below, if you'd like to take a quick peek to see if
anything looks out of the ordinary.

    Thanks,

      John


root at lxadml2# qconf -ssconf
algorithm                         default
schedule_interval                 00:00:15
maxujobs                          0
queue_sort_method                 seqno
job_load_adjustments              np_load_avg=0.50
load_adjustment_decay_time        0:7:30
load_formula                      np_load_avg
schedd_job_info                   false
flush_submit_sec                  0
flush_finish_sec                  0
params                            MONITOR=1
reprioritize_interval             0:0:0
halftime                          168
usage_weight_list                 cpu=1.000000,mem=0.000000,io=0.000000
compensation_factor               5.000000
weight_user                       0.250000
weight_project                    0.250000
weight_department                 0.250000
weight_job                        0.250000
weight_tickets_functional         0
weight_tickets_share              0
share_override_tickets            TRUE
share_functional_shares           TRUE
max_functional_jobs_to_schedule   200
report_pjob_tickets               TRUE
max_pending_tasks_per_job         50
halflife_decay_list               none
policy_hierarchy                  OFS
weight_ticket                     0.000000
weight_waiting_time               0.000000
weight_deadline                   3600000.000000
weight_urgency                    0.000000
weight_priority                   400.000000
max_reservation                   0
default_duration                  INFINITY




root at lxadml2# qconf -sconf global
#global:
execd_spool_dir              /opt/sge/6.2u2/cell.amsg.6.2u2/spool
mailer                       /bin/mail
xterm                        /usr/bin/X11/xterm
load_sensor                  none
prolog                       none
epilog                       none
shell_start_mode             posix_compliant
login_shells                 sh,ksh,csh,tcsh
min_uid                      0
min_gid                      0
user_lists                   none
xuser_lists                  none
projects                     none
xprojects                    none
enforce_project              false
enforce_user                 auto
load_report_time             00:00:40
max_unheard                  00:05:00
reschedule_unknown           00:00:00
loglevel                     log_warning
administrator_mail           amsg_sgeadm at srl.css.mot.com
set_token_cmd                none
pag_cmd                      none
token_extend_time            none
shepherd_cmd                 none
qmaster_params               none
execd_params                 none
reporting_params             accounting=true reporting=false \
                              flush_time=00:00:15 joblog=false sharelog=00:00:00
finished_jobs                100
gid_range                    20000-20100
qlogin_command               builtin
qlogin_daemon                builtin
rlogin_command               builtin
rlogin_daemon                builtin
rsh_command                  builtin
rsh_daemon                   builtin
max_aj_instances             2000
max_aj_tasks                 75000
max_u_jobs                   0
max_jobs                     0
max_advance_reservations     0
auto_user_oticket            0
auto_user_fshare             0
auto_user_default_project    none
auto_user_delete_time        86400
delegated_file_staging       false
reprioritize                 0
jsv_url                      none
libjvm_path                  Please
additional_jvm_args          -Xmx256m
jsv_allowed_mod              ac,h,i,e,o,j,M,N,p,w


rayson wrote:
> On 4/23/10, cjf001<john.foley at motorola.com>  wrote:
>> So, a few questions for you all !
>>
>> - I'm running all SGEv6.2u2 right now. Can I upgrade just the qmaster
>>    to v6.2u5, and leave the clients at 6.2u2 ?  If so, can the clients
>>    be a mix of 6.2u2 and 6.2u5 ? (would make the eventual upgrade
>>    easier....)
>
> Should try it with a test cluster first, which can run on a subset of
> nodes of your production cluster -- as long as they use different
> ports and spool directories, they are isolated.
>
>
>> - Is there a way to limit the number of jobs in the system - that is,
>>    keep qsub from submitting if the total number of jobs is greater
>>    that some number ? I know there's a limit on *running* jobs, but
>>    I couldn't find anything on *running + pending* jobs.
>
> max_jobs - see sge_conf(5).
>
>
>> - anybody else out there running the flat file qmaster backend, with
>>    >  5000 jobs in the system (running + pending) ?  If so, how's
>>    your performance ?
>
> I guess it depends on the disk's I/O speed.
>
> However, 5000 jobs are not a lot of jobs -- did you turn on any
> special scheduling features??
>
> Rayson
>
>
>>
>>
>>      Thanks,
>>
>>         John
>>
>>
>> John Foley wrote:
>>> I guess I could try that.... my simlink would actually be on the
>>> NFS server, though, so I'm not sure if that would eliminate the
>>> NFS traffic for my test....
>>>
>>> I found that the spooler location is defined in the "bootstrap"
>>> file... I'm thinking of just stopping the qmaster, changing the
>>> entry in the bootstrap file, copying the data to the new local
>>> location, and then restarting qmaster.....
>>>
>>> Anyone see anything wrong with that ?
>>>
>>> Thanks,
>>>
>>> John
>>>
>>> rayson wrote:
>>>> On Thu, Apr 22, 2010 at 4:14 PM, cjf001 wrote:
>>>>> I ask because my current qmaster spool directory is on our NFS server,
>>>>> but I'm thinking I could (temporarily, at least) move it to the
>>>>> local machine's disk to see if that's causing my performance issue.
>>>>
>>>> A quick and dirty way: with a sym. link and you can place your spool
>>>> directory wherever you want.
>>>>
>>>> Rayson
>>>>
>>>>
>>>>
>>>>
>>>>>
>>>>> Thanks,
>>>>>
>>>>> John
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> ###########################################################################
>>>>>
>>>>> # John Foley # Location: IL93-E1-21S #
>>>>> # IT&  Systems Administration # Maildrop: IL93-E1-35O #
>>>>> # Antenna&  Mechanical Simulation Grp # Email: john.foley at motorola.com #
>>>>> # Motorola, Inc. - Mobile Devices # Phone: (847) 523-8719 #
>>>>> # 600 North US Highway 45 # Fax: (847) 523-5767 #
>>>>> # Libertyville, IL. 60048 (USA) # Cell: (847) 460-8719 #
>>>>> ###########################################################################
>>>>>
>>>>> (this email sent using SeaMonkey on Windows)
>>>>>
>>>>> ------------------------------------------------------
>>>>> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=254501
>>>>>
>>>>>
>>>>> To unsubscribe from this discussion, e-mail:
>>>>> [users-unsubscribe at gridengine.sunsource.net].
>>>>>
>>>>
>>>> ------------------------------------------------------
>>>> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=254503
>>>>
>>>>
>>>> To unsubscribe from this discussion, e-mail:
>>>> [users-unsubscribe at gridengine.sunsource.net].
>>>
>>>
>>>
>>
>>
>>
>> --
>> ###########################################################################
>> # John Foley                          # Location:  IL93-E1-21S            #
>> # IT&  Systems Administration         # Maildrop:  IL93-E1-35O            #
>> # Antenna&  Mechanical Simulation Grp #    Email: john.foley at motorola.com #
>> # Motorola, Inc. -  Mobile Devices    #    Phone: (847) 523-8719          #
>> # 600 North US Highway 45             #      Fax: (847) 523-5767          #
>> # Libertyville, IL. 60048  (USA)      #     Cell: (847) 460-8719          #
>> ###########################################################################
>>                (this email sent using SeaMonkey on Windows)
>>
>> ------------------------------------------------------
>> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=254658
>>
>> To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].
>>
>
> ------------------------------------------------------
> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=254665
>
> To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].



-- 
###########################################################################
# John Foley                          # Location:  IL93-E1-21S            #
# IT & Systems Administration         # Maildrop:  IL93-E1-35O            #
# Antenna & Mechanical Simulation Grp #    Email: john.foley at motorola.com #
# Motorola, Inc. -  Mobile Devices    #    Phone: (847) 523-8719          #
# 600 North US Highway 45             #      Fax: (847) 523-5767          #
# Libertyville, IL. 60048  (USA)      #     Cell: (847) 460-8719          #
###########################################################################
               (this email sent using SeaMonkey on Windows)

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=254672

To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].



More information about the gridengine-users mailing list