[GE dev] Where to start?

kartik rustagi kashes911 at gmail.com
Fri Dec 19 17:42:58 GMT 2008


Hello everyone. I had a chat with some people on the #sge IRC channel.
Earlier responses from this mailing list pointed me to the various
areas in which we could work. I hope people here would be kind enough
to tell us some ideas (including the ones I'm mentioning below) which
could be completed in a time frame of 4-5 months, from someone who is
new to the codebase.
1. First major idea that was interesting was the replacement of qmon(
suggested to us via IRC).  But since an entire replacement is a huge
project, could anyone please tell us any sub-portion of the project
which we could complete in the given time frame?
2. Secondly we were interested in the execution daemon. Now getting
familiar with such a huge source code itself could eat into a major
chunk of the time allotted to us, is there any task that needs to be
done here, and which might involve a certain level of abstraction over
the source code (so that its doable :-)  )?
3. Improving the web interface, sounds cool. Would it use up 4-5 months?

ps:- Are there rss feeds for job status

Regards,
Kartik

On Thu, Dec 11, 2008 at 2:39 PM, kartik rustagi <kashes911 at gmail.com> wrote:
> ---------- Forwarded message ----------
> From: kartik rustagi <kashes911 at gmail.com>
> Date: Tue, Dec 9, 2008 at 11:51 PM
> Subject: Re: [GE dev] Where to start?
> To: dev <dev at gridengine.sunsource.net>
>
>
> Thanks ron for your reply. I have mailed Dan and I am going through
> and trying to 'understand' the conversation <
> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=88197>
>
> Can you or any one else comment on the rest of the ideas I mentioned
> in my last mail.
> I will appreciate that.
> Waiting for replies.
> Thanks
>
> On Fri, Dec 5, 2008 at 11:47 AM, ron <ron_chen_123 at yahoo.com> wrote:
>> --- On Wed, 12/3/08, kartik rustagi <kashes911 at gmail.com> wrote:
>>> 1.DRMAA Web Services Specification and Binding
>>> What exactly related to DRMAA needs to be done here. Any
>>> particular person I should contact regarding this.
>>
>> You should contact Daniel:
>>
>>  Dan.Templeton AT sun DOT com
>>
>> And you can read his blog:
>>
>>  http://blogs.sun.com/templedf/
>>
>> Or watch his video:
>>
>> http://www.youtube.com/watch?v=bFx78OD27CQ
>>
>>
>>> 4.Integration with a VMM (such as Xen) to dynamically set
>>> up an
>>> execution environment (in the form of a virtual machine)
>>> before running a job
>>> Will this be done using libvirt or is libvirt the solution
>>> to this problem.
>>
>> May be you can start with reading the discussions we had before:
>>
>> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=88197
>> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=88300
>>
>>
>>>
>>> 5.IPv6 support
>>
>> If I recall correctly, there are a few places (may be less than 2 or 3 files) in the communication library that need to be modified to support IPv6.
>>
>> You can find the library in: gridengine/source/libs/comm
>>
>>
>>> Regarding my machine having IPMI, I dont think it will have
>>> IPMI. Its
>>> a dell laptop. Still I have writen a mail to Dell asking
>>> about it.
>>
>> Sadly, laptops typically don't have IPMI :|
>>
>>>
>>> And I find working for execution deamon and qmaster deamon
>>> interesting too.
>>
>> I think the execution daemon is easier to modify.
>>
>> Daniel has some articles at:
>>
>> http://blogs.sun.com/templedf/category/Grid
>>
>> And I like this one the most:
>>
>> http://blogs.sun.com/templedf/entry/how_jobs_get_executed
>>
>>  -Ron
>>
>>
>>> So the thing is I find most of the ideas you have given
>>> interesting.
>>> Now I wish to be associated with SGE for a long period of
>>> time,
>>> outside the time scope of this competition. And the thing
>>> is I am not
>>> able to measure the amount of time each of these ideas will
>>> take to be
>>> implemented.
>>> I choose SGE because of my general interest in Grid
>>> computing. And
>>> since you people have more knowledge regarding the code
>>> base of SGE it
>>> will be great if you people can suggest me projects i
>>> should work
>>> upon( can be more that 1 project too) which can be
>>> completed in these
>>> 4-5 months including understanding the required code base.
>>>
>>> As far as my skills go, I am comfortable in c/c++, python,
>>> HTML and
>>> javascript. I haven't learn java till now, but if any
>>> of the project
>>> requires quite a lot of work in java i will learn it too.
>>>
>>> ps:- The website of the competition i am participating in
>>> quotes that
>>> "it should not be bug fixes and should i require
>>> substantial amount of
>>> coding or/and research"
>>> Waiting for replies
>>>
>>>
>>> On Fri, Nov 28, 2008 at 10:10 PM, kartik rustagi
>>> <kashes911 at gmail.com> wrote:
>>> > ohk finally exams over , now i am for grid 24*7.....
>>> will check out
>>> > the ideas both of you(rayson and reuti) and get back
>>> to you guys soon
>>> >
>>> >
>>> > On Sun, Nov 23, 2008 at 12:41 AM, reuti
>>> <reuti at staff.uni-marburg.de> wrote:
>>> >> Hi,
>>> >>
>>> >> some issues might fall into the set timeframe and
>>> would be of common
>>> >> interest to be implemented (I hope). Maybe some
>>> are even interesting
>>> >> for you, if you just want to pick a specific one:
>>> >>
>>> >> 1)
>>> http://gridengine.sunsource.net/issues/show_bug.cgi?id=2808
>>> (limit
>>> >> the job count per user in an RQS)
>>> >>
>>> >> 2)
>>> http://gridengine.sunsource.net/issues/show_bug.cgi?id=2147
>>> (jobs
>>> >> as a who clause in an RQS)
>>> >>
>>> >> 3)
>>> http://gridengine.sunsource.net/issues/show_bug.cgi?id=2087
>>> (not
>>> >> enforced custom time-limit)
>>> >>
>>> >> 4)
>>> http://gridengine.sunsource.net/issues/show_bug.cgi?id=1116
>>> (sort
>>> >> qstat by parallel job)
>>> >>
>>> >> 5)
>>> http://gridengine.sunsource.net/issues/show_bug.cgi?id=2554
>>> >> (header for qstat of the listed user range)
>>> >>
>>> >> 6) Repair user-mapping and implement group-mapping
>>> >>
>>> >> Maybe someone with a deep insight of the SGE
>>> source might judge,
>>> >> whether some of these would be an appropriate
>>> project.
>>> >>
>>> >> -- Reuti
>>> >>
>>> >>
>>> >>
>>> >> Am 22.11.2008 um 17:26 schrieb rayson:
>>> >>
>>> >>> (Moving the discussion back to the list)
>>> It's great that you are
>>> >>> interested in the SGE project!!
>>> >>>
>>> >>> There are some materials that I think are
>>> quite useful to the first
>>> >>> time SGE developer:
>>> >>>
>>> >>> In the 2002 workshop:
>>> >>> - Working in the Grid Engine Project Part I
>>> >>> - Working in the Grid Engine Project Part II
>>> >>>
>>> >>> And other PDFs are available from the Grid
>>> Engine workshops:
>>> >>>
>>> >>> http://gridengine.sunsource.net/workshop.html
>>> >>>
>>> >>>
>>> >>> As for picking a project, since SGE is an
>>> application that is quite
>>> >>> complex, the answer to "where to
>>> start?" depends on what you are
>>> >>> interested in.
>>> >>>
>>> >>> - if you are interested in low-level Unix
>>> programming, then you can
>>> >>> start with working on the execution daemon,
>>> which is responsible for
>>> >>> starting SGE jobs.
>>> >>>
>>> >>> - if you are interested in scheduling, you can
>>> start with the qmaster
>>> >>> daemon and scheduler module.
>>> >>>
>>> >>> - if you are interested in data center issues
>>> and have access to a
>>> >>> machine that has IPMI, then you can also work
>>> with Ron and I on the
>>> >>> power saving project.
>>> >>>
>>> >>> - if you are interested in web stuff (eg.
>>> AJAX), you can take a look
>>> >>> at the xml-qstat project.
>>> >>>
>>> >>> And we have a few Google Summer of Code
>>> proposals at: (the
>>> >>> gridengine.info site is currently down, so you
>>> may need to wait for a
>>> >>> day or two before it comes back up)
>>> >>>
>>> http://wiki.gridengine.info/wiki/index.php/GSoCIdeas
>>> >>>
>>> >>> And lastly, we have a few packaging effort
>>> going on, including the
>>> >>> Debian & Redhat RPM projects.
>>> >>>
>>> >>> Rayson
>>> >>>
>>> >>>
>>> >>>
>>> >>> On 11/22/08, kartik rustagi
>>> <kashes911 at gmail.com> wrote:
>>> >>>> yeah definately. Can you help me start?
>>> >>>>
>>> >>>> On Sat, Nov 22, 2008 at 3:57 AM, Rayson Ho
>>> <rayrayson at gmail.com>
>>> >>>> wrote:
>>> >>>>> Hi,
>>> >>>>>
>>> >>>>> Are you still interested in doing a
>>> project in SGE??
>>> >>>>>
>>> >>>>> rayson
>>> >>>>>
>>> >>>>>
>>> >>>>> On 11/13/08, kartik rustagi
>>> <kashes911 at gmail.com> wrote:
>>> >>>>>> Hi, I am a Engineering student
>>> having quite a lot of interest in
>>> >>>>>> Grid
>>> >>>>>> computing and want to work in this
>>> field. Being an open source
>>> >>>>>> fanatic
>>> >>>>>> I think Grid Engine is the project
>>> where I can contribute. I
>>> >>>>>> will be
>>> >>>>>> having my winter break in the
>>> month of December and January and
>>> >>>>>> would
>>> >>>>>> like to dedicate these and the
>>> following 2-3 months to grid. I
>>> >>>>>> would
>>> >>>>>> like to work for Grid Engine as a
>>> part of "Code For Freedom"
>>> >>>>>> organized
>>> >>>>>> by Sun
>>> <http://in.sun.com/communities/univ/codeforfreedom/> .
>>> >>>>>> Can any
>>> >>>>>> Gris developer please help me in
>>> choosing a project which i
>>> >>>>>> could work
>>> >>>>>> upon. I am very comfortable in
>>> working in c/c++. Waiting for a
>>> >>>>>> reply.
>>> >>>>>>
>>> >>>>>> ps:- Aint Grid Engine on irc?
>>> >>>>>>
>>> >>>>>>
>>> ------------------------------------------------------
>>> >>>>>>
>>> http://gridengine.sunsource.net/ds/viewMessage.do?
>>> >>>>>> dsForumId=39&dsMessageId=88694
>>> >>>>>>
>>> >>>>>> To unsubscribe from this
>>> discussion, e-mail: [dev-
>>> >>>>>>
>>> unsubscribe at gridengine.sunsource.net].
>>> >>>>>>
>>> >>>>>
>>> >>>>
>>> >>>
>>> >>>
>>> ------------------------------------------------------
>>> >>>
>>> http://gridengine.sunsource.net/ds/viewMessage.do?
>>> >>> dsForumId=39&dsMessageId=89501
>>> >>>
>>> >>> To unsubscribe from this discussion, e-mail:
>>> [dev-
>>> >>> unsubscribe at gridengine.sunsource.net].
>>> >>
>>> >>
>>> ------------------------------------------------------
>>> >>
>>> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=39&dsMessageId=89510
>>> >>
>>> >> To unsubscribe from this discussion, e-mail:
>>> [dev-unsubscribe at gridengine.sunsource.net].
>>> >>
>>> >
>>>
>>> ------------------------------------------------------
>>> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=39&dsMessageId=90843
>>>
>>> To unsubscribe from this discussion, e-mail:
>>> [dev-unsubscribe at gridengine.sunsource.net].
>>
>> ------------------------------------------------------
>> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=39&dsMessageId=91278
>>
>> To unsubscribe from this discussion, e-mail: [dev-unsubscribe at gridengine.sunsource.net].
>>
>

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=39&dsMessageId=93417

To unsubscribe from this discussion, e-mail: [dev-unsubscribe at gridengine.sunsource.net].



More information about the gridengine-users mailing list