|
Replies:
7
-
Last Post:
Mar 28, 2007 12:09 PM
by: stevel
|
|
|
Alexander Kolba...
akolb@eng.sun.com
|
|
|
|
Proposal: new project for improving ON build times
Posted:
Mar 26, 2007 8:25 PM
|
|
I would like to propose a project aimed to improve ON build times. This can
live either under tools or under performance or under some other community.
There was some discussion about it a while ago in the context of Google summer
of code:
http://www.opensolaris.org/jive/message.jspa?messageID=33951
It may be a part of ONNV project, or something else if you think that some
other project/community is more suitable.
The goal of the project is to make our ON builds faster. This includes, but is
not limited to:
- Developing and running observability tools to understand existing problems
and find some low-hanging fruits
- Increasing build parallelism
- Taking advantage of new OpenSOlaris technologies like DTrace and ZFS.
- Cleaning up Makefiles (at least some major Makefile issues)
- Exploring some aggressive tricks and techniques to radically improve build
times
- Exploring various caching approaches.
The goal is to make builds fast enough for developers to be productive. This
is, probably, going to be an open-ended project.
-- Alex Kolbasov
_______________________________________________
opensolaris-discuss mailing list
opensolaris-discuss at opensolaris dot org
|
|
|
Posts:
976
From:
Винницкая область — область на западе Украины. (Vinnitsya, Ukraine)
Registered:
6/14/05
|
|
|
|
Re: Proposal: new project for improving ON build times
Posted:
Mar 26, 2007 9:37 PM
in response to: Alexander Kolba...
|
|
Alexander Kolbasov wrote:
>I would like to propose a project aimed to improve ON build times. This can
>live either under tools or under performance or under some other community.
>
>There was some discussion about it a while ago in the context of Google summer
>of code:
>
>http://www.opensolaris.org/jive/message.jspa?messageID=33951
>
>[...]
>
>
>The goal is to make builds fast enough for developers to be productive. This
>is, probably, going to be an open-ended project.
>
>-- Alex Kolbasov
>
>
+1
(FYI: Even my fastest SPARC, a Sun Blade 2000 / Dual x7017a 1056 MHz /
8GB memory / FC-AL drives, needs about 4 hours currently [for a nightly
non-debug build using Studio11 as primary compiler and using dmake] /
even if the whole workspace sits in physical mem in /tmp/foo plus when
not doing anything else)
GCC shadow compilation added noticable costs:
http://www.opensolaris.org/os/community/tools/gcc/shadow/
One may of course disable it in-house - for one or another personal
build - (Note: I'm very happy, ON can be built with gcc and I understand
that shadow compilation is a good means to keep ON gcc-clean.)
~m
_______________________________________________
opensolaris-discuss mailing list
opensolaris-discuss at opensolaris dot org
|
|
|
|
|
Posts:
196
From:
US
Registered:
3/9/05
|
|
|
|
Re: [perf-discuss] Proposal: new project for improving
ON build times
Posted:
Mar 26, 2007 9:57 PM
in response to: Alexander Kolba...
|
|
Alexander Kolbasov wrote:
> I would like to propose a project aimed to improve ON build times. This can
> live either under tools or under performance or under some other community.
>
> There was some discussion about it a while ago in the context of Google summer
> of code:
>
> http://www.opensolaris.org/jive/message.jspa?messageID=33951
>
> It may be a part of ONNV project, or something else if you think that some
> other project/community is more suitable.
>
> The goal of the project is to make our ON builds faster. This includes, but is
> not limited to:
>
> - Developing and running observability tools to understand existing problems
> and find some low-hanging fruits
>
> - Increasing build parallelism
>
> - Taking advantage of new OpenSOlaris technologies like DTrace and ZFS.
>
> - Cleaning up Makefiles (at least some major Makefile issues)
>
> - Exploring some aggressive tricks and techniques to radically improve build
> times
>
> - Exploring various caching approaches.
>
> The goal is to make builds fast enough for developers to be productive. This
> is, probably, going to be an open-ended project.
>
+1
-Eric
_______________________________________________
opensolaris-discuss mailing list
opensolaris-discuss at opensolaris dot org
|
|
|
|
|
Posts:
72
From:
Registered:
2/15/07
|
|
|
|
Re: [perf-discuss] Proposal: new project for improving
ON build times
Posted:
Mar 26, 2007 10:59 PM
in response to: esaxe
|
|
Very interesting and useful too. I gave up and aborted the build after
ON build kept running for 5 hrs on Solaris on VMWare. If you a create
a separate project, please post it so that we can join the efforts.
Cheers,
-Atul
On 3/27/07, Eric Saxe <eric dot saxe at sun dot com> wrote:
> Alexander Kolbasov wrote:
> > I would like to propose a project aimed to improve ON build times. This can
> > live either under tools or under performance or under some other community.
> >
> > There was some discussion about it a while ago in the context of Google summer
> > of code:
> >
> > http://www.opensolaris.org/jive/message.jspa?messageID=33951
> >
> > It may be a part of ONNV project, or something else if you think that some
> > other project/community is more suitable.
> >
> > The goal of the project is to make our ON builds faster. This includes, but is
> > not limited to:
> >
> > - Developing and running observability tools to understand existing problems
> > and find some low-hanging fruits
> >
> > - Increasing build parallelism
> >
> > - Taking advantage of new OpenSOlaris technologies like DTrace and ZFS.
> >
> > - Cleaning up Makefiles (at least some major Makefile issues)
> >
> > - Exploring some aggressive tricks and techniques to radically improve build
> > times
> >
> > - Exploring various caching approaches.
> >
> > The goal is to make builds fast enough for developers to be productive. This
> > is, probably, going to be an open-ended project.
> >
> +1
>
> -Eric
> _______________________________________________
> opensolaris-discuss mailing list
> opensolaris-discuss at opensolaris dot org
>
_______________________________________________
opensolaris-discuss mailing list
opensolaris-discuss at opensolaris dot org
|
|
|
|
|
Posts:
3,795
From:
GB
Registered:
3/9/05
|
|
|
|
Re: [tools-discuss] Proposal: new project for
improving ON build times
Posted:
Mar 27, 2007 4:07 AM
in response to: Alexander Kolba...
|
|
I fully support this effort but I don't understand why a separate
project repository, webpage and mailing list is required.
This is really just about the build tools and we already have a project
for this.
So I VERY strongly suggest we do NOT create a project for this but
instead using the existing tools-discuss mail alias and get a repository
in the onnv project to host the work in progress.
--
Darren J Moffat
_______________________________________________
opensolaris-discuss mailing list
opensolaris-discuss at opensolaris dot org
|
|
|
|
|
Alexander Kolba...
akolb@eng.sun.com
|
|
|
|
Re: [tools-discuss] Proposal: new project for
improving ON build times
Posted:
Mar 27, 2007 5:01 PM
in response to: darrenm
|
|
> I fully support this effort but I don't understand why a separate
> project repository, webpage and mailing list is required.
>
> This is really just about the build tools and we already have a project
> for this.
>
> So I VERY strongly suggest we do NOT create a project for this but
> instead using the existing tools-discuss mail alias and get a repository
> in the onnv project to host the work in progress.
Someone working on this project may be less interested in the overall
tools-discuss traffic, and I am in favour of separating different things,
although I do not see a problem of this being just a part of tools-discuss and
ONNV project either if owners of both agree with your opinion. As long as the
project has a place to share information in a productive way it is fine.
- akolb
_______________________________________________
opensolaris-discuss mailing list
opensolaris-discuss at opensolaris dot org
|
|
|
|
|
Posts:
824
From:
US
Registered:
3/9/05
|
|
|
|
Re: [tools-discuss] Proposal: new project for
improving ON build times
Posted:
Mar 28, 2007 10:34 AM
in response to: Alexander Kolba...
|
|
>>>>> "akolb" == Alexander Kolbasov <akolb at eng dot sun dot com> writes:
akolb> I do not see a problem of this being just a part of tools-discuss
akolb> and ONNV project either if owners of both agree with your
akolb> opinion.
Keith is the formal owner of tools-discuss. But speaking as one of the
Tools community leaders, I'm okay with the discussion happening on
tools-discuss. That's the list we're using for the SCM transition work,
and it would be good for the two projects to be aware of what each other
is doing.
mike
_______________________________________________
opensolaris-discuss mailing list
opensolaris-discuss at opensolaris dot org
|
|
|
|
|
Posts:
1,156
From:
US
Registered:
3/9/05
|
|
|
|
Re: Re: [tools-discuss] Proposal: new project
for improving ON build times
Posted:
Mar 28, 2007 12:09 PM
in response to: kupfer
|
|
On Wed, Mar 28, 2007 at 10:34:55AM -0700, Mike Kupfer wrote:
> >>>>> "akolb" == Alexander Kolbasov <akolb at eng dot sun dot com> writes:
>
> akolb> I do not see a problem of this being just a part of tools-discuss
> akolb> and ONNV project either if owners of both agree with your
> akolb> opinion.
>
> Keith is the formal owner of tools-discuss. But speaking as one of the
> Tools community leaders, I'm okay with the discussion happening on
> tools-discuss. That's the list we're using for the SCM transition work,
> and it would be good for the two projects to be aware of what each other
> is doing.
Agreed... speaking as the person probably most guilty for filling
tools-discuss with threads related to a project (SCM Migration), it
seems okay to me. ;-)
cheers,
steve
--
stephen lau // stevel at sun dot com | 650.786.0845 | http://whacked.net
opensolaris // solaris kernel development
_______________________________________________
opensolaris-discuss mailing list
opensolaris-discuss at opensolaris dot org
|
|
|
|
|
