Skip to content

x/build/builders: move FreeBSD builders to GCE #8639

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
bradfitz opened this issue Sep 3, 2014 · 6 comments
Closed

x/build/builders: move FreeBSD builders to GCE #8639

bradfitz opened this issue Sep 3, 2014 · 6 comments
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge OS-FreeBSD
Milestone
Unreleased

Comments

@bradfitz
Copy link
Contributor

bradfitz commented Sep 3, 2014 

This bug is about moving the FreeBSD builders to GCE per the document
http://golang.org/s/builderplan

For FreeBSD it looks like we can use http://mfsbsd.vx.sk/ to prepare a FreeBSD image
that boots, does a single build (in memory), and then shuts down.

See:
https://groups.google.com/forum/#!msg/gce-discussion/YWoa3Aa_49U/1MfTsmgoaNkJ
@bradfitz
Copy link
Contributor Author

bradfitz commented Sep 3, 2014

Comment 1:

More details are in issue #8642 about OpenBSD, which will be the same thing essentially.
mfsBSD is just the tool we'll use to prepare the bootable image described in issue #8642.

@bradfitz
Copy link
Contributor Author

bradfitz commented Sep 4, 2014

Comment 2:

Labels changed: added builder.

bradfitz added a commit to golang/tools that referenced this issue Dec 30, 2014
@bradfitz
dashboard/buildlet: start of the buildlet
9c946b9 
This is the basics: untar a tar.gz file to a directory, and execute a
command.

Update golang/go#8639
Update golang/go#8640
Update golang/go#8642

Change-Id: I5917ed8bd0e4c2fdb4b3fab34ca929caca95cc8a
Reviewed-on: https://go-review.googlesource.com/2180
Reviewed-by: Andrew Gerrand <[email protected]>
bradfitz added a commit to golang/tools that referenced this issue Jan 2, 2015
@bradfitz
dashboard/coordinator: periodically clean stale VMs
005d2be 
This isn't used yet, but will be for the new-style builders (VMs on
GCE running the buildlet, started by the coordinator).

From the code's comments:

cleanUpOldVMs periodically enumerates virtual machines and deletes
any which have a "delete-at" attribute having a unix timestamp
before the current time. These VMs are created to run a single
build and should be shut down by a controlling process. Due to
various types of failures, they might get stranded. To prevent them
from getting stranded and wasting resources forever, we instead set
the "delete-at" metadata attribute on them when created to some
time that's well beyond their expected lifetime, and then this is
the backup mechanism to delete them if they get away.

Update golang/go#8639
Update golang/go#8640
Update golang/go#8642

Change-Id: I489e97926e7ab56487571c2bf0bd255cdf49570d
Reviewed-on: https://go-review.googlesource.com/2199
Reviewed-by: Burcu Dogan <[email protected]>
@bradfitz bradfitz mentioned this issue Jan 2, 2015
Closed
@bradfitz bradfitz mentioned this issue Jan 18, 2015
Closed
@wathiede
Copy link
Contributor

Is the goal to have all the FreeBSD versions Go supports running as builders? I know GCE had (has?) some problems with versions prior to 10, largely disk related. Building from RAM might make pre-10 FreeBSD usable, but there could still be challenges getting it to booted far enough to build.

@adg
Copy link
Contributor

adg commented Jan 19, 2015

I'm happy to just build against FreeBSD 10+, although the current builders
are running 9.1.

For the older versions, maybe we could run them (really slowly) inside qemu
on gce?

On 18 January 2015 at 16:36, Bill [email protected] wrote:

Is the goal to have all the FreeBSD versions Go supports running as
builders? I know GCE had (has?) some problems with versions prior to 10,
largely disk related. Building from RAM might make pre-10 FreeBSD usable,
but there could still be challenges getting it to booted far enough to
build.

—
Reply to this email directly or view it on GitHub
#8639 (comment).

@bradfitz
Copy link
Contributor Author

Let's start with FreeBSD 10 on GCE running the buildlet. We can run older versions elsewhere (RootBSD, AWS) too, but they won't be available via gomote and such.

@bradfitz
Copy link
Contributor Author

@wathiede sent https://go-review.googlesource.com/#/c/3053/

bradfitz added a commit to golang/build that referenced this issue Jan 21, 2015
@bradfitz
dashboard/buildlet: start of the buildlet
9571310 
This is the basics: untar a tar.gz file to a directory, and execute a
command.

Update golang/go#8639
Update golang/go#8640
Update golang/go#8642

Change-Id: I5917ed8bd0e4c2fdb4b3fab34ca929caca95cc8a
Reviewed-on: https://go-review.googlesource.com/2180
Reviewed-by: Andrew Gerrand <[email protected]>
bradfitz added a commit to golang/build that referenced this issue Jan 21, 2015
@bradfitz
dashboard/coordinator: periodically clean stale VMs
b52c224 
This isn't used yet, but will be for the new-style builders (VMs on
GCE running the buildlet, started by the coordinator).

From the code's comments:

cleanUpOldVMs periodically enumerates virtual machines and deletes
any which have a "delete-at" attribute having a unix timestamp
before the current time. These VMs are created to run a single
build and should be shut down by a controlling process. Due to
various types of failures, they might get stranded. To prevent them
from getting stranded and wasting resources forever, we instead set
the "delete-at" metadata attribute on them when created to some
time that's well beyond their expected lifetime, and then this is
the backup mechanism to delete them if they get away.

Update golang/go#8639
Update golang/go#8640
Update golang/go#8642

Change-Id: I489e97926e7ab56487571c2bf0bd255cdf49570d
Reviewed-on: https://go-review.googlesource.com/2199
Reviewed-by: Burcu Dogan <[email protected]>
bradfitz added a commit to golang/build that referenced this issue Jan 22, 2015
@bradfitz
all: add env support, freebsd-386, freebsd-amd64-race, re-enable plan9
32d0520 
Update golang/go#9491
Update golang/go#8639

Change-Id: I1f43c751777f10a6d5870ca9bbb8c2a3430189bf
Reviewed-on: https://go-review.googlesource.com/3170
Reviewed-by: Andrew Gerrand <[email protected]>
@rsc rsc removed the os-freebsd label Apr 10, 2015
@rsc rsc added this to the Unplanned milestone Apr 10, 2015
@rsc rsc removed accepted labels Apr 14, 2015
@rsc rsc changed the title builders: move FreeBSD builders to GCE x/build/builders: move FreeBSD builders to GCE Apr 14, 2015
@rsc rsc modified the milestones: Unreleased, Unplanned Apr 14, 2015
@rsc rsc added OS-FreeBSD and removed repo-tools labels Apr 14, 2015
@rsc rsc added the Builders x/build issues (builders, bots, dashboards) label Jun 11, 2015
@golang golang locked and limited conversation to collaborators Sep 22, 2016
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge OS-FreeBSD
Projects
None yet
Milestone
Unreleased
Development

No branches or pull requests
5 participants
@bradfitz @rsc @wathiede @adg @gopherbot