Skip to content

x/build/env/linux-arm64/packet: all builders down #32543

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
dmitshur opened this issue Jun 11, 2019 · 2 comments
Closed

x/build/env/linux-arm64/packet: all builders down #32543

dmitshur opened this issue Jun 11, 2019 · 2 comments
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. Soon This needs action soon. (recent regressions, service outages, unusual time-sensitive situations)
Milestone
Unreleased

Comments

@dmitshur
Copy link
Contributor

According to https://farmer.golang.org/#health, all the Packet linux/arm64 machines are missing (as of 3 hours ago):

I will be looking into this soon.
@dmitshur dmitshur added Builders x/build issues (builders, bots, dashboards) NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. Soon This needs action soon. (recent regressions, service outages, unusual time-sensitive situations) labels Jun 11, 2019
@dmitshur dmitshur added this to the Unreleased milestone Jun 11, 2019
@dmitshur dmitshur self-assigned this Jun 11, 2019
@dmitshur
Copy link
Contributor Author

sshing into the server times out:

$ ssh -v -i ~/.ssh/id_ed25519_golang1 [email protected]
[...]
ssh: connect to host 147.75.74.194 port 22: Operation timed out

Pinging it times out too:

$ ping 147.75.74.194
PING 147.75.74.194 (147.75.74.194): 56 data bytes
Request timeout for icmp_seq 0
Request timeout for icmp_seq 1
Request timeout for icmp_seq 2
Request timeout for icmp_seq 3

This appears to be very similar to the last time packet builders had a problem in issue #31112.

@dmitshur
Copy link
Contributor Author

I've restarted the server and that fixed the issue (just like in #31112).

It took a few minutes for it to fully restart, but then it became responsive to pings, ssh, and all the packet builders are up and connected now:

@dmitshur dmitshur mentioned this issue Jul 10, 2019
Closed
@dmitshur dmitshur mentioned this issue Nov 20, 2019
Closed
@dmitshur dmitshur mentioned this issue Feb 22, 2020
Closed
@dmitshur dmitshur mentioned this issue Mar 18, 2020
Closed
@golang golang locked and limited conversation to collaborators Jun 10, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. Soon This needs action soon. (recent regressions, service outages, unusual time-sensitive situations)
Projects
None yet
Milestone
Unreleased
Development

No branches or pull requests
2 participants
@dmitshur @gopherbot