Some systems are experiencing issues

About This Site

This is the status page of the openSUSE infrastructure team, where you can get updates on how our systems are doing. If there are interruptions to service, we will post a note here.

As always, if you are experiencing any issues with the openSUSE infrastructure, don't hesitate to get in touch with us at admin@opensuse.org or via #opensuse-admin on Libera and we'll get back to you as soon as we can.

We will schedule and contain any maintenance it deems as Major to the following time:

Thursday, 08:00 - 10:00 CET for all openSUSE Services

Maintenance
Infrastructure migration - Jenkins

The Jenkins server hosting ci.opensuse.org will move to a new location. Due to the service not being actively used, it will be migrated but only brought back up with low priority.

Edit: The machines have been shut down at the old location.

Infrastructure migration - Jitsi

The Jisti instance at meet.opensuse.org will be migrated to a new location, downtime is to be expected.

Edit: The migration is in progress. Edit 2: Progress is made on meet-test.opensuse.org. Until finalized, meet.opensuse.org will redirect there.

Past Incidents

27th August 2018

Mirror overview rsync.opensuse.org unexpected outage

UPDATE 2: The service is up and running again

UPDATE: The server is facing HW issues. We are working on the replacement, but unfortunately it will take some time. We don't have any ETA yet either, but we'll let you know here as soon as we have news

The server that hosts rsync.opensuse.org has unexpectedly gone offline. It is a physical server, hosted on a sponsor's datacenter. We are in communication with the sponsor, but unfortunately there is no ETA yet on when it will be back

15th August 2018

openQA openqa.opensuse.org often responds with 504 Gateway Time-out and is experiencing connectivity problems to its workers

Currently the web UI component of openqa.opensuse.org often responds with "504 Gateway Time-Out" and is experiencing connectivity problems to its workers. We are investigating the issue which seems to be related to network problems.

Updated from "Partial Outage" to "Performance Issues" as we are back to a mainly stable state which we have under control with a reduced set of active workers.

We will shutdown the machine o3 and bring it up with more cores in the next minutes. o3 is back, picked up jobs, continuing the monitoring.

All problems resolved. Risk mitigation improvements have been implemented or are planned to be implemented in the future.

See https://progress.opensuse.org/issues/39743 for details.

4th August 2018

Pastebin paste.opensuse.org broken by cookies from other *.opensuse.org subdomains

UPDATE: A fix has been applied on the paste.opensuse.org side

paste.opensuse.org currently gets broken by cookies from other *.opensuse.org subdomains and only prints a Disallowed Key Characters. error message.

Workarounds:

  • open paste.opensuse.org in a private browser window or
  • use susepaste.org. For existing links to paste.opensuse.org, replacing the domain with susepaste.org will work and give you the pasted content

UPDATE:

It turned out that news.opensuse.org and lizards.opensuse.org send out cookies with a cookie domain of "*.opensuse.org", and one of these cookies breaks paste.opensuse.org.

We'll restrict the cookie domain, but until this is done, you can delete your news.opensuse.org cookies to "fix" paste.opensuse.org. Note that this will only last until you visit news.opensuse.org again (until we have fixed the cookie domain there).

UPDATE:

These cookies get sent by more services - we are aware of www.opensuse.org, news.o.o, lizards.o.o, bugzilla and forums.o.o. Follow https://progress.opensuse.org/issues/40025 for more technical details.

UPDATE:

This was fixed on paste.opensuse.org