This will affect uk1-pn, uk1-adj and a very small number of dedicated server customers.

We are going to be performing some maintenance soon, the details are as follows.Maintenance Type:                  Network Maintenance
Expected effect on your service:  No network access
Expected duration:                30 seconds
This will occur between:          23:00 on Tuesday 20th Oct 2009 and 05:00 on Wednesday 21st Oct 2009  (All times are UK)
Area affected:                    RSH.North from our Maidenhead Datacentre

The nature of the maintenance window is to reconfigure the core routers as a VSS-1440 cluster. This will provide an increase in redundancy for your service and will provide additional capacity in terms of port aggregation and network resilience. The migration has been carefully planned and we are using the multiple uplinks that each rack has to stage the process and minimise the impact to service.

All of the racks in our Spectrum House data centre have two uplinks. During the 30 second window each rack will, in-turn, have one uplink migrated to the chassis that is configured as a cluster. The link connected to the existing configuration will then be shut down.
Once all the racks are connected to the cluster chassis, the secondary chassis will be configured as part of the cluster. At this point the secondary ports will be brought back online and a fully redundant configuration will once again be achieved.

The issues previously experienced with the Cisco systems have been completely ironed out and we are confident that this work will be the last major network maintenance for the foreseeable future. We have, however, prepared the process so that a complete rollback is quick and easy to achieve should it be required.

We apologise for any inconvenience this may cause and we would like to reiterate at this time that the patience shown by all clients continues to be much-appreciated. Please do not hesitate to contact us if you have any queries or questions regarding this maintenance window.

We will be performing maintenance which will put your service in an at risk period. This will last about 60 minutes, and during this time, your service is running at a higher risk of interruption if a failure occurs.

Date: 14 October 2009
Window: 16:00 for 2 Hours
Duration: < 60 minutes

This maintenance is to improve the network and is necessary under our programme for increasing the reliability and redundancy of the network.

This will not have any impact on the service.

We are still experiencing issues on one of our UK networks. This will be affecting uk1-pn (shoutcast) and possibly uk1-adj (autodj). We do apologise for the problems over the last day or two, but the network providers are working very hard to get this resolved, they have been working on it all through the night since about 11pm last night.

I’ll post any updates here.

UPDATE 13:08: I can confirm that the issue is NOT affecting uk1-adj – only uk1-pn and one dedicated server customer who will be contacted shortly.

UPDATE 14:26: Annoyingly, I’ve just found out from a third party source that there will be another 90 minutes of downtime on the whole network, so this will affect uk1-adj as well. It’s not good that they are doing it at this time in the day, but it must have been the only option.

We have just received this message from one of our suppliers. This only affects customers on uk1-pn, uk1-adj and a small number of dedicated server customers.

We need to perform some emergency network as soon as possible. This has been scheduled for tonight, which we appreciate is very short notice. We need to reboot a router to install new software, and this reboot will take up to 45 minutes. We will do everything we can to speed up the process as much as we can and reduce the maintenance time.

Date: 24/09/2009
Window: 23:00 for 2 hours
Duration: < 45 minutes.

The maintenance is to perform an emergency upgrade of Cisco software. We are using a Cisco VSS-1440 as part of our network core, and we have been experiencing some reduced performance with it today. There is no cause within our network configuration and set up of this, and it started to have a detrimental effect on some clients today. We escalated this to the Cisco TAC team, who have diagnosed a fault with the software on the router in the form of a memory leak. Cisco has supplied us with a new version of the software for the router which will fix the memory leak and slow performance.

The nature of this problem is that it will escalate as time goes on, which is why we want to apply the fix as soon as core business hours finish today. Please accept our apologies for the short notice, we hope our clients appreciate this problem was out of our control caused by Cisco software, and we are working as best we can to resolve it quickly.

We apologise for any inconvenience this may cause, please do not hesitate to contact us if you have any queries or questions regarding this maintenance window.

UPDATE 01:56: It looks like the network is coming back up now, it took longer than expected so I’ll post any updates in the morning.

We are looking in to the issue affecting uk1-pn, which has just gone down. Updates will be posted here.

UPDATE 12:51: The datacentre staff are aware of an issue, so it sounds like a network problem. They are working to get this fixed asap,

UPDATE 12:54: Server is back online, downtime lasted about 10 minutes.

We will be performing maintenance which will affect your service. This will last about 30 seconds, and during this time, your server will unreachable via the network.

Date: 23/09/2009
Window: 23:00 for 2 hours
Duration: < 2 minutes.

In order to minimise the time needed to move the servers to our new facility, the VLAN this subnet is configured on has been spanned across the two locations. The maintenance is to move your subnet onto the router on our new facility.

The subnet affected is: 87.117.208.0/24

Servers affected: uk1-pn.mixstream.net

There was a network connectivity outage on 09/09/2009, which started at approximately 23:15 PM, following the network maintenance window. The outage lasted for approximately 6 minutes. According to the network admins, the issue appears to have resurfaced, although it doesn’t seem to be affecting any of our streams.

Date: 09/09/09
Time: 23:15
Duration: <10 minutes Date: 10/09/09 Time: 12:45 Duration: Ongoing

This is a very important email, please read it carefully and ask us about it if you have any questions. We will be performing maintenance which will affect your service. This will last about 30 minutes, and during this time, your service will go offline.

Date: 22 July 2009
Window: 02:00 for 2 Hours
Duration: < 30 minutes This maintenance is to create a high availability cluster on our RSH.North core router, from our new Maidenhead facility. The cluster will increase the availability by providing redundant chassis and redundant processing, and each edge switch will be connected to both chassis via two separate uplinks. Thus, in the event of chassis failure, the traffic will not be affected, as the load will be taken over by the active chassis. This is the last maintenance window for a long period of time, as this will enable us to implement end to end redundant connections, and in the event of a failure anywhere on the line, this should be completely transparent to our clients. We apologise for any inconvenience this may cause, please do not hesitate to contact us if you have any queries or questions regarding this maintenance window.

We will be performing maintenance which will affect your service. This will last about 20 minutes, and during this time, your service will go offline.

Date: 21 July 2009
Window: 02:00 for 1 Hour
Duration: < 20 minutes This maintenance is to upgrade the IOS firmware on our RSH.North core router, from our new Maidenhead facility. Currently the network is configured with dual uplinks from our core router to the edge switches in each rack. This upgrade will enable clustering capabilities on the core router and once the core router will be configured as a cluster, it will increase the availability of the service in case of a core router failure. This affects anyone on the Shoutcast server UK1-PN and some dedicated server customers. Please open a support ticket if you are unsure. We apologise for any inconvenience this may cause, please do not hesitate to contact us if you have any queries or questions regarding this maintenance window.

We will be performing some scheduled data centre maintenance, which creates an “at risk” period for your service. This maintenance is not service affecting and there should be no noticeable impact. However, during the maintenance period your service is at an increased risk.

Date: 22/06/09
Time: 08:00 for 7 hours

The maintenance is related to the UPS system in Spectrum House, and during the maintenance period the UPS will be taken off-line and electrical testing completed. This is a standard maintenance item and there should be no cause for concern. During the maintenance period the critical load will be transferred seamlessly from the UPS to the raw mains, and then when the maintenance is complete it will be transferred back seamlessly.

We have confirmed with Southern Electric that they have no maintenance scheduled during this period.

If you have any questions about this, please do not hesitate to get in touch.