Planned Maintenance - Leeds Datacentre Fibre

22:00 and 23:00 on the 28th August 2014

One of the fibre providers serving our Leeds datacentre has advised us that they will be physically re-routing their fibre into the facility due to a widening scheme on the A61 at Tankersley requiring the fibre to be cut and relocated. 

This work has been planned to occur between 22:00 and 23:00 on the 28th August 2014.

The datacentre has multiple fibre providers onsite, as such this work is not service affecting but connectivity into the Leeds datacentre should be considered "at risk" during this window.

[CLOSED] Planned Works notification - 17th July 2014

We have been advised by one of our transit providers that they will be carrying out maintenance between 02:00 and 06:00 GMT on the 17th July 2014.

This work is expected to cause an outage during the above window, but is not deemed service affecting as our network operates with multiple transit providers for redundancy.

You may experience brief route changes and increased latency as the network routes around this.

If you have any questions regarding this, please don't hesitate to contact our support desk who will be happy to assist you.

[CLOSED] Planned Works notification - 10th July 2014

We have been advised by one of our transit providers that they will be carrying out maintenance between 01:00 and 02:00 GMT on the 10th July 2014.

This work is expected to cause an outage during the above window, but is not deemed service affecting as our network operates with multiple transit providers for redundancy.

You may experience brief route changes and increased latency as the network routes around this.

If you have any questions regarding this, please don't hesitate to contact our support desk who will be happy to assist you.

[CLOSED] Incoming & Outgoing Mail Issues

--------------------------------------------

UPDATE - 10:15 21st March 2014: Our servers are now successfully accepting e-mails and normal service has resumed.

--------------------------------------------

UPDATE - 10:00 21st March 2014: Engineers are still working to stabilise the platform and have made a number of changes which will improve the situation for many customers.

If you are sending out e-mail via ourselves, but experiencing a problem please change your outgoing SMTP server to relay.mailbox.net.uk to make use of a dedicated platform we've put in place for this.

We continue to put all resources available into the problem, and will provide another update in 1 hour.

--------------------------------------------

09:00 20th March 2014 - We are aware of an intermittent problem affecting inbound and outgoing e-mails. Engineers are working to restore normal service.

We apologise to all customers affected by this.

[CLOSED] Hosting Outage - 212.85.249.130

Update: Normal service has been restored. 

Engineers are aware of an outage affecting hosting services that reside on 212.85.249.130, and are working to restore service as quickly as possible.

[CLOSED] LLU outage on 21st January

We have been notified by our LLU supplier that they will be carrying out planned maintenance which will cause an outage for customers during the following window:

Start: Monday 21st January 2013, 23:00 GMT
End: Tuesday 22nd January 2013, 06:00 GMT

They will carry out the work as quickly as possible to minimise the downtime, and restore normal service as soon as possible.

We apologise to affected customers for any inconvenience caused.

[CLOSED] Network at risk notification

Our monitoring has detected a fault on one of our host links into the BT Wholesale network, and the link itself is currently down.

Traffic is routing correctly over the alternative host link and whilst there is no impact to service you should treat BT based DSL connections "at risk" until redundancy is restored.

BT Wholesale are investigating, and an update will be provided once we have further details.

[CLOSED] BT Wholesale 20CN / 21CN Outage

-------------------------------------------------------------------------------


UPDATE 12:59 - Normal service has been restored.


-------------------------------------------------------------------------------


UPDATE 12:30 - BT have dispatched an engineer to the affected location to restore service, next update due in 1 hour, or sooner if service is restored.


-------------------------------------------------------------------------------


UPDATE 11:50 - BT Wholesale are working to restore service, the next update is due within 1 hour.


-------------------------------------------------------------------------------


11.30 - We've just seen a number of ADSL connections drop, and believe there is a major BT Wholesale outage - we're making contact with them to see what is going on and will post an update once we receive it.


-------------------------------------------------------------------------------

[CLOSED] Emergency Network Maintenance

We will be carrying out emergency network maintenance at 00:00 on the 25th January 2012.

Some customers may experience a brief outage to their DSL service at the above time.

We apologise for the inconvenience caused by this essential work.

[CLOSED] BT Wholesale Issue

-----------------------------------------------


UPDATE 22:30 - Service has been restored.


-----------------------------------------------


UPDATE 21:19 - BT Wholesale confirm they are experiencing a BGP related issue causing this outage.


-----------------------------------------------


BT Wholesale are currently investigating a network outage which is affecting some 20CN circuits. Once we have an update we will inform you.


-----------------------------------------------

[CLOSED] Network Outage

-----------------------------------------------


UPDATE 17:00 - NTL engineers have resolved a provisioning fault on their side which has resolved this issue, the network is no longer deemed "at risk".

-----------------------------------------------


UPDATE 17:00 - An engineer from NTL is due to arrive at Telehouse at appropriately 18:30 to investigate the network link involved in the earlier outage.

-----------------------------------------------

UPDATE 15:55 - Normal service has now resumed, however the network remains at risk until further notice.

----------------------------------------------

We are currently experiencing a network outage, engineers are working on this as a priority, further updates will be posted when we have more information.

We apologise to our affected customers.

[CLOSED] - BT System Issues

BT service was restored at 3am


Any outstanding issues will now be progressed with BT


Apologies for any delays cause by this issue


---------------------------------------------------
Unfortunatley BT have not fixed their issue and the new update time for a fix is 18:30


Apologies for any inconvenience caused
---------------------------------------------------


BT Have stated their internal systems are not expected to be operational before 16:45, however we should receive a further update at approx 14:00

---------------------------------------------------


BT are currently experiencing issues with their internal systems, this has temporarily stopped our ability to raise faults with BT.


The next update is expected at 1pm

[CLOSED] - Intermittent Network Issues

22.50 - The network appears to have stabilised however investigations are still ongoing.


---------------------------------------------------------


Dear Customer,

We are currently experiencing intermittent network issues.

Our network engineers are investigating the cause of this issue.

Once we have an update we will inform you.

The 186k Team

[CLOSED] - Intermittent Network Issues

16:50 - The network outage is confirmed as clear

The problem was caused by heavy load on a core device. This was not correctly reporting. After locating the issue a reboot of the device has fixed the problem. Future monitoring of this device has been amended.

Please accept our sincere aplogies for any inconvenience caused


----------------------------------------------------------

15:40 - The network appears to have stabilised however investigations are still ongoing.

Further updates shortly

----------------------------------------------------------


Dear Customer,

We are currently experiencing intermittent network issues.

Our network engineers are investigating the cause of this issue.

Once we have an update we will inform you.

The 186k Team.

[CLOSED] All BT ADSL lines are down

BT ADSL lines are down
There is a BT outage in Stepeny Green where we (and others) interconnect in to BT.

BT have raised an Incident and are aware of a problem



Update: 9:15
Lines are coming back - most 20cn circuits are back online

For 21CN circuits please power off your router for at least 20 minutes then retest as you may have the BT termination IP address starting 172.*.*.*

Update:12:00
This incident is now closed.

The issue was also reported by ThinkBroadband

http://www.thinkbroadband.com/news/4829-major-broadband-outage.html

[CLOSED] Sheffield Major Service Outage

BT currently have a major outage at Sheffield affecting a large surrounding area of South Yorkshire and the Midlands.

IMT32513/11 21CN CORE/METRO NODE : SHEFFIELD : LOSS OF SERVICE:Service affecting:Total Loss;

Estimated restore time: 14-10-2011 13:20:00


Update


Today 16:25:00 BT confirm that they are aware of the issue, and have re-opened the earilier incident they had.


Update


Today 16:52:00 There appears to be an issue with a card on the BRAS and BT are  currently sourcing a replacement

Estimated Completion Date: 14/10/2011 18:00:00


Update
Lines came back up at approx 8pm on Friday.

[CLOSED] - Telephone Problems

Dear Customer,


We are currently experiencing intermittent issues with our phone system, some calls will be held within the queue but not answered.

During this issue please use the premier@186k.co.uk email address as the primary contact method.

Kind regards,
The 186k Team

[CLOSED] - BT Wholesale 21cn Outage

BT are currently investigating an outage affecting 21cn circuits in and around the London area.


There was an network drop this morning (BRAS-RED1-L-FAR) and a number of lines failed to reconnect, this is being treated an a BT internal incident.


We are awaiting information from BT


Kind regards,


Support.




---------------



We are now seeing affected lines reconnecting, however we are awaiting a report from BT.


Some routers may need to be power cycled to aid reconnection.

[CLOSED] BT 20CN CONNECTIVITY ISSUES

At 12:20 pm we recieved the following from BT.....

We are currently experiencing difficulties with 20 CN Broadband, that may cause a small portion of your customers on the IPStream product to experience a loss of PPP Connectivity


Work has commenced to restore service, with DLM being temporarily suspended to avoid any further disruption to End User Service.

A script is being run to repair corrupted records, then all impacted circuits will be forced back through DLM to restore service. At this stage normal DLM will also be put back in to service.

Wholesale Customer Service would like to ask that during this incident, customers do not contact BT Wholesale to report DLM related Issues.



BT Wholesale regrets any inconvenience this may cause you and will keep you updated within 2 hours.


[16:30] - update from BT

Further to our previous message, our technical teams are still working to fix the system problem on 20CN Broadband Systems.


A script is being run to repair corrupted records, then all impacted circuits will be forced back through DLM to restore service. At this stage normal DLM will also be put back in to service.

Wholesale Customer Service would like to ask that during this incident, customers do not contact BT Wholesale to report DLM related Issues.

BT Wholesale is working hard to resolve this issue to restore normal service to the application.

BT Wholesale regrets any inconvenience this may cause you and would like to assure customers that we regard the extended unavailability of 20CN Broadband Systems as a high priority and is investigating how we can restore service.

BT Wholesale will provide further updates within 2 hours.


12:40 10th August 2011

We are pleased to report that the DLM service has been


restored to 20CN Broadband Systems.



BT Wholesale regrets any inconvenience which may have been

caused by these issues.

[CLOSED] BT WHOLESALE SYSTEM FALIURES

At 8:50am this morning we have recieved the following from BTW.....

BT WHOLESALE - MULTIPLE WHOLESALE SYSTEMS

We are currently experiencing a Major Service Failure

impacting a number of BT Wholesale Applications, including our
telephony System.

This means that we are unable to take calls from customers,
and provide updates on Orders, Faults or System Issues.

This is being investigated at the highest priority, and work
has commenced to restore service.

BT Wholesale regrets any inconvenience this may cause you and
will keep you updated within 2 hours.

------------------------------------------------------------------

[16:00] 25 July 2011

As in our previous mails, BT Wholesale have suffered a Major Service Failure today impacting a number of BT Wholesale Applications.

Our technical support teams have successfully restored the impacted hardware, which is allowing BT Wholesale and our Supplier to work on a full recovery of service to our customers.

BT Wholesale regrets the inconvenience this may cause you and would like to assure customers that we regard the extended unavailability of Wholesale Systems as a high priority.

A further update will be provided when we have more information regarding levels of service currently available.

Your continued patience during this incident is appreciated.

------------------------------------------------------------------

BT confirm issues resolved at 10pm