Our LLU supplier is currently experiencing issues with their availability checker, this is currently not returning results.
Engineers are investigating this.
-------------------------------
This has now been resolved.
Wednesday, 2 February 2011
Tuesday, 11 January 2011
[CLOSED] - 21CN ADSL Network Outage
We are currently experiencing issues with the 21CN ADSL network, this is under investigation with BT.
This outage is affecting most ISP's.
Once we have an update we will inform you.
Thank you.
186k Support.
----------------------------------------------------------------
Update: 09:06
It has been discovered that "21CN-BRAS-RED2" dropped all lines at approx 04:30 this morning, this has had a knock on affect to other BRAS.
BT are currently working on BRAS-RED2,
We are awaiting further updates.
----------------------------------------------------------------
Update: 10:34
There is no longer an issues with any 21CN BRAS, however BT can see that authentication requests are not reaching ourselves.
BT are working on collapsing the tunnels to ourselves allowing these to re establish and authentication requests to reach our RADIUS.
We are expecting to see connections within the next 30 minutes.
----------------------------------------------------------------
BT are still working on the tunnels allowing authentication requests to reach us.
Please accept our apology for the delay.
----------------------------------------------------------------
It appears the resolution is taking longer than anticipated, we are awaiting an update from BT but will continue to chase this.
Once we have any more information we will inform you.
----------------------------------------------------------------
Update 12:25
Our network engineers have identified the issue within BT's network and are working with BT to resolve the fault, This has been identified as a device configuration error that was highlighted when the tunnels were collapsed, BT are looking at the configuration and will be looking to correct this.
Next update will be in 1 hour (13:25)
Please accept our apologies for the time it has currently taken to resolve this issue.
----------------------------------------------------------------
Update: 13:22
BT Operations are rebuilding the configuration on the device that controls the tunnels, once this configuration is rebuilt it will be loaded onto the device.
The rebuilding and reload will be complete within the next 30 minutes.
We will have an update in 30 minutes (13:52).
----------------------------------------------------------------
Update: 13:52
Configuration has now been reloaded, we now expect users to start connecting, however there will be an initial load on the RADIUS servers so connection could take longer than usual to initiate.
Any users that are receiving the BT holding page will be required to power down their equipment for at least 20 minutes and then attempt to reconnect.
We will monitor the connections and report how this is going in 1 hour (14:52)
Thank you for your patience.
----------------------------------------------------------------
We can see users are now connecting and believe the issue to be resolved.
BT are investigating the issue with the configuration file, once we have the explanation we will update this post (although the post will be closed).
Please accept our apologies for any inconveniences caused during this issue.
186k Support,
This outage is affecting most ISP's.
Once we have an update we will inform you.
Thank you.
186k Support.
----------------------------------------------------------------
Update: 09:06
It has been discovered that "21CN-BRAS-RED2" dropped all lines at approx 04:30 this morning, this has had a knock on affect to other BRAS.
BT are currently working on BRAS-RED2,
We are awaiting further updates.
----------------------------------------------------------------
Update: 10:34
There is no longer an issues with any 21CN BRAS, however BT can see that authentication requests are not reaching ourselves.
BT are working on collapsing the tunnels to ourselves allowing these to re establish and authentication requests to reach our RADIUS.
We are expecting to see connections within the next 30 minutes.
----------------------------------------------------------------
BT are still working on the tunnels allowing authentication requests to reach us.
Please accept our apology for the delay.
----------------------------------------------------------------
It appears the resolution is taking longer than anticipated, we are awaiting an update from BT but will continue to chase this.
Once we have any more information we will inform you.
----------------------------------------------------------------
Update 12:25
Our network engineers have identified the issue within BT's network and are working with BT to resolve the fault, This has been identified as a device configuration error that was highlighted when the tunnels were collapsed, BT are looking at the configuration and will be looking to correct this.
Next update will be in 1 hour (13:25)
Please accept our apologies for the time it has currently taken to resolve this issue.
----------------------------------------------------------------
Update: 13:22
BT Operations are rebuilding the configuration on the device that controls the tunnels, once this configuration is rebuilt it will be loaded onto the device.
The rebuilding and reload will be complete within the next 30 minutes.
We will have an update in 30 minutes (13:52).
----------------------------------------------------------------
Update: 13:52
Configuration has now been reloaded, we now expect users to start connecting, however there will be an initial load on the RADIUS servers so connection could take longer than usual to initiate.
Any users that are receiving the BT holding page will be required to power down their equipment for at least 20 minutes and then attempt to reconnect.
We will monitor the connections and report how this is going in 1 hour (14:52)
Thank you for your patience.
----------------------------------------------------------------
We can see users are now connecting and believe the issue to be resolved.
BT are investigating the issue with the configuration file, once we have the explanation we will update this post (although the post will be closed).
Please accept our apologies for any inconveniences caused during this issue.
186k Support,
Tuesday, 21 December 2010
[CLOSED] - 20CN-BRAS-ERX15-READING3
We have just been informed of a BT outage affecting 20CN connections.
The exchange currently having issues is "20CN-BRAS-ERX15-READING3".
BT are currently investigating this outage.
------------------------------------------------------------------
This issue has been cleared and all circuits are now back online.
------------------------------------------------------------------
We have received this update/cause from BT:
IMT35773/10 (F) - 21/12/2010 09:26 - 21/12/2010 12:00 - : READING 3 EDGE ROUTE SWITCH 15 : LOSS OF SERVICE : Loss of internet services for 20708 broadband end users. Cause corrupt data - service restored"
Apologies for any inconvenience caused
The exchange currently having issues is "20CN-BRAS-ERX15-READING3".
BT are currently investigating this outage.
------------------------------------------------------------------
This issue has been cleared and all circuits are now back online.
------------------------------------------------------------------
We have received this update/cause from BT:
IMT35773/10 (F) - 21/12/2010 09:26 - 21/12/2010 12:00 - : READING 3 EDGE ROUTE SWITCH 15 : LOSS OF SERVICE : Loss of internet services for 20708 broadband end users. Cause corrupt data - service restored"
Apologies for any inconvenience caused
Monday, 15 November 2010
[CLOSED] Delayed BT updates
15/11/10 - Delayed BT updates
Due to BT system issues we are currently unable to get BT fault updates.
Apologies for any inconvenience caused, all updates will be forwarded to all our customer as soon as possible
------------------------------------------------------------------
16/11/10 - We are still experiencing intermittent issues with BT`s fault systems so some updates may be a bit delayed.
Apologies for the inconvenience, updates will be forwarded as soon as possible
------------------------------------------------------------------
BT have now repaired their fault report system so updates are back to normal
Due to BT system issues we are currently unable to get BT fault updates.
Apologies for any inconvenience caused, all updates will be forwarded to all our customer as soon as possible
------------------------------------------------------------------
16/11/10 - We are still experiencing intermittent issues with BT`s fault systems so some updates may be a bit delayed.
Apologies for the inconvenience, updates will be forwarded as soon as possible
------------------------------------------------------------------
BT have now repaired their fault report system so updates are back to normal
Wednesday, 3 November 2010
[Closed] - EDINBURGH Lines down
Alot of lines that connect to Edinburgh RASs went down at 11am
This does not seem to be isolated to a specific exchange or RAS.
BT have been informed and are currently investigating.
Next update expected 12:45
------------------------------------------------------------------
12:40: BT Engineers are currently onsite at the affected BRAS working on the issue
------------------------------------------------------------------
13:30: Still no official line from BT but we are seeing circuit reconnect slowly
------------------------------------------------------------------
14:20: BT are hoping to have this resolved shortly
This issue is mentioned here: http://www.theregister.co.uk/2010/11/03/bt_outage/
------------------------------------------------------------------
17:30: Unfortunatley no further updates from BT but we are seeing the majority of lines reconnected and online.
Customers that are having difficulty accessing broadband are advised to reboot their equipment.
We will post further updates when recieved
------------------------------------------------------------------
We have been informed this issue has now been resolved, once again this was due to BT hardware failure.
We also have the following form BT:
"BT’s engineers, working with specialists from BT’s network equipment vendor, are pro-actively monitoring both the network and systems stability of the affected node. In parallel, plans are being developed to implement total resilience to this environment".
This does not seem to be isolated to a specific exchange or RAS.
BT have been informed and are currently investigating.
Next update expected 12:45
------------------------------------------------------------------
12:40: BT Engineers are currently onsite at the affected BRAS working on the issue
------------------------------------------------------------------
13:30: Still no official line from BT but we are seeing circuit reconnect slowly
------------------------------------------------------------------
14:20: BT are hoping to have this resolved shortly
This issue is mentioned here: http://www.theregister.co.uk/2010/11/03/bt_outage/
------------------------------------------------------------------
17:30: Unfortunatley no further updates from BT but we are seeing the majority of lines reconnected and online.
Customers that are having difficulty accessing broadband are advised to reboot their equipment.
We will post further updates when recieved
------------------------------------------------------------------
We have been informed this issue has now been resolved, once again this was due to BT hardware failure.
We also have the following form BT:
"BT’s engineers, working with specialists from BT’s network equipment vendor, are pro-actively monitoring both the network and systems stability of the affected node. In parallel, plans are being developed to implement total resilience to this environment".
Subscribe to:
Posts (Atom)