Service Outage - Feb 1st, 2024W

Internet Services were restored last evening sometime after 10PM. We appreciate everyone’s patience.

We are experiencing a network outage due to the fiber optic lines line being severed by vandals south of the Ohkay Casino. Repair crews are onsite. There is no estimated time to repair currently, however we are hopeful it will be soon. We will provide a status update here, on our outgoing phone message and on FaceBook.

Service Outage

The repair was completed sometime in the evening. Service is restored. Thanks you all for your patience.

We are currently experiencing a service outage from our upstream provider due to a cut in the fiber optic lines north of Espanola. Most of our tower sites are currently offline. We do not have an estimated time for repairs to be completed, however expect it will be fixed by this evening. Thanks for your patience.

Emergency power repairs in Espanola

EDIT: All repair work completed in Espanola on November 1st.

EDIT: November 1st:
repair work is continuing at one of our sites in Espanola. There may be a brief outage, approximately 15-20 minutes, between 9:00 and 12:00 AM. Thank you for your patience as we work to repair our infrastructure.

Today Tuesday October 31st we are repairing a power issue we have identified at one of our sites in Espanola. There may be a brief outage, approximately 15-20 minutes, between 12:00 and 16:00 this afternoon. Thank you for your patience as we work to repair our infrastructure.

As of 11:30 PM October 2nd We are currently experiencing a global outage due to an upstream transport provider and are working to restore services at this time. We do not have an ETR.

EDIT - Services were restored at 03:40 AM. Our main traffic transport provider experienced a failure and was able to get us back online on a redundant pathway. Thank you all for your patience!

REDI Net emergency repair outage today at Midnight 5/15 through 6:00 AM 5/16

​Hello, 

REDI Net, one of our upstream internet providers, will be performing emergency repairs impacting services for all clients between 12:00 AM tonight 5/15 through tomorrow morning at 6:00 AM 5/16.

Total outage time is anticipated between 1-4 hours but REDI Net reserves the whole window for outage repairs.

Thank you for your understanding!

Sincerely, 

Black Mesa Wireless

Localized outage, Espanola

EDIT: as of approximately 9:05 AM the localized service outage has been restored. As of roughly 9:35, our Cogent connection is restoring routes and is passing traffic. We should return to normal capacity over the course of the day. The Cogent connection is not officially repaired, we may lose capacity, but things are trending towards repaired.

Starting at approximately 5:00 AM this morning Saturday December 3rd we are experiencing a localized outage affecting approximately 65 clients in Espanola and are on site investigating at this time.

Our main transport link is still offline and we are operating at reduced network capacity while Cogent completes their repairs and fully restores our service. Thank you for your understanding.

Systemwide outage

2022-12-01 20:00: We are operating at reduced capacity over a backup connection at this time and have reduced bandwidth. The internet is going to be on, but slow. Thank you for your understanding.

2022-12-01 16:51: All services restored as of 16:45. A huge thanks to support provided to Cogent by ABQ IX and the private members who did the heavy lifting to bring us back online.

Thank you all for your patience, please watch for a more detailed postmortem.

2022-12-01 14:08:Cogent has gained access as of 1:01 PM and is working with a local exchange provider to bring all equipment back online. They have not provided an ETR, but this is large progress. More to come as we know more.

EDIT 2022-12-01 9:30: We just received an update from Cogent saying they will have access to repair their failed equipment and restore our service at 14:00 this afternoon. As we receive more updates we will update our socials and messages.

EDIT 2022-12-01 3:00: As of 3:00 AM Dec 1st, Cogent crews have been unable to gain access to the damaged equipment responsible for this outage. They have rescinded their previous ETR and do not have an update at this time.

We sincerely apologize for this continued outage and are working to restore service across different avenues at this time. Thank you all for your ongoing patience.

EDIT 2022-11-30 21:40: We just received word that Cogent, the party responsible for the current outage, will gain access at 12:00 tonight and estimate a service restoration time of approximately 06:00 on the 1st. We have our fingers crossed. Thank you for your patience.

EDIT 2022-11-30 14:47: As of writing, our services remain down and we have no estimated time of resolution. Repair crews are still awaiting access to begin their repairs in a data center in Albuquerque, where the issue is centered. As soon as we have more information we will provide an update.

EDIT 2022-11-30 11:00: As of 11:00 AM we are still down and do not have a solid time of resolution. Repair crews are still awaiting secure access to complete their repairs. As soon as we have more information we will provide an update.

EDIT 2022-11-30 05:47: Update received at 5:23 this morning states crews are working to gain access to an area controlled by a non-responsive site manager in Albuquerque to complete the repair. No ETR at this time. Thank you all for your patience.

EDIT 21:36: We just received word that the outage is due to damage in the middle of the state caused by a pole failure that also had powerline involvement. Services and crews are working to repair damaged fiber now. We do not have an official ETR, but we believe services are likely to be restored tonight.

As of 16:10 today 29 Nov 2022 we are experiencing a systemwide outage from our upstream provider, Cogent. We are currently awaiting status updates at this time and do not have an estimated time of resolution. Thank you for your patience.

Outage 8 Oct 2022

We are currently experiencing an outage as of approximately 10:00 AM today October 8th. The root cause is related to our middle mile providers, one with physical infrastructure damage and another with an administrative issue. We are working to bring everything back online and will update with an Estimated Time of Resolution as we have one.

Thank you for your patience.

UPDATE

20:11 Our main upstream provider is currently working to resolve the fiber connection issue and our backup provider is attempting to implement a routing fix at this time. We currently do not have an estimated time to resolution.

23:40 All services have been restored as of approximately 22:40 and are now fully confirmed.

HS tower outage

Our tower located at the Espanola High School was severely damaged in the windstorm over the weekend.  During today's efforts to keep the tower online and operational, our backup charging system suffered an additional catastrophic failure.

We are working diligently to restore service, but we will not be able to keep the tower site online overnight.  We apologize for the inconvenience this is sure to cause and hope to have a solution in place as soon as possible.

Thank you for your understanding.

Sincerely, 

Black Mesa Wireless