CLICK HERE to get automated email updates when new posts (including outage information) are added to this page.
One of our Espanola towers has lost its fiber feed from REDI Net. REDI Net Network Operations is investigating the issue. In the mean time, the backup link is functioning, but some users in Espanola and western Alcalde will see reduced speeds until the issue is resolved.
A widespread power outage is affecting most of Espanola, Alcalde, Dixon, Velarde, and Chamita. Our network core and most of our towers are still running but many customers will have an internet service outage until Jemez Co-op restores power.
See http://71.29.201.50:7576/ for the Jemez Co-op Outage Map.
We are working with REDI Net to resolve the issue that caused the system-wide outage last week. They are ready to apply their fixes and we have scheduled a service window for 07:00 - 07:30 on June 26th. We are hopeful this will not cause any further downtime, but it is a possibility.
We are currently experiencing a complete network outage as of approximately 8:00 AM today. We are working with REDI-Net in an attempt to determine what and where the problem is. We do not currently have an estimated resolution time, but check back for more updates.
-Black Mesa Wireless Team
We are performing some software and equipment upgrades on the Rio Arriba Health Commons tower site this morning, which will cause intermittent brief outages for customers on that tower. This affects primarily portions of southern and western Española, including Las Lomas apartments.
We are moving the core router, which handles all traffic for the entire network, to a larger battery backup tomorrow, June 19th at 5:30AM. This should only require 5 minutes of downtime but we are leaving a 30 minute window to deal with any possible issues that may come up. This will affect ALL CUSTOMERS.
We are having some problems with a router locking up in Velarde, affecting customers in Velarde and the north end of Alcalde. We are actively troubleshooting this issue and it may require a hardware replacement.
There appears to be a widespread power outage in the southern portion of Espanola, near the Dreamcatcher area and in to La Mesilla. Clients connecting to the tower near Santa Cruz may experience service interruptions due to extended power loss.
For more information, visit http://www.jemezcoop.org/ and view their outage map.
Hello Everyone,
There was briefly an outage related to the way our tower sites connect over the REDI Net infrastructure. The REDI networking staff was already working on a solution and they were able to get us back online in a matter of minutes. We apologize for the brief blip in service.
Thanks for your understanding!
There is a widespread power outage affecting most of our coverage area. We have had a battery backup failure at the network core as well, affecting some services.
We are bringing a generator online at the core and waiting for Jemez Co-op to bring power back to the rest of the service area.
We are performing a major upgrade of the Black Mesa tower tomorrow, February 12th, from 10AM to 1PM. This will improve battery capacity and router speed and is expected to improve both performance and reliability as a result.
All the necessary pieces are already assembled on site. We anticipate a relatively brief outage (10-15min) for most customers, but it could take some time to ensure that the new system is functioning correctly. Outages may occur at any time during the specified window.
Thanks for your patience with this upgrade.
We will be performing a brief battery upgrade in Velarde at around noon today. This will require the tower to go down for no more than 2-5 minutes as we must disconnect all power to connect the new batteries.
These batteries will help ensure that the tower keeps running even if we get some real winter weather.
We are performing upgrades on the High School water tank today between 10am and 12:45pm. This will result in 5-10 minutes of downtime for most or all customers on this tower.
We are doubling battery capacity, which should ensure that we do not have any outages due to lack of sun should we actually have a proper winter at some point.
We will be upgrading and re-aiming some radios this afternoon, it should result in no more than a few minutes of down time. This is for customers in the Espanola and La Mesilla area with radios aimed toward the Rio Arriba Health Commons (west to north-west).
We are planning some brief but very important stability work for the Black Mesa tower site tomorrow morning, December 15th, between 7:00 AM and 12:00 PM. The tower will be briefly offline during this time, not more than 20 to 30 minutes, as we make our power infrastructure more robust before the winter season sets in.
Thank you for your understanding!
We just went live as of this morning in downtown Pojoaque and Cuyamungue. For customers within this area we expect to be able to deliver 100Mbps service now, and in the near future up to 300Mbps service.
If you are interested in service in this area, the best way to proceed is to register for service, and we will follow up to confirm eligibility.
We will be performing core network upgrades in Velarde between 4am and 6am over the next three days. These upgrades require taking equipment offline briefly that is connecting all customers to the Internet. Outages should be no more than a few minutes at a time, but there are almost always unforeseen issues with such major upgrades that could extend the outages to 10-15 minutes at a time.
Thank you for your patience, these upgrades will make the network faster and more robust to equipment failures in the future.
While we are not experiencing any issues that we can find within our network, you may experience problems reaching various sites and services on the Internet today. There are connectivity problems between major Internet backbone providers including Level 3 Communications affecting traffic throughout the country.
While we do not have an ETA for these issues to be resolved, these worldwide Internet transit organizations are working to restore normal traffic flow as quickly as possible.
We will be migrating a few pieces of our network core to a much larger battery backup system on the morning of October 24th 2017, between 09:30 and 10:30. The outage should only last 3-5 minutes but it is possible if there are problems that it could last a short while longer.
This upgrade will enable key parts of our core network to continue running for several days without mains power.
Hello All,
We will be doing additional recabling at the Dixon tower site on October 3rd from 9:00 AM through to 4:00 PM. During this time, brief disconnections in service will take place as we update the cables.
On October 4th, clients located in Ohkay Owingeh and Alcalde areas who are connected to the Black Mesa tower site will experience a brief outage as we swap to a new access point radio configuration. This outage will occur between 9:00 AM and 12:00 PM.
Also on October 4th, clients in the El Bosque area will experience a brief outage as we swap a piece of critical infrastructure. This outage should occur between 12:00 PM and 2:00 PM.
Thank you all for your patience and understanding.
--Steve
