MXroute - Status Page

Roughly 100 customers are left, and the reason they haven't been restored yet appears to be bugs in the backup software. The data is there, but I need their processes.

While the majority of customers are back online, there are still a few left to restore. I get it, it wasn't supposed to take this long. That's why we haven't built a server like the one that failed in 5 years and never will again. Over the years we've made variations in hardware configurations, and Sunfire was a bad decision. Only thing left to do is finish this and never experience it again. Postmortem will follow, of course.

More and more customers back online. Still work to do.

Work continues. More users are online than are not. But we're still going. A handful of giant accounts slowed down the restore just a bit in the last hour. Remember these things are not working yet for anyone:

1. Crossbox

2. Toggle Expert Spam Filtering

3. Retrieve Domain Verification Key

4. SpamAssassin (temporarily intentional, but it's not our only filtering layer)

A large portion of users are back online. We're continuing to restore the rest, and working to speed it up a bit more. These items do not currently work on the Sunfire server:

1. Crossbox

2. Toggle Expert Spam Filtering

3. Retrieve Domain Verification Key

We are now processing inbound and outbound mail for users that have been restored, as your domain appears on the list of restored accounts. So users that have been restored should have all functionality except for Crossbox. This reduces the number of impacted users continually as restores occur, which are continuing at this time.

Backups still restoring. Pacing varies, larger accounts slow it down but we have 10 simultaneous restores going. It's worth noting that accounts are restored before emails, so your login may work just a bit before your email reappears.

Backup restores continue moving forward. The pace is now reasonable. Over 100 users are back online. However, we are still not accepting inbound or outbound email on the server until the restores are completed. This is intentional and designed specifically to ensure that you do not miss email, better it arrive late than never.

We've made some adjustments to speed up backup restores a bit.

DNS for sunfire.mxrouting.net has been restored. You may or may not have success in logging into the server as accounts are still being restored. Some configuration deployments need to wait until after the backup restores finish. The server is also not accepting ANY inbound email until this is over, and outbound may not quite work yet either. We are deferring it all so that it will be re-sent later. We can't let anyone miss any inbound email, so it's important that the exim configurations be properly populated before we accept inbound mail.

So to clarify where we're at:

1. You should see "sunfire.mxrouting.net" appear as up very soon.

2. Your account may not be restored to the server yet (as of this moment, it likely isn't).

3. Inbound mail is intentionally deferred right now.

4. Outbound mail may or may not work right now.

We're cooking with gas now. It's all downhill from here. A disconnect between two software vendors delayed us getting to this stage, but what's done is done.

We are continuing to work on restoring the backups so that the new server can slip right in and take the place of the old one. There should be no expectation of data loss, nor should there be expectation of lost email. Delayed email, of course.

Working out the final details for restoring backups to the new server. They are restored over network, but the storage is local to the network so it should be quite efficient.

The sunfire.mxrouting.net server has experienced hardware failure. We are in the process of replacing the server. During this time users on the sunfire.mxrouting.net server will be unable to access their email during this process. While this isn't a situation that we often find ourselves in and we hoped to prevent, it is a possibility and there is no immediate resolution but the one we are working on. If you are not on the sunfire.mxrouting.net server, do not consider this status message to have any connection to your MXroute service, please continue to reach out to us about other servers on our platform if needed.