Pabau - Notice history

The reported slowness was intermittent in nature and did not consistently impact all users or actions within the platform. Following continued monitoring and internal checks, the behaviour is no longer occurring, and system performance has returned to normal levels.

We are pleased to report that the fix that was put into production yesterday appears to have had the desired effect on the web application speed and loading times. 

Our monitoring systems have confirmed that there have been no further latency issues observed from the time the fix was applied. A deep dive with our senior engineers has taken place, and we are confident that the root cause of the latency has now been dealt with. We will add some further ‘belts and braces’ fixes, which will be applied over the coming days and weeks to further solidify our core infrastructure.

We are very conscious of the impact that latency has on your business operation, and it is our number one priority to resolve it.  We saw a record uptake on the Pabau Go application, which was unaffected by the slowness, and we would again encourage all businesses to download and make use of it: Pabau GO iOS app

A fix has now been applied to address the slow loading on the Pabau web application.

We’ll continue to closely monitor performance to ensure everything remains stable. Thank you for your patience while we worked through this.

We understand how frustrating slow performance can be and the impact this has on your day-to-day work. Please rest assured that our team is fully aware of the issue and continues to actively work on restoring normal loading speeds across the Pabau web application.

The Pabau GO iOS application remains unaffected and can be used as an alternative while we work on a fix.

Thank you for your patience and understanding. We will continue to share updates as soon as we have more to report.

Update: The issue that occurred yesterday also affected the speed of some Pabau services earlier this afternoon.

The positive news is we have now identified the root cause of the issue and it is being fully patched.

The speed of the platform has been stable for the majority of today - and we expect no further issues when the patch is fully complete, which is currently in progress.

This incident has been resolved. The issue was caused by an unexpected load on our servers. Our engineers performed a reboot of several servers and the issue was resolved. Our team will now root cause this incident to try to prevent it from being able to reoccur. We appreciate your patience and apologise for the disruption this would have caused you in your businesses.

A fix has gone in and we are seeing improvement across key components - our team will continue to work to bring the system back to 100% speed across all areas.

The fix that was applied did not have the intended effect and the team are now deploying an updated fix to resolve the slow loading of Pabau.

We implemented a fix and are currently monitoring the result. We expect speed to return to normal in 10-15 minutes.

The slowness is also impacting booking and using the Pabau GO application. Our team are working on the resolution and we will update as soon as we have more info.

The issue affecting slow loading and intermittent crashes when opening client cards has now been resolved.

Performance has been restored, and client cards should now open as expected.

Thank you for your patience, and we apologise for the inconvenience caused.

The web application speed is now optimal.

Please always have the iOS app downloaded which was unaffected: https://apps.apple.com/gb/app/pabau-go/id1057335634

We are rebooting some of our services to get the speed back to normal - a weekend upgrade failed and has been reverted. We expect the speed to return to normal in the next 5-10 minutes on the web application. Please ensure you have the Pabau GO app installed to revert to in instances of slow loading: https://apps.apple.com/gb/app/pabau-go/id1057335634

Although the incident was quickly resolved by our engineers to allow Pabau to operate as normal - we wanted to share with you the effect that today;s incident has had (and continues to have) across the internet. This is the second incident we have seen this month where a third party provider has had an impact on our services - with the AWS outage also effecting global internet services a few weeks ago. You can read about todays issue here: https://www.bbc.co.uk/news/articles/c629pny4gl7o

As a post-mortem - although we cannot account for issues like this, we are happy to report that due to the very quick actions of our engineers, the impact on Pabau was very limited - as we immediately de-coupled cloudflare from our tech stack; when it is safe to do so, we will restore the Cloudflare service which offers added protection to our infrastructure.

A further fix has been made and we expect no further speed issues

The ​Pabau GO iOS app was unaffected​, and we recommend all businesses Download it here and use it as a backup service if required.

We are seeing some more reports again of slowness/login issues. Our team are investigating and we will be restoring services as soon as possible.

The ​Pabau GO iOS app is unaffected​, and we recommend using it in the meantime: Download here

This incident with the slow speeds has now been fully resolved - the speed of the web app has returned to normal.

ISSUE: The incident was caused by one of our nodes detaching from our cluster and which resulted in the other nodes being overloaded. We have created a fix for this so that it cannot happen in the future.

Please note all speed & functionality is normal in the Pabau GO iOS app and we recommend using this as a backup service if there is ever any instances of slow loading on the web application. You can Download the iOS app here and can login with your normal Pabau credentials.

The fix for the slow speed is being deployed and we expect speeds to return back to normal on the web version in the next few minutes.

Please note all speed & functionality is normal in the Pabau GO iOS app and we recommend using as a backup service. You can Download it here and can login with your normal Pabau credentials.