Upon returning from the thanksgiving holiday, I discovered there were numerous reports of failures from across the DepMap Portal. I believe I’ve rectified the problem at this time.
The root cause was that one of the background services failed to restart after a change that was made to address a filesystem filling up. Unfortunately, our automated monitoring was not checking this particular service and so it did not get flagged by our notification system and I didn’t realize there was a problem until returning from the holiday and saw people reporting issues.
We’ll look into improving our monitoring to prevent outages like this in the future.
Apologies for the disruption and inconvenience.
Phil
