Emberly - Notice history

Experiencing partially degraded performance

Documentation - Operational

100% - uptime
Jan 2024 · 100.000%Feb · 100.000%Mar · 100.000%

Previous page

Next page

Jan 2024100.000% uptime
Feb 2024100.000% uptime
Mar 2024100.000% uptime

Object Storage - Operational

100% - uptime
Jan 2024 · 100.000%Feb · 100.000%Mar · 100.000%

Previous page

Next page

Jan 2024100.000% uptime
Feb 2024100.000% uptime
Mar 2024100.000% uptime

Proxy Server - Operational

100% - uptime
Jan 2024 · 100.000%Feb · 100.000%Mar · 100.000%

Previous page

Next page

Jan 2024100.000% uptime
Feb 2024100.000% uptime
Mar 2024100.000% uptime

Notice history

Mar 2024

No notices reported this month

Feb 2024

Major Outage
  • Resolved
    Resolved
    This incident has been resolved.
  • Investigating
    Investigating

    We are working with our hosting provider to resolve some ongoing issues, more info will be posted soon!

Authorization Failures
  • Resolved
    Resolved

    Issues appear to be resolved, we are seeing no further signs of concern at this time!

  • Monitoring
    Monitoring

    We have rolled out a change and are monitoring the results for further issues....

  • Investigating
    Investigating

    We have found a bug in our authorization flow that may prevent new users from registering, our team is working on patching it!

Config Outage
  • Resolved
    Resolved

    These issues have been resolved.

  • Investigating
    Investigating

    We are aware that after our run of changes the ability to download your config via our website is broken in multiple areas, this api was overlooked initially but is now being worked on 👀

    In the meantime you can use the /config commands in our discord bot to view or download your config

Authorization Flow Insecurities
  • Resolved
    Resolved

    This issue has been resolved, we are seeing no signs of major errors or concern!

  • Monitoring
    Monitoring

    Changes have been pushed to production and services have been restored, we will monitor the results for issues for a bit before we close this issue. Please let us know if you experience any bugs with the changes.

  • Update
    Update

    We are working on pushing the final run of commits, service will be restored momentarily!

  • Update
    Update

    We are continuing to work on and test our fix for these issues, it has been a long and painful process but our authorization flow will be now 100% more secure and reliable.

  • Identified
    Identified

    We have identified the root cause of ongoing insecurities within our Authorization flow and we are currently working on testing a permanent solution, along with this insecurity we have also caught and corrected some database corruption issues (with 0 lose of data thankfully) we have also applied some critical improvements to our authorization flows signature process.

    All of these changes will be applied after testing is complete.

  • Investigating
    Investigating

    We have identified some insecurities in our authorization flow and are working on a permanent solution, to prevent any further issues/abuse our website has been shut down and will be back up soon!

Jan 2024

Upload Webhooks
  • Resolved
    Resolved

    All systems are working as expected :D

  • Monitoring
    Monitoring

    We have rolled out the necessary changes, currently our systems seem to be handling the changes as expected but we will monitor the results for a bit before closing this issue.

  • Investigating
    Investigating

    We are currently fixing up the connections between our proxy and user uploads, webhooks may not send during this time but uploads should still work as expected regardless.

Client Issues
  • Resolved
    Resolved

    Our team has decided to temporarily remove/disable the affected commands until we come up with a more permanent solution in the latest development version of our client, the removal of these commands will take place over the next few days and will most likely happen silently (no announcement) as no other parts of the client are effected here it will now be marked as operational.

  • Identified
    Identified

    We are aware of some ongoing issues with our API which is resulting in our discord bot/client displaying invalid responses on some meme commands, this will be updated as soon as possible as it seems at this time that our meme provider was updated and now requires authentication! We are working on a new version of the bot anyways so this fix may be delayed until the new client is released!

Degraded Cloudflare Performance
  • Resolved
    Resolved

    All ongoing issues have been marked as fixed by the cloudflare team.

  • Monitoring
    Monitoring

    Cloudflare appears to be having some issues that have already cause minor issues on a variety of our services, they are now back online but users should expect random outages while the cloudflare team works to resolve these issues, we will continue to monitor their status and post updates as necessary. Currently users all throughout texas could face response time and latency issues..

    More info: https://www.cloudflarestatus.com/

Important Maintenance/Outage
  • Resolved
    Resolved

    Issues have been resolved

  • Investigating
    Investigating

    We have recently rolled out the update that adds full support for custom domains, however we have noticed some major flaws and security issues. as a result of such we have shut down the site temporarily while we work on the fixes. Will be back up within an hour

Jan 2024 to Mar 2024

Next