Conversation

Notices

1. thurloat 📌 (thurloat@mastodon.club)'s status on Wednesday, 08-May-2019 12:22:10 EDT thurloat 📌

   Looks like the queues are finally emptying out, and somehow we're getting toots in the TL from 2 years ago ... I have no idea ...

   hang in there, still assigning additional resources to chug through this between feeding and changing new bums.

   thanks everyone for your support :)

   1. thurloat 📌 (thurloat@mastodon.club)'s status on Wednesday, 08-May-2019 15:08:33 EDT thurloat 📌

      in reply to

      update

      about 30% through the task backlog, removed a bunch of memory pressure from redis so the tasks are clearing more quickly now.

      it also appears that the bug that plagued us with missing profile photos is fixing itself.

      nice

      1. thurloat 📌 (thurloat@mastodon.club)'s status on Thursday, 09-May-2019 12:33:52 EDT thurloat 📌

         in reply to

         All queues are cleared and everything is chugging snappily along!

         Let me know if you see anymore hiccups.

         Ive also domain blocked a few dead or misbehaving instances (technically, not socially), you shouldn't notice but again let me know if you see wonkiness with your home feed or anyone special missing.

         1. thurloat 📌 (thurloat@mastodon.club)'s status on Sunday, 12-May-2019 16:37:40 EDT thurloat 📌

            in reply to

            behold the root cause of our flakiness over the last few days!

            something is causing a load increase of 2-3x just over the last week in sidekiq.

            it appears to be mostly pull workers and image conversion workers getting taxed, so maybe we're following some new media heavy instances?

            https://mastodon.club/media/1GQXOIAuSrfjbMFG5lw