Wed, 05/21/2008 - 22:31

Thursday, 22 May 2008

Wed, 05/21/2008 - 22:31

I have this graph up on my screen all the time. It should be flat. This week has been rough.

We’ve gone through our various databases, caches, web servers, daemons, and despite some increased traffic activity across the board, all systems are running nominally. The truth is we’re not sure what’s happening. It seems to be occurring in-between these parts.

We’re busy working on instrumenting and adding meters to provide visibility into what’s slowing Twitter down. We’ll use this data both to alleviate the current woes and to help inform our long-term architecture work to make Twitter a utility service people can count on. We’ve definitely failed that aim this week.

Thanks for your patience during these current frustrations (and those to come) as we figure out how to work the kinks out. Thanks also for speaking up: we’re listening. In addition to providing visibility into our systems, we’re working to give everyone greater visibility into our roadmap to solve these ongoing problems. More to come.