Engineering Back

Latest posts

Infrastructure Twitter’s Blobstore Hardware Lifecycle Monitoring and Reporting Service

By on

At Twitter, our on premise data centers contain hundreds of thousands of hardware servers and millions of server hardware components.

Infrastructure Kerberizing Hadoop Clusters at Twitter

By on

At Twitter, our on premise data centers contain hundreds of thousands of hardware servers and millions of server hardware components.

Infrastructure How we scaled Reads On the Twitter Users Database

By on

At Twitter, our on premise data centers contain hundreds of thousands of hardware servers and millions of server hardware components.

Infrastructure The data platform cluster operator service for Hadoop cluster management

By on

As any team and its infrastructure grows, the risk of an unplanned service outage and potential data loss will grow.

Infrastructure Constraint Management for cluster operation safety and reliability at Twitter

By on

As any team and its infrastructure grows, the risk of an unplanned service outage and potential data loss will grow.

Infrastructure How Twitter uses rasdaemon for hardware reliability

By on

At Twitter, our on premise data centers contain hundreds of thousands of hardware servers and millions of server hardware components.

Insights Measuring the impact of Twitter network latency with CausalImpact

By on

In this blog, we share how we adopted the CausalImpact package from Google on a Twitter edge network experiment to measure the impact of improving Twitter's latency on customer engagement and revenue.

Infrastructure Stability and scalability for search

By on

In this blog, we discuss how we power real-time search for Tweets, Users, Direct Messages and more using Elasticsearch.

Infrastructure Data Quality Automation at Twitter

By on

In this post, we share how Twitter implemented a Data Quality Platform that gave customers the ability to have automated data quality checks.

Infrastructure Twitter Sparrow tackles data storage challenges of scale

By on

In this blog post, we discuss the scale at which Twitter operates through Project Sparrow, an initiative that shifted the architecture of our data pipelines from a batch event approach to streaming.

See more