How Google migrated billions of lines of code from Perforce to Piper
Google migrated billions of lines of code from Perforce to Piper over four years to scale and reduce risks. Challenges included dependencies and seamless migration, but the transition was successful, improving operational efficiency.
Read original articleGoogle successfully migrated billions of lines of code from Perforce to Piper, a process that took over four years. The decision to move away from Perforce was driven by the need to scale and reduce operational risks. The migration involved creating a new distributed system called Piper, based on Google's infrastructure, and cutting over all traffic to the new system. The project faced challenges such as dependencies on Perforce APIs and the need for a seamless migration process. Despite the risks involved, the migration was completed without any loss of state or impact on Google's production instances. The successful cutover to Piper not only reduced operational risk but also unblocked new systems due to increased traffic support. The migration to Piper showcased Google's engineering daring and scrappiness in tackling complex challenges.
Related
OpenPipe Mixture of Agents: Outperform GPT-4 at 1/25th the Cost
OpenPipe's cost-effective agent mixture surpasses GPT-4, promising advanced language processing at a fraction of the cost. This innovation could disrupt the market with its high-performance, affordable language solutions.
BeyondCorp (2014)
Google's BeyondCorp approach rethinks enterprise security by moving away from traditional perimeter security to enhance protection in the changing tech environment. Visit the link for more details on this innovative strategy.
The Death of the Junior Developer – Steve Yegge
The blog discusses AI models like ChatGPT impacting junior developers in law, writing, editing, and programming. Senior professionals benefit from AI assistants like GPT-4o, Gemini, and Claude 3 Opus, enhancing efficiency and productivity in Chat Oriented Programming (CHOP).
Serving a billion web requests with boring code
The author shares insights from redesigning the Medicare Plan Compare website for the US government, focusing on stability and simplicity using technologies like Postgres, Golang, and React. Collaboration and dedication were key to success.
Our great database migration
Shepherd, an insurance pricing company, migrated from SQLite to Postgres to boost performance and scalability for their pricing engine, "Alchemist." The process involved code changes, adopting Neon database, and optimizing performance post-migration.
This is something that surprised me while I was at Google too. Of course a source code version control system shouldn't be a dependency of production, but it turns out it is just so convenient to go from (1) use your source code system to store configuration so that they are versioned and tracked; (2) have tools to read configuration and apply them automatically, Terraform style; (3) have tools to modify said configuration automatically instead of manually. Voila your source version control system suddenly becomes a NoSQL database.
I would love to hear the reasoning behind going custom, and if that ended up truly being worth the investment.
Or maybe I'm misremembering the timeline on when certain things became available. shrug
That is such a cringy, fearful, statement...
Related
OpenPipe Mixture of Agents: Outperform GPT-4 at 1/25th the Cost
OpenPipe's cost-effective agent mixture surpasses GPT-4, promising advanced language processing at a fraction of the cost. This innovation could disrupt the market with its high-performance, affordable language solutions.
BeyondCorp (2014)
Google's BeyondCorp approach rethinks enterprise security by moving away from traditional perimeter security to enhance protection in the changing tech environment. Visit the link for more details on this innovative strategy.
The Death of the Junior Developer – Steve Yegge
The blog discusses AI models like ChatGPT impacting junior developers in law, writing, editing, and programming. Senior professionals benefit from AI assistants like GPT-4o, Gemini, and Claude 3 Opus, enhancing efficiency and productivity in Chat Oriented Programming (CHOP).
Serving a billion web requests with boring code
The author shares insights from redesigning the Medicare Plan Compare website for the US government, focusing on stability and simplicity using technologies like Postgres, Golang, and React. Collaboration and dedication were key to success.
Our great database migration
Shepherd, an insurance pricing company, migrated from SQLite to Postgres to boost performance and scalability for their pricing engine, "Alchemist." The process involved code changes, adopting Neon database, and optimizing performance post-migration.