April 6, 2009 6:30 PM - 138 attended

How FriendFeed uses MySQL to store schema-less data

Bret Taylor from FriendFeed talks about how they store their data in a "schema-less" system on top of MySQL. FriendFeed stores over 250 million entries and a bunch of other data, from comments and "likes" to friend lists.

As the database has grown, they have tried to iteratively deal with the scaling issues that come with rapid growth. They did the typical things, like using read slaves and memcache to increase read throughput and sharding our database to improve write throughput. However, as FriendFeed grew, scaling their existing features to accommodate more traffic turned out to be much less of an issue than adding new features.

In particular, making schema changes or adding indexes to a database with more than 10 - 20 million rows completely locks the database for hours at a time. After some deliberation, FriendFeed decided to implement a "schema-less" storage system on top of MySQL rather than use a completely new storage system. This talk attempts to describe the high-level details of the system.


Bret Tayler is one of the founders of FriendFeed.com. Before starting FriendFeed, he was a Group Product Manager at Google, responsible for Google's developer products. Before that, he launched Google Maps and Google Local, and before that he worked on Google's crawling and indexing infrastructure.


Agenda:
6:30 - 7:00 -- Doors open/general socializing & food provided by Sun Startup Essentials
7:00 - 7:15 -- Intro/announcements
7:20 - 8:30 -- Main presentation by Bret Taylor
8:30 - 9:00 -- Main presentation Q&A
9:00 - 10:00 -- General discussion/Q&A/networking/etc.
10:00ish -- end of group

  • You must be a member to post a comment. Join or login.

138 attended
4.50 4.5020 (20 ratings)

Percona

Food, drinks, books and speakers.

Continuent

Logo, signs & swag.

IGN Entertainment

Time, money, swag, food, drinks & facilities

CBS Interactive

Food, beverages & facilities

O'Reilly User Group Program

The O'Reilly User Group Program provides the great books we get monthly.

MySQL

A great database for us all to use! :)

Other nearby
Meetups
Why these groups?
x

The Meetup Groups shown here are topically similar to The SF MySQL Meetup Group.

Groups are more likely to be displayed here if they:

  • have a Meetup scheduled
  • have a high rating
  • have a group photo
  • are "public" and not "private"
  • have shown they are likely to stick around (older than 30 days)
Find more Meetup Groups
near San Francisco

Log in

  • Not registered with us yet?
or

Log in to Meetup with your Facebook account.

Sign up

or

Join this Meetup Group even quicker with your Facebook account.

By clicking the "Sign up using Facebook" or "Sign up" buttons above, you agree to Meetup's Terms of Service