memcached

Memcached

Developer(s)	Danga Interactive
Stable release	1.2.6 / July 23, 2008
Repository	github.com/memcached/memcached
Operating system	Cross-platform
Type	distributed memory caching system
License	BSD License
Website	http://www.danga.com/memcached/

memcached (pronunciation: mem-cache-dee.) is a general-purpose distributed memory caching system that was originally developed by Danga Interactive for LiveJournal, but is now used by many other sites. It is often used to speed up dynamic database-driven websites by caching data and objects in memory to reduce the number of times the database must be read. Memcached is distributed under a permissive free software license.

Memcached lacks authentication and security features, meaning it should only be used on servers with a firewall set up appropriately. By default, memcached uses the port 11211. Among other technologies, it uses libevent.

Memcached's APIs provide a giant hash table distributed across multiple machines. When the table is full, subsequent inserts cause older data to be purged in least recently used (LRU) order. Applications using memcached typically layer memcached requests and additions into core before falling back on a slower backing store, such as a database.

The system is used by several very large, well-known sites including YouTube, LiveJournal, Slashdot, Wikipedia, Wikia, SourceForge, Metacafe, ShowClix, GameFAQs, Facebook, Digg, Twitter, Fotolog, BoardGameGeek, NYTimes.com, deviantART, Jamendo, Kayak, VxV, The Pirate Bay and Netlog.

Example code

Converting a database or object creation queries to use memcached is simple. Typically, when using straight database queries, example code would be as follows:

Note that all functions described on this page are pseudocode only. Memcached calls and programming languages may vary based on the used API.

function get_foo (int userid) {
   result = db_select("SELECT * FROM users WHERE userid = ?", userid);
   return result;
}

After conversion to memcached, the same call might look like the following

function get_foo (int userid) {
    result = memcached_fetch("userrow:" + userid);
    if (!result) {
        result = db_select("SELECT * FROM users WHERE userid = ?", userid);
        memcached_add("userrow:" + userid,  result);
    }
    return result;
}

The server would first check whether a memcached value with the unique key "userrow:userid" exists, where userid is some number. If the result does not exist, it would select from the database as usual, and set the unique key using the memcached API add function call.

However, if only this API call were modified, the server would end up fetching incorrect data following any database update actions: the memcached "view" of the data would become out of date. Therefore, in addition to creating an "add" call, an update call would be also needed, using the memcached set function.

function update_foo(int userid, string dbUpdateString) {
    result = db_execute(dbUpdateString);
    if (result) {
        data = createUserDataFromDBString(dbUpdateString);
        memcached_set("userrow:" + userid, data);
    }
}

This call would update the currently cached data to match the new data in the database, assuming the database query succeeds. An alternative approach would be to invalidate the cache with the memcached delete function, so that subsequent fetches result in a cache miss. Similar action would need to be taken when database records were deleted, to maintain either a correct or incomplete cache.

External links

General

• Official memcached site
• memcached wiki and faq
• Win32 memcached port 1.2.1
• Win32 memcached port 1.2.4

Client Libraries

• PHP
• Java
• Python
• Perl
• pure Ruby
• compiled Ruby
• Enyim.com .NET client
• BeIT .NET client
• ASP.NET cache and session provider
• Scheme
• new C/C++ reference implementation
• old C implementation

Client Applications

• memcached in MediaWiki
• memcached storage engine for MySQL
• pgmemcached - API for PostgreSQL
• Memcached Functions for MySQL - API for MySQL
• memcachefs: a memcache filesystem using FUSE
• IPC::Lock::Memcached - fast locking via memcached
• hibernate-memcached Second level cache for Hibernate ORM
• Memcached UDF for Java DB on OpenSolaris