I was perusing craigslist and noticed a link that said 'open source'. Being
the ever-curious lad of 44 I clicked the link and wish to share what I
found:
<quote>
craigslist is a big believer in open source software
<
http://en.wikipedia.org/wiki/Open-source_software>, and relies heavily
<
http://www.craigslist.org/about/thanks> on Linux, MySQL, Perl, Apache,
Sphinx, Redis, Haraka, and many others.
craigslist (CL) has released the following open source projects:
CL blob service <
https://github.com/craigslist/python-clblob> - a simple
HTTP-based, multi-master storage service designed for scale-out and
multi-datacenter deployments:
- multi-master architecture with no single point of failure
- scales well for both read and write intensive workloads
- tracks TTLs for automatic expiration and purging of blobs
- designed for both local and multiple data center replication
- pluggable index and storage interface (uses SQLite for index and
filesystem for storage by default)
CL image service <
https://github.com/craigslist/python-climage> - large
scale image resizing and processing HTTP service:
- flexible API to choose any quality, size, and center-cropping
- automatically handles orientation operations from EXIF data
- stores resized images in the blob service (could use other stores)
memcache cluster proxy (MCP) <
https://github.com/craigslist/mcp> - a
high-performance modular clustering HTTP reverse proxy:
- high-performance event-driven daemon
- flexible configuration, easily extensible framework
- uses standard memcached memory store for caching
- supports PCRE and rule-based traffic routing by URL, headers, and more
- tracks health of origin servers, routes around failures
- provides configurable URL redirects, rewrites, and real-time
header transformations
In addition, craigslist contributes code to the following open source
projects:
Haraka <
http://haraka.github.io/>:
- added the smtp_client code that helps support pooled connections for
proxy queues
- rewrote all of the smtp_proxy and smtp_forward code
- major contributions to the test suite
- plugin that does strict DNS checking, DNS access control lists
- contributions to bannering support
- logging infrastructure changes for more robust logging
- plugins for aliases, access lists, etc.
Redis <
https://github.com/antirez/redis>:
- perl-AnyEvent-Redis-Federated: an event-based redis client that
implements client-side sharding in Perl
- redis_util: s collection of utilities for node-redis
- provided support for included config files
Sphinx <
http://en.wikipedia.org/wiki/Sphinx_(search_engine)>:
- provided the original persistent connections implementation
- craigslist sponsors useful sphinx feature developments, such as the
TRUNCATE INDEX command for real-time sphinx
The craigslist Charitable Fund
<
http://www.craigslist.org/about/charitable> supports
open source nonprofit organizations including:
- Apache Software Foundation <
http://www.apache.org/>
- Free Software Foundation <
http://www.fsf.org/>
- Gnome Foundation <
http://www.gnome.org/>
- Mozilla Foundation <
http://www.mozilla.org/>
- Open Source Initiative <
http://www.opensource.org/>
- OpenStreetMap.us <
http://openstreetmap.us/>
- Perl Foundation <
http://www.perlfoundation.org/>
- PostgreSQL <
http://www.postgresql.org/>
- Python Software Foundation <
http://www.python.org/>
- Software in the Public Interest <
http://www.spi-inc.org/>
</quote>
Isn't that cool!
--
:-)~MIKE~(-:
---------------------------------------------------
PLUG-discuss mailing list -
PLUG-discuss@lists.phxlinux.org
To subscribe, unsubscribe, or to change your mail settings:
http://lists.phxlinux.org/mailman/listinfo/plug-discuss
(text/plain)