I don't know if this has come up yet but....

Top Page
Attachments:
Message as email
+ (text/plain)
+ (text/html)
+ (text/plain)
Delete this message
Reply to this message
Author: Michael Havens
Date:  
To: PLUG, LINUX-L
Subject: I don't know if this has come up yet but....
I was perusing craigslist and noticed a link that said 'open source'. Being
the ever-curious lad of 44 I clicked the link and wish to share what I
found:

<quote>

craigslist is a big believer in open source software
<http://en.wikipedia.org/wiki/Open-source_software>, and relies heavily
<http://www.craigslist.org/about/thanks> on Linux, MySQL, Perl, Apache,
Sphinx, Redis, Haraka, and many others.

craigslist (CL) has released the following open source projects:

CL blob service <https://github.com/craigslist/python-clblob> - a simple
HTTP-based, multi-master storage service designed for scale-out and
multi-datacenter deployments:

- multi-master architecture with no single point of failure
- scales well for both read and write intensive workloads
- tracks TTLs for automatic expiration and purging of blobs
- designed for both local and multiple data center replication
- pluggable index and storage interface (uses SQLite for index and
filesystem for storage by default)

CL image service <https://github.com/craigslist/python-climage> - large
scale image resizing and processing HTTP service:

- flexible API to choose any quality, size, and center-cropping
- automatically handles orientation operations from EXIF data
- stores resized images in the blob service (could use other stores)

memcache cluster proxy (MCP) <https://github.com/craigslist/mcp> - a
high-performance modular clustering HTTP reverse proxy:

- high-performance event-driven daemon
- flexible configuration, easily extensible framework
- uses standard memcached memory store for caching
- supports PCRE and rule-based traffic routing by URL, headers, and more
- tracks health of origin servers, routes around failures
- provides configurable URL redirects, rewrites, and real-time
header transformations

In addition, craigslist contributes code to the following open source
projects:

Haraka <http://haraka.github.io/>:

- added the smtp_client code that helps support pooled connections for
proxy queues
- rewrote all of the smtp_proxy and smtp_forward code
- major contributions to the test suite
- plugin that does strict DNS checking, DNS access control lists
- contributions to bannering support
- logging infrastructure changes for more robust logging
- plugins for aliases, access lists, etc.

Redis <https://github.com/antirez/redis>:

- perl-AnyEvent-Redis-Federated: an event-based redis client that
implements client-side sharding in Perl
- redis_util: s collection of utilities for node-redis
- provided support for included config files

Sphinx <http://en.wikipedia.org/wiki/Sphinx_(search_engine)>:

- provided the original persistent connections implementation
- craigslist sponsors useful sphinx feature developments, such as the
TRUNCATE INDEX command for real-time sphinx

The craigslist Charitable Fund
<http://www.craigslist.org/about/charitable> supports
open source nonprofit organizations including:

- Apache Software Foundation <http://www.apache.org/>
- Free Software Foundation <http://www.fsf.org/>
- Gnome Foundation <http://www.gnome.org/>
- Mozilla Foundation <http://www.mozilla.org/>
- Open Source Initiative <http://www.opensource.org/>
- OpenStreetMap.us <http://openstreetmap.us/>
- Perl Foundation <http://www.perlfoundation.org/>
- PostgreSQL <http://www.postgresql.org/>
- Python Software Foundation <http://www.python.org/>
- Software in the Public Interest <http://www.spi-inc.org/>

</quote>

Isn't that cool!
--
:-)~MIKE~(-:
---------------------------------------------------
PLUG-discuss mailing list -
To subscribe, unsubscribe, or to change your mail settings:
http://lists.phxlinux.org/mailman/listinfo/plug-discuss