I don't know if this has come up yet but....

Michael Havens bmike1 at gmail.com
Wed Jun 24 16:27:11 MST 2015


I was perusing craigslist and noticed a link that said 'open source'. Being
the ever-curious lad of 44 I clicked the link and wish to share what I
found:

<quote>

craigslist is a big believer in open source software
<http://en.wikipedia.org/wiki/Open-source_software>, and relies heavily
<http://www.craigslist.org/about/thanks> on Linux, MySQL, Perl, Apache,
Sphinx, Redis, Haraka, and many others.

craigslist (CL) has released the following open source projects:

CL blob service <https://github.com/craigslist/python-clblob> - a simple
HTTP-based, multi-master storage service designed for scale-out and
multi-datacenter deployments:

   - multi-master architecture with no single point of failure
   - scales well for both read and write intensive workloads
   - tracks TTLs for automatic expiration and purging of blobs
   - designed for both local and multiple data center replication
   - pluggable index and storage interface (uses SQLite for index and
   filesystem for storage by default)

CL image service <https://github.com/craigslist/python-climage> - large
scale image resizing and processing HTTP service:

   - flexible API to choose any quality, size, and center-cropping
   - automatically handles orientation operations from EXIF data
   - stores resized images in the blob service (could use other stores)

memcache cluster proxy (MCP) <https://github.com/craigslist/mcp> - a
high-performance modular clustering HTTP reverse proxy:

   - high-performance event-driven daemon
   - flexible configuration, easily extensible framework
   - uses standard memcached memory store for caching
   - supports PCRE and rule-based traffic routing by URL, headers, and more
   - tracks health of origin servers, routes around failures
   - provides configurable URL redirects, rewrites, and real-time
   header transformations

In addition, craigslist contributes code to the following open source
projects:

Haraka <http://haraka.github.io/>:

   - added the smtp_client code that helps support pooled connections for
   proxy queues
   - rewrote all of the smtp_proxy and smtp_forward code
   - major contributions to the test suite
   - plugin that does strict DNS checking, DNS access control lists
   - contributions to bannering support
   - logging infrastructure changes for more robust logging
   - plugins for aliases, access lists, etc.

Redis <https://github.com/antirez/redis>:

   - perl-AnyEvent-Redis-Federated: an event-based redis client that
   implements client-side sharding in Perl
   - redis_util: s collection of utilities for node-redis
   - provided support for included config files

Sphinx <http://en.wikipedia.org/wiki/Sphinx_(search_engine)>:

   - provided the original persistent connections implementation
   - craigslist sponsors useful sphinx feature developments, such as the
   TRUNCATE INDEX command for real-time sphinx

The craigslist Charitable Fund
<http://www.craigslist.org/about/charitable> supports
open source nonprofit organizations including:

   - Apache Software Foundation <http://www.apache.org/>
   - Free Software Foundation <http://www.fsf.org/>
   - Gnome Foundation <http://www.gnome.org/>
   - Mozilla Foundation <http://www.mozilla.org/>
   - Open Source Initiative <http://www.opensource.org/>
   - OpenStreetMap.us <http://openstreetmap.us/>
   - Perl Foundation <http://www.perlfoundation.org/>
   - PostgreSQL <http://www.postgresql.org/>
   - Python Software Foundation <http://www.python.org/>
   - Software in the Public Interest <http://www.spi-inc.org/>

</quote>

Isn't that cool!
-- 
:-)~MIKE~(-:
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.phxlinux.org/pipermail/plug-discuss/attachments/20150624/5639e91e/attachment.html>


More information about the PLUG-discuss mailing list