I don't know if this has come up yet but....
Michael Havens
bmike1 at gmail.com
Wed Jun 24 16:27:11 MST 2015
I was perusing craigslist and noticed a link that said 'open source'. Being
the ever-curious lad of 44 I clicked the link and wish to share what I
found:
<quote>
craigslist is a big believer in open source software
<http://en.wikipedia.org/wiki/Open-source_software>, and relies heavily
<http://www.craigslist.org/about/thanks> on Linux, MySQL, Perl, Apache,
Sphinx, Redis, Haraka, and many others.
craigslist (CL) has released the following open source projects:
CL blob service <https://github.com/craigslist/python-clblob> - a simple
HTTP-based, multi-master storage service designed for scale-out and
multi-datacenter deployments:
- multi-master architecture with no single point of failure
- scales well for both read and write intensive workloads
- tracks TTLs for automatic expiration and purging of blobs
- designed for both local and multiple data center replication
- pluggable index and storage interface (uses SQLite for index and
filesystem for storage by default)
CL image service <https://github.com/craigslist/python-climage> - large
scale image resizing and processing HTTP service:
- flexible API to choose any quality, size, and center-cropping
- automatically handles orientation operations from EXIF data
- stores resized images in the blob service (could use other stores)
memcache cluster proxy (MCP) <https://github.com/craigslist/mcp> - a
high-performance modular clustering HTTP reverse proxy:
- high-performance event-driven daemon
- flexible configuration, easily extensible framework
- uses standard memcached memory store for caching
- supports PCRE and rule-based traffic routing by URL, headers, and more
- tracks health of origin servers, routes around failures
- provides configurable URL redirects, rewrites, and real-time
header transformations
In addition, craigslist contributes code to the following open source
projects:
Haraka <http://haraka.github.io/>:
- added the smtp_client code that helps support pooled connections for
proxy queues
- rewrote all of the smtp_proxy and smtp_forward code
- major contributions to the test suite
- plugin that does strict DNS checking, DNS access control lists
- contributions to bannering support
- logging infrastructure changes for more robust logging
- plugins for aliases, access lists, etc.
Redis <https://github.com/antirez/redis>:
- perl-AnyEvent-Redis-Federated: an event-based redis client that
implements client-side sharding in Perl
- redis_util: s collection of utilities for node-redis
- provided support for included config files
Sphinx <http://en.wikipedia.org/wiki/Sphinx_(search_engine)>:
- provided the original persistent connections implementation
- craigslist sponsors useful sphinx feature developments, such as the
TRUNCATE INDEX command for real-time sphinx
The craigslist Charitable Fund
<http://www.craigslist.org/about/charitable> supports
open source nonprofit organizations including:
- Apache Software Foundation <http://www.apache.org/>
- Free Software Foundation <http://www.fsf.org/>
- Gnome Foundation <http://www.gnome.org/>
- Mozilla Foundation <http://www.mozilla.org/>
- Open Source Initiative <http://www.opensource.org/>
- OpenStreetMap.us <http://openstreetmap.us/>
- Perl Foundation <http://www.perlfoundation.org/>
- PostgreSQL <http://www.postgresql.org/>
- Python Software Foundation <http://www.python.org/>
- Software in the Public Interest <http://www.spi-inc.org/>
</quote>
Isn't that cool!
--
:-)~MIKE~(-:
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.phxlinux.org/pipermail/plug-discuss/attachments/20150624/5639e91e/attachment.html>
More information about the PLUG-discuss
mailing list