Facebook Open-sourced

Facebook Open-sourced

By:


Isnt it great that companies like Facebook and Googles massive Web applications also contribute back to the community by opening their code to developers? Facebook is famous for delivering a great user experience regardless of huge traffic and immense usage of its applications. Are you a Web server administrator interested in these technologies especially now that most of the components are public?
We at Monitis want to inform you about these technologies because they make life easy for sysadmins, and make them heroes to employees for delivering high availability and performance. Moreover, like Facebook, we also deliver free products for instance our free web server monitoring through Mon.itor.us, and were providing other free tools for web sysadmins (like Instant Ping, Instant Website Check and free Web Load Testing).
Heres a brief on Facebooks open-source infrastructure products:
URL: http://cassandra.apache.org/
Apache Cassandra is a redundant, scalable storage solution designed to eliminate entry and retrieval failures for structured data. The structures are stored across multiple servers
using multi-dimensional maps with row keys represented as strings of unspecified length, but usually conform to 16 to 36 bytes in length. Operations are performed under these row keys that function across these multiple dimensions of a row.
URL: http://hive.apache.org/
Apache Hive is a data warehouse that is built to provide everything from tools that can enable data summarization to analyzing large data sets. Apache Hive can also provide tools to create data extraction as well as transforming and loading data from many sources. It can also give designers the mechanism to put structures on their data. Apache Hive can define any simple SQL query language. In turn, that enables any analyst to own the data. Apache Hive is currently in beta mode on Facebook. Other companies such as CNET, Netflix, and eHarmony are using Apache Hive for other purposes such as business intelligence and analytics.
URL: https://github.com/facebook/flashcache/
FlashCache is a loadable Linux kernel module, a write-back block cache program designed to speed up access to data. It uses the Device Mapper and resides below the file system. Users of FlashCache have reported I/O throughput increases of up to 75% without additional hard drive space. In fact, you can reduce the number of hard drives by three-quarters without an impact on performance. Plus, you can increase e-mail users by two-thirds. FlashCache is essentially plug-and-play, with some customization or tuning possible. It works with all NetApp software and all storage protocols.
URL: https://github.com/facebook/hiphop-php/
HipHop, a project designed for transforming PHP source code into highly optimized C++, offers large performance gains and has been in development for the past two years. It is still continuing to grow and develop to constantly bring the customer the best. Facebook strives to load quick, and to run efficiently, and for the last six years Facebook has been able to do that because of PHP. PHP is a simply language. Its easy to learn, write, read and debug; because of that, it is a great language for new engineers to make innovations into Facebook. HipHop has taken Facebooks PHP and converted it into C++ to decrease the webpages CPU usage on the servers by nearly 50%. The less CPU that is used, the fewer servers are needed, which means less overhead for an organization. HipHop has greatly helped Facebook, and is looking to help others.
URL:
http://opencompute.org/
The Open Compute Project, is an open hardware project that has a goal of speeding up innovation of servers as well as speeding up data centers. They want to maximize computing efficiency by bringing together the best techniques and specs for the project. The major hold up to this has been the fabrication difficulty of working with the new microprocessors, which have become very specific to certain market niches and that makes them more difficult to work with. Companies that are trying to monopolize supporting a true Open Source Microprocessor, generally do not have any incentive to support multiple microprocessor use. This has created issues in the personal computer market, which has halted any new architectural innovation and progress.
URL: https://github.com/facebook/scribe
Scribe. One can not overestimate the value of aggregating massive amounts of logged data from as many servers as possible. As Facebook grew, they realized a need for a system to allow them to monitor and manipulate log data from their servers. They created Scribe, which is capable of logging billions of messages from hundreds of thousands of machines each day. Scribe is open source, fully scalable, and works in real time, accepting performance statistics, access logs and all other Facebook user events. The Metadata gathered can then be analyzed in any number of ways in order to create a complete picture of current operations, as well as to extract data for future use and initiatives.
URL: http://thrift.apache.org/
Apache Thrifts framework enables cross-language C++ development, as well as program development through Java, Python, PHP and Ruby. Thrift also has the ability to stack for creating both clients and servers. Thrifts definition generates the top portion of the code. The services provided are generated from the file client and processor codes. In opposition to the standard built-in types, it uses created structured data which is then sent as generated code. Both the protocol and transport layer are integral parts of the run-time library. Thrift allows for a change of both protocol and transport without the necessity of the compilation of code. Separate from the client issue Thrift also uses infrastructures to pool protocols and transports together. It allows blocking, non-blocking and multi-blocking servers to work together seamlessly. The underlying I/O part of the stack is also able to support multiple languages.
URL: http://www.tornadoweb.org/
Tornado is a web server that features framework written in another program called Python. Tornado is specialized to handle simultaneous connections from a server which makes it ideal for real-time services. Tornado is an open-source version of a web service as some of the tools used on Facebook can be used more often at FriendFeed. The framework in Tornado is distinct from many web server frameworks because it doesnt block any server; plus Tornado is reasonably fast. Because Tornado is non-blocking and uses ePoll, it can handle thousands of simultaneous connections that can cause the framework to track any real-time services. Tornado is built as a web server that can handle FriendFeeds real-time features. Every active user on FriendFeed must maintain an open collection to the FriendFeed servers.
Making life easier for sysadmins is what Monitis is all about, and the reason behind the development of such recent products as the worlds first free server monitoring as a service, the first mobile app for free server monitoring, a free page-load tester, and so much more. We hope that this briefing of Facebook open-source infrastructure technology makes your life easier, too!
About Mon.itor.Us
Mon.itor.us is the world's first free all-in-one, Cloud-based, server-monitoring service -- providing both external (measuring application uptime and end-user experience) and internal server resources monitoring (tracking used disk space, RAM, CPU, traffic). Mon.itor.Us is faster to deploy and cheaper to use than even open-source monitoring software, as there is no need to set up and maintain a monitoring server. Mon.itor.Us is a part of the Monitis family of monitoring applications, providing professional, premium all-in-one monitoring services integrating application performance with backend infrastructure with cloud monitoring.

For more information, contact:
Monitis Inc.
Sales & Marketing Department
sales@monitis.com
http://www.monitis.com
US & Canada Toll Free: +1-800-657-7949

About the Author:



Article Originally Published On: http://www.articlesnatch.com


Tags: , ,

|

Loading...
Related....
Videos...

Recent Software Articles

Comments

Still can't find what you are looking for? Search for it!

Loading

Site Navigation:

Copyright 2005-2011 ArticleSnatch, LLC - All Rights Reserved.
Privacy Policy | Terms of Service.