{"id":1624,"date":"2011-06-12T14:30:00","date_gmt":"2011-06-12T06:30:00","guid":{"rendered":"http:\/\/www.brofive.org\/?p=1624"},"modified":"2018-05-12T21:45:25","modified_gmt":"2018-05-12T13:45:25","slug":"%e8%b7%a8%e6%95%b0%e6%8d%ae%e4%b8%ad%e5%bf%83%e7%9a%84%e7%b3%bb%e7%bb%9f%e5%8f%af%e9%9d%a0%e6%80%a7","status":"publish","type":"post","link":"http:\/\/www.brofive.net\/?p=1624","title":{"rendered":"\u8de8\u6570\u636e\u4e2d\u5fc3\u7684\u7cfb\u7edf\u53ef\u9760\u6027"},"content":{"rendered":"

\u524d\u4e9b\u65f6\u5019\u53c2\u52a0\u4e86\u4e00\u4e9b\u5173\u4e8e\u8de8\u6570\u636e\u4e2d\u5fc3\u7684\u7cfb\u7edf\u53ef\u9760\u6027\u8ba8\u8bba\uff0c\u7ed3\u5408\u4e4b\u524d\u53d1\u751f\u7684\u5404\u9879\u4e91\u8ba1\u7b97\u4e8b\u6545\uff0c\u7279\u522b\u662fAmazon EBS\u4e8b\u6545\u7684\u53cd\u601d\uff0c\u8bbe\u8ba1\u5e76\u5b9e\u73b0\u8de8\u6570\u636e\u4e2d\u5fc3\u7684\u7cfb\u7edf\u53ef\u9760\u6027\u5bf9\u4e91\u8ba1\u7b97\u6280\u672f\u548c\u670d\u52a1\u7684\u53d1\u5c55\u6709\u5f88\u5927\u7684\u610f\u4e49\u3002\u7cfb\u7edf\u7684\u53ef\u9760\u6027\u6709\u591a\u79cd\u7ea7\u522b\uff0c\u5305\u62ec\u5b9e\u65f6\u5907\u4efd\u548c\u5f02\u6b65\u707e\u5907\uff0c\u524d\u8005\u9700\u8981\u7cfb\u7edf\u505a\u7279\u6b8a\u7684\u8bbe\u8ba1\uff0c\u4fdd\u8bc1\u6bcf\u6b21\u66f4\u65b0\u90fd\u88ab\u4e92\u76f8\u540c\u6b65\uff1b\u540e\u8005\u5219\u8f83\u4e3a\u7b80\u5355\uff0c\u53ea\u9700\u665a\u4e0a\u5f02\u6b65\u540c\u6b65\u767d\u5929\u7684\u4e1a\u52a1\u6570\u636e\u5373\u53ef\u3002<\/font> <\/p>\n

\u8ba9\u6211\u4eec\u770b\u770b\u76ee\u524d\u7684\u8de8DC\u53ef\u9760\u6027\u7684\u73b0\u72b6\u3002<\/font> <\/p>\n

\u4e00\u3001Amazon AWS\u670d\u52a1\uff1a\u5e94\u7528\u548c\u5e73\u53f0\u914d\u5408\u5b8c\u89e3\u51b3\u53ef\u9760\u6027\uff0c\u4f46\u662f\u53ef\u4ee5\u63d0\u4f9b\u5f02\u6b65\u590d\u5236\u3002AWS\u6709Zone\u7684\u6982\u5ff5\uff0cZone\u53ef\u4ee5\u770b\u505a\u662fDC\u4e2d\u7684\u96c6\u7fa4\uff0c\u662f\u8fd1\u5904\u7684DC\uff0cZone\u4e4b\u4e0a\u662fRegion\uff0cRegion\u53ef\u4ee5\u770b\u505a\u662f\u8fdc\u7a0bDC\u3002<\/font> <\/p>\n

Data stored in Amazon S3, Amazon SimpleDB, or Amazon Elastic Block Store is redundantly stored in multiple physical locations as part of normal operation of those services and at no additional charge. Amazon S3 and Amazon SimpleDB ensure object durability by storing objects multiple times across multiple datacenters on the initial write and then actively doing further replication in the event of device unavailability or detected bit-rot.<\/font> <\/p>\n

\u4e8c\u3001OpenStack\uff1a\u76ee\u524d\u6b63\u5728\u505a\u8de83\u4e2aDC\u7684\u6f14\u793a\u5e73\u53f0\uff0c\u57fa\u4e8e\u5f00\u6e90\u8f6f\u4ef6<\/font> <\/p>\n

Dell Inc.<\/font><\/a> (Nasdaq: DELL), <\/font>Equinix, Inc.<\/font><\/a>(NASDAQ: EQIX) and <\/font>Rackspace Hosting, Inc.<\/font><\/a> (NYSE: RAX) today announced that they have collaborated to develop an OpenStack\u2122 cloud demonstration and test environment. The demo environment will be available in three data centers: the Equinix International Business Exchange\u2122 (IBX\u00ae) in Silicon Valley, Calif., and Ashburn, Va., and the Rackspace data center in Chicago, Ill. The companies also plan to collaborate on additional demo environments in Equinix data centers in Europe and Asia in the second quarter of 2011. The demonstration environment allows organizations to easily and rapidly assess applications on the open-source cloud platform, simplifying the evaluation process and speeding the deployment of OpenStack proof of concepts (POCs). It is the first demonstration of an open standard platform where geographically dispersed OpenStack clouds can offer customers the ability to move applications and workloads between them.<\/font> <\/p>\n

\u4e09\u3001Rackspace\uff1a\u76ee\u524d\u4e0d\u63d0\u4f9b\u8de8DC\u7684\u53ef\u9760\u6027<\/font> <\/p>\n

\u56db\u3001HBase\uff1a\u76ee\u524d\u4e0d\u63d0\u4f9b\u8de8DC\u7684\u90e8\u7f72\uff0c\u4f46\u662f\u63d0\u4f9bBulk Load\u5de5\u5177\uff0c\u6216\u53ef\u63d0\u4f9b\u5f02\u5730\u707e\u5907<\/font> <\/p>\n

Bulk uploader needs to be able to tolerate myriad data input types. Data will likely need massaging and ultimately, if writing HRegion content directly into HDFS rather than going against hbase API \u2013 preferred since it’ll be dog slow doing bulk uploads going against hbase API \u2013 then it has to be sorted. Using mapreduce would make sense.<\/font> <\/p>\n

Look too at using PIG because it has a few LOAD implementations \u2013 from files on local or HDFS \u2013 and some facility for doing transforms on data moving tuples around. Would need to write a special STORE operator that wrote the data sorted out as HRegions direct into HDFS (This would be different than <\/font>PIG-6<\/font><\/del><\/a> which is about writing into hbase via API).<\/font> <\/p>\n

Also, chatting with Jim, this is a pretty important issue. This is the first folks run into when they start to get serious about hbase.<\/font> <\/p>\n

\u4e94\u3001MongoDB\uff1a\u636e\u8bf4\u53ef\u4ee5\u63d0\u4f9b\u591a\u4e2aDC\u7684\u6570\u636e\u540c\u6b65\uff0c\u7531\u4e8eMongoDB\u662f\u5ba2\u6237\u7aef\u53ef\u9760\u6027\uff0c\u56e0\u6b64\u5e94\u7528\u9700\u8981\u4fdd\u8bc1\u53ef\u9760\u6027\u3002<\/font> <\/p>\n

In version 1.6, 1.8, and when more sophisticated setups are not necessary, basic configuration choices can be sufficient to ensure good performance across multiple data centers.  Primary plus DR site\uff1aUse one site, with one or more set members, as primary. Have a member at a remote site with priority=0\u3002Multi-site with local reads\uff1aAnother configuration would be to have one member in each of three data centers. One node arbitrarily becomes primary, the others though are secondaries and can process reads locally.<\/font> <\/p>\n

\u516d\u3001Linode\uff1a\u5e95\u5c42\u4e0d\u63d0\u4f9b\u53ef\u9760\u6027\u4fdd\u8bc1\uff0c\u9700\u8981\u5e94\u7528\u63d0\u4f9b\uff0c\u5305\u62ec\u540c\u6b65\u548c\u5f02\u6b65\u7684\u590d\u5236<\/font> <\/p>\n

That sounds like a lot of work, doing it all manually. You’re probably better off coming up with something simple but automated. For example, nightly syncing via rsync. Run a cron job on your primary that, through SSH, initiates a blocking (consistent, if your database access is transactional) database dump, rsyncs it and any website changes to the secondary box, and initiates a database import on the secondary box.  In terms of more timely updates for when you post an article, if you’ve got some sort of article posting script, you can just have it execute the script that the nightly cron job executes (or if you have no article posting script, initiate it yourself). The sync should be pretty fast since little will have changed, and while the import on the secondary box might take a while, that shouldn’t matter since your primary box doesn’t need to wait on that.<\/font> <\/p>\n

\u76f8\u5173\u4fe1\u606f\uff1a<\/font> <\/p>\n