{"id":847,"date":"2015-10-02T19:30:00","date_gmt":"2015-10-02T11:30:00","guid":{"rendered":"http:\/\/www.brofive.org\/?p=847"},"modified":"2018-04-26T00:27:56","modified_gmt":"2018-04-25T16:27:56","slug":"hawq%e6%88%90%e4%b8%baapache%e5%ad%b5%e5%8c%96%e9%a1%b9%e7%9b%ae","status":"publish","type":"post","link":"http:\/\/www.brofive.net\/?p=847","title":{"rendered":"HAWQ\u6210\u4e3aApache\u5b75\u5316\u9879\u76ee"},"content":{"rendered":"<p><span style=\"font-size: large;\"><a href=\"http:\/\/www.brofive.net\/wp-content\/uploads\/2018\/04\/hawq.png\"><img loading=\"lazy\" decoding=\"async\" style=\"display: inline; border: 0px;\" title=\"hawq\" src=\"http:\/\/www.brofive.net\/wp-content\/uploads\/2018\/04\/hawq_thumb.png\" alt=\"hawq\" width=\"593\" height=\"284\" border=\"0\" \/><\/a> <\/span><\/p>\n<p><span style=\"font-size: large;\">\u6628\u5929\u5f97\u77e5Pivotal\u5c06HAWQ\u5f00\u6e90\u4e86\uff0c\u867d\u7136\u548c\u4e4b\u524d\u542c\u8bf4\u7684GreenPlum\u5f00\u6e90\u6709\u6240\u4e0d\u540c\uff0c\u4f46\u662f\u4f30\u8ba1\u57fa\u672c\u4e0a\u4e5f\u5dee\u4e0d\u591a\u4e86\uff0c\u6bd5\u7adfHAWQ\u662fGP Over HDFS\u3002\u5927\u4f53\u7814\u7a76\u4e86\u4e00\u4e0b\uff1a<\/span><\/p>\n<ul>\n<li><span style=\"font-size: large;\">src\uff1a\u5c31\u662f\u4e00\u4e2aPostgreSQL Server\u7684\u4ee3\u7801\uff0c\u5176\u4e2d\u6709\u4e9b\u4ee3\u7801\u6765\u81ea2006\u5e74\u7684\u7248\u672c\uff0c\u6709\u4e9b\u4ee3\u7801\u5374\u53c8\u662f2009\u5e74\u4e4b\u540e\u7684\u4ee3\u7801\uff0c\u770b\u4e0a\u53bb\u662fGP\u5185\u90e8\u7ef4\u62a4\u7684\u4e00\u4e2a\u7248\u672c\uff0c\u5e76\u4e0d\u662f\u5bf9\u5e94\u5230\u793e\u533a\u7684\u67d0\u4e2a\u7248\u672c\u3002 \u5176\u4e2d\u4e3b\u8981\u4ee3\u7801\u662f2006\u5e74\u5bfc\u51fa\u7684\u4ee3\u7801\uff0c\u5982\u679c\u8003\u53e4\u6216\u8bb8\u53ef\u4ee5\u53d1\u73b0\u4e00\u4e9b\u5386\u53f2\u6e0a\u6e90\u3002\u4ee3\u7801\u548c9.0\u7cfb\u5217\u5dee\u5f02\u5f88\u5927\uff0c\u548c8.0\u7248\u672c\u5012\u662f\u66f4\u4e3a\u63a5\u8fd1\u3002 <\/span><span style=\"font-size: large;\">\uff081\uff09<strong>backend<\/strong>\uff1a\u65b0\u589e\u4e86acess external\u4ee3\u7801\uff0c\u591a\u6570\u5e94\u8be5\u662f\u9488\u5bf9PXF\u7684\u6539\u52a8\uff1b\u65b0\u589e\u4e86catalog\u4ee3\u7801\uff0c\u53ef\u4ee5Load Hcatalog\u4ee3\u7801\uff1b\u7d22\u5f15\u90e8\u5206\u4fee\u6539btree\uff1b\u652f\u6301parquet\uff1b\u65b0\u589eCDB\u5b58\u50a8\u5f15\u64ce\uff1b\u4fee\u6539\u6267\u884c\u5668\u548c\u4f18\u5316\u5668\uff1b\u652f\u6301sunos\u3001qnx\u79fb\u690d\uff1b\u65b0\u589eresource manager\uff1b\u65b0\u589e\u626b\u63cfcache<\/span>\n<p><span style=\"font-size: large;\">\uff082\uff09\u5176\u4ed6\u5404\u4e2a\u4ee3\u7801\uff0c\u611f\u89c9GP\u7684\u5de5\u7a0b\u5e08\u4e5f\u633a\u6709\u4f18\u5316\u7cbe\u795e\u7684\u3002\u201dThis is the greenplum logtape implementation.\u00a0 The original postgres logtape impl is unnecessarily complex and it prevents many perfomanace optmizations. \u201d<\/span><\/li>\n<li><span style=\"font-size: large;\">PXF\uff1aPivotal Extented Framework\uff0c\u652f\u6301HAWQ\u67e5\u8be2\u5916\u90e8\u6570\u636e\u6e90\uff0c\u5305\u62ecHIVE\u3001HBASE\u3001HDFS\uff0c\u652f\u6301\u63d2\u4ef6\u5f0f\u63a5\u53e3\u3002Java\u8bed\u8a00\u5f00\u53d1\u7684\u3002\u91cc\u9762\u6709\u51e0\u4e2a\u4e3b\u8981\u7684\u63a5\u53e3\uff1aFragment\u3001Resolver\u3001Accessor\u3001FilterBuilder\uff0c\u5206\u522b\u89e3\u51b3\u6570\u636e\u5206\u533a\u3001\u5217\u540d\u89e3\u6790\u3001\u6570\u636e\u8bbf\u95ee\u548c\u6570\u636e\u8fc7\u6ee4 <\/span><\/li>\n<li><span style=\"font-size: large;\">contrib\uff1a\u4f7f\u7528\u7684\u5916\u90e8Lib\uff0c\u542b\u6570\u636e\u54c8\u5e0c\u548c\u52a0\u5bc6\u3001\u6d4b\u8bd5\u4ee3\u7801\u3001\u9488\u5bf9float\u6570\u7ec4\u7684Sparse Vector\u3001\u5b9a\u957f\u6570\u636e\u5904\u7406 <\/span><\/li>\n<li><span style=\"font-size: large;\">depends\uff1aYARN\u7684C\/C++ Lib <\/span><\/li>\n<li><span style=\"font-size: large;\">tools\uff1agpnetbench\u7528\u6765\u6d4b\u8bd5\u7f51\u7edc\u6027\u80fd<\/span><\/li>\n<\/ul>\n<p><a href=\"http:\/\/hawq.incubator.apache.org\/\"><span style=\"font-size: large;\">http:\/\/hawq.incubator.apache.org\/<\/span><\/a><\/p>\n<p><a href=\"https:\/\/github.com\/apache\/incubator-hawq\"><span style=\"font-size: large;\">https:\/\/github.com\/apache\/incubator-hawq<\/span><\/a><\/p>\n<p><span style=\"font-size: large;\">In a class by itself, only Apache HAWQ (incubating) combines exceptional MPP-based analytics performance, robust ANSI SQL compliance, Hadoop ecosystem integration and manageability, and flexible data-store format support. All natively in Hadoop. No connectors required.<\/span><\/p>\n<p><span style=\"font-size: large;\">Built from a decade\u2019s worth of massively parallel processing (MPP) expertise developed through the creation of the Pivotal Greenplum\u00ae enterprise database and open source PostgreSQL, HAWQ enables to you to swiftly and interactively query Hadoop data, natively via HDFS.<\/span><\/p>\n<p><span style=\"font-size: large;\">HAWQ is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the<\/span><a href=\"http:\/\/incubator.apache.org\/\"><span style=\"font-size: large;\">Incubator<\/span><\/a><span style=\"font-size: large;\">. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u6628\u5929\u5f97\u77e5Pivotal\u5c06HAWQ\u5f00\u6e90\u4e86\uff0c\u867d\u7136\u548c\u4e4b\u524d\u542c\u8bf4\u7684GreenPlum\u5f00\u6e90\u6709\u6240\u4e0d\u540c\uff0c\u4f46\u662f\u4f30\u8ba1\u57fa\u672c\u4e0a\u4e5f\u5dee\u4e0d\u591a&#8230;<\/p>\n","protected":false},"author":1,"featured_media":846,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[22,119],"tags":[153,121],"views":3773,"_links":{"self":[{"href":"http:\/\/www.brofive.net\/index.php?rest_route=\/wp\/v2\/posts\/847"}],"collection":[{"href":"http:\/\/www.brofive.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.brofive.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.brofive.net\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.brofive.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=847"}],"version-history":[{"count":2,"href":"http:\/\/www.brofive.net\/index.php?rest_route=\/wp\/v2\/posts\/847\/revisions"}],"predecessor-version":[{"id":972,"href":"http:\/\/www.brofive.net\/index.php?rest_route=\/wp\/v2\/posts\/847\/revisions\/972"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/www.brofive.net\/index.php?rest_route=\/wp\/v2\/media\/846"}],"wp:attachment":[{"href":"http:\/\/www.brofive.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=847"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.brofive.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=847"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.brofive.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=847"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}