Gluster#GlusterFS
{{short description|Open-source software project supported by Red Hat}}
{{Infobox company
| name = Gluster, Inc.
| logo = Image:Gluster-Logo-thumbnail5.png
| type = Privately funded
| foundation = 2005
| location_city = Sunnyvale, California and Bangalore, India
| locations = 2
| key_people = Anand Babu (AB) Periasamy (CTO) and Hitesh Chellani (CEO)
| num_employees = 60
| industry = Software, computer storage
| products = Cloud storage
| homepage = {{URL|www.gluster.com}}
}}
Gluster Inc. (formerly known as Z RESEARCH{{cite web |url=http://www.gluster.com/company/index.php |archive-url=https://web.archive.org/web/20100909083833/http://www.gluster.com/company/index.php |archive-date=2010-09-09 |title=About Us |date=2008 |website=gluster.com |access-date=2022-07-31}}{{cite news |last=Raj |first=Chandan |date=2011-09-20 |title=California based Indian Entrepreneurs powering petabytes of cloud storage, the Gluster story |url=https://www.scribd.com/document/463502051/Gluster-History-PDVSA |journal=YourStory |publisher=Scribd |location=Bengaluru, India |access-date=2022-07-31}}{{cite mailing list |url=https://lists.nongnu.org/archive/html/gluster-devel/2007-05/msg00127.html |title=Roadmap and support questions. |date=2007-05-12 |access-date=31 July 2022 |mailing-list=gluster-devel |last=Chellani |first=Hitesh |author-link= |quote=Z Research was officially formed in June 2005 by AB (Anand Babu) aka "rooty" who is the CTO and myself with the goal of commoditizing Supercomputing and Superstorage and in the process validating yet another a business model around "Free Software", thus evangelizing "Free Software" and promoting the fact building businesses around "Free Software" is the way forward.}}) was a software company that provided an open source platform for scale-out public and private cloud storage. The company was privately funded and headquartered in Sunnyvale, California, with an engineering center in Bangalore, India. Gluster was funded by Nexus Venture Partners and Index Ventures. Gluster was acquired by Red Hat on October 7, 2011.{{cite web |url=http://www.redhat.com/promo/storage/press-release.html |title=Red Hat to Acquire Gluster |publisher=redhat.com |date=October 4, 2011 |access-date=2013-08-16 |url-status=dead |archive-url=https://web.archive.org/web/20130530203435/http://www.redhat.com/promo/storage/press-release.html |archive-date=May 30, 2013 }}
History
The name Gluster comes from the combination of the terms GNU and cluster. Despite the similarity in names, Gluster is not related to the Lustre file system and does not incorporate any Lustre code.
Gluster based its product on GlusterFS, an open-source software-based network-attached filesystem that deploys on commodity hardware.{{cite web|url=http://www.infostor.com/nas/gluster-open-source-scale-out-nas-.html |title=Gluster: Open source scale-out NAS |publisher=InfoStor.com |date=2011-02-17 |access-date=2013-08-16}} The initial version of GlusterFS was written by Anand Babu Periasamy, Gluster's founder and CTO.{{cite web|last=Kovar |first=Joseph F. |url=http://www.crn.com/slide-shows/storage/225700107/2010-storage-superstars-25-you-need-to-know.htm?pgno=17 |title=Page 17 - 2010 Storage Superstars: 25 You Need To Know |date=21 June 2010 |publisher=Crn.com |access-date=2013-08-16}}
In May 2010 Ben Golub became the president and chief executive officer.{{Cite news |title= Former Plaxo CEO Ben Golub Joins Gluster, An Open Source Storage Platform Startup |date= May 18, 2010 |author= Jason Kincaid |work= Tech Crunch |url= https://techcrunch.com/2010/05/18/former-plaxo-ceo-ben-golub-joins-gluster-an-open-source-storage-platform-startup/ |access-date= August 20, 2013 }}{{Cite news |title= Former Plaxo CEO takes top spot at Gluster |date= May 19, 2010 |work= Silicon Valley Business Journal |url= http://www.bizjournals.com/sanjose/stories/2010/05/17/daily50.html |access-date= August 20, 2013 }}
Red Hat became the primary author and maintainer of the GlusterFS open-source project after acquiring the Gluster company in October 2011.
The product was first marketed as Red Hat Storage Server, but in early 2015 renamed to be Red Hat Gluster Storage since Red Hat has also acquired the Ceph file system technology.{{Cite web |title= New product names. Same Great features. |url= http://app.engage.redhat.com/e/es.aspx?s=1795&e=556851 |archive-url= https://web.archive.org/web/20150402165836/http://app.engage.redhat.com/e/es.aspx?s=1795&e=556851 |archive-date= April 2, 2015 |access-date= October 27, 2016 }}
Red Hat Gluster Storage is in the retirement phase of its lifecycle with a end of support life date of December 31, 2024.{{Cite web |last=Red Hat access website |date=2022-10-10 |title=Red Hat Gluster Storage Life Cycle |url=https://access.redhat.com/support/policy/updates/rhs }}
Architecture
The GlusterFS architecture aggregates compute, storage, and I/O resources into a global namespace. Each server plus attached commodity storage (configured as direct-attached storage, JBOD, or using a storage area network) is considered to be a node. Capacity is scaled by adding additional nodes or adding additional storage to each node. Performance is increased by deploying storage among more nodes. High availability is achieved by replicating data n-way between nodes.
=Public cloud deployment=
For public cloud deployments, GlusterFS offers an Amazon Web Services (AWS) Amazon Machine Image (AMI), which is deployed on Elastic Compute Cloud (EC2) instances rather than physical servers and the underlying storage is Amazon's Elastic Block Storage (EBS).{{cite web|author=Nathan Eddy |url=http://www.eweek.com/c/a/Midmarket/Gluster-Introduces-NAS-Virtual-Appliances-for-VMware-Amazon-Web-Services-148680/ |title=Gluster Introduces NAS Virtual Appliances for VMware, Amazon Web Services |publisher=Eweek.com |date=2011-02-11 |access-date=2013-08-16}} In this environment, capacity is scaled by deploying more EBS storage units, performance is scaled by deploying more EC2 instances, and availability is scaled by n-way replication between AWS availability zones.
=Private cloud deployment=
A typical on-premises, or private cloud deployment will consist of GlusterFS installed as a virtual appliance on top of multiple commodity servers running hypervisors such as KVM, Xen, or VMware; or on bare metal.{{cite web|title=Gluster Virtual Storage Appliance|url=http://www.storage-switzerland.com/Blog/Entries/2011/2/22_Gluster_Virtual_Storage_Appliance.html|publisher=Storage Switzerland, LLC|access-date=1 September 2013}}
GlusterFS
{{Infobox software
| name = GlusterFS
| author = Gluster
| developer = Red Hat, Inc.
| latest release version = 11.1{{cite web|url=https://github.com/gluster/glusterfs/tags|title=github tags|date=6 November 2023 |access-date=6 January 2025}}
| latest release date = {{release date|df=yes|2023|11|06}}
| operating system = Linux, OS X, FreeBSD, NetBSD, OpenSolaris
| genre = Distributed file system
| license = GNU General Public License v3{{cite web |url=https://gluster.org/community/documentation/index.php/Gluster_3.1:_Understanding_the_GlusterFS_License |title=Gluster 3.1: Understanding the GlusterFS License |work=Gluster Documentation |publisher=Gluster.org |access-date=30 April 2014 |archive-date=3 May 2016 |archive-url=https://web.archive.org/web/20160503143527/http://www.gluster.org/community/documentation/index.php/Gluster_3.1:_Understanding_the_GlusterFS_License |url-status=dead }}
| website = {{URL|www.gluster.org}}
| repo = {{URL|github.com/gluster}}
}}
GlusterFS is a scale-out network-attached storage file system. It has found applications including cloud computing, streaming media services, and content delivery networks. GlusterFS was developed originally by Gluster, Inc. and then by Red Hat, Inc., as a result of Red Hat acquiring Gluster in 2011.{{cite web|author1=Timothy Prickett Morgan|title=Red Hat snatches storage Gluster file system for $136m|url=https://www.theregister.co.uk/2011/10/04/redhat_buys_gluster/|publisher=The Register|access-date=3 July 2016|date=4 October 2011}}
In June 2012, Red Hat Storage Server was announced as a commercially supported integration of GlusterFS with Red Hat Enterprise Linux.{{Cite news |title= Red Hat Storage Server NAS takes on Lustre, NetApp |author= Timothy Prickett Morgan |work= The Register |date= 27 June 2012 |url= https://www.theregister.co.uk/2012/06/27/redhat_storage_server_2_launch/ |access-date= 30 May 2013 }} Red Hat bought Inktank Storage in April 2014, which is the company behind the Ceph distributed file system, and re-branded GlusterFS-based Red Hat Storage Server to "Red Hat Gluster Storage".{{cite web|url=http://app.engage.redhat.com/e/es.aspx?s=1795&e=556851 |title=Red Hat Storage. New product names. Same great features. |website=redhat.com |date=20 March 2015 |access-date=20 March 2015 |url-status=dead |archive-url=https://web.archive.org/web/20150402165836/http://app.engage.redhat.com/e/es.aspx?s=1795&e=556851 |archive-date=2 April 2015 }}
= Design =
GlusterFS aggregates various storage servers over Ethernet or Infiniband RDMA interconnect into one large parallel network file system. It is free software, with some parts licensed under the GNU General Public License (GPL) v3 while others are dual licensed under either GPL v2 or the Lesser General Public License (LGPL) v3. GlusterFS is based on a stackable user space design.
GlusterFS has a client and server component. Servers are typically deployed as storage bricks, with each server running a {{mono|glusterfsd}} daemon to export a local file system as a volume. The {{mono|glusterfs}} client process, which connects to servers with a custom protocol over TCP/IP, InfiniBand or Sockets Direct Protocol, creates composite virtual volumes from multiple remote servers using stackable translators. By default, files are stored whole, but striping of files across multiple remote volumes is also possible. The client may mount the composite volume using a GlusterFS native protocol via the FUSE mechanism or using NFS v3 protocol using a built-in server translator, or access the volume via the {{mono|gfapi}} client library. The client may re-export a native-protocol mount, for example via the kernel NFSv4 server, SAMBA, or the object-based OpenStack Storage (Swift) protocol using the "UFO" (Unified File and Object) translator.
Most of the functionality of GlusterFS is implemented as translators, including file-based mirroring and replication, file-based striping, file-based load balancing, volume failover, scheduling and disk caching, storage quotas, and volume snapshots with user serviceability (since GlusterFS version 3.6).
The GlusterFS server is intentionally kept simple: it exports an existing directory as-is, leaving it up to client-side translators to structure the store. The clients themselves are stateless, do not communicate with each other, and are expected to have translator configurations consistent with each other. GlusterFS relies on an elastic hashing algorithm, rather than using either a centralized or distributed metadata model. The user can add, delete, or migrate volumes dynamically, which helps to avoid configuration coherency problems. This allows GlusterFS to scale up to several petabytes on commodity hardware by avoiding bottlenecks that normally affect more tightly coupled distributed file systems.
GlusterFS provides data reliability and availability through various kinds of replication: replicated volumes and geo-replication.{{Cite news |title= GlusterFS Documentation |url= https://docs.gluster.org/en/latest/Quick-Start-Guide/Architecture/ |access-date= January 28, 2018 }} Replicated volumes ensure that there exists at least one copy of each file across the bricks, so if one fails, data is still stored and accessible. Geo-replication provides a leader-follower model of replication, where volumes are copied across geographically distinct locations. This happens asynchronously and is useful for availability in case of a whole data center failure.
GlusterFS has been used as the foundation for academic research{{cite conference
| url = http://nowlab.cse.ohio-state.edu/publications/conf-papers/2008/noronha-icpp08.pdf
| title = IMCa: A High Performance Caching Front-End for GlusterFS on InfiniBand
| last1 = Noronha | first1 = Ranjit
| last2 = Panda | first2 = Dhabaleswar K
| date = 9–12 September 2008
| conference = 37th International Conference on Parallel Processing, 2008. ICPP '08.
| conference-url = https://ieeexplore.ieee.org/xpl/conhome/4625814/proceeding
| publisher = IEEE
| doi = 10.1109/ICPP.2008.84
| access-date = 14 June 2011
Red Hat markets the software for three markets: "on-premises", public cloud and "private cloud".{{cite web |title= Red Hat Storage Server |work= Web site |publisher= Red Hat |url= http://www.redhat.com/products/storage-server/ |access-date= 30 May 2013 }}
See also
{{Portal|Free and open-source software|Linux}}
{{Div col|colwidth=20em}}
- BeeGFS
- Ceph (software)
- Distributed file system
- Distributed parallel fault-tolerant file systems
- Gfarm file system
- IBM Storage Scale (GPFS)
- LizardFS
- Lustre
- MapR FS
- Moose File System
- OrangeFS
- Parallel Virtual File System
- Quantcast File System
- RozoFS
- XtreemFS
- ZFS
{{div col end}}