Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > alt.os.linux > #81666

Re: GlusterFS with replica 3

Show all headers | View raw

On 05/07/2025 08.41, ^Bart wrote:

> I have a cluster with the latest GlusterFS on Debian12 with three nodes 
> but when I try a simple du -sh of the /var/www the node went in "N" 
> state and it doesn't come back to Y so I need to manually restart 
> glusterd daemon.

Have you seen anything in the logs? Maybe check 
/var/log/glusterfs/glusterd.log
It can be lock that hasn't been released, sadly only fix is to restart 
glusterd.


> If I don't run backup, rsync, du, etc. the cluster works well, I used 
> also vmstat to see ram, cpu and disk; I have 4 vcpu 70% and 8GB of ram 
> for each node, free ram is roughly of 300MB, used about 1,5GB and 
> buffer/cache about 5GB.

It's quite many years since I used GlusterFS, but back then at work we 
had quite large DELL servers (64GB RAM, 2 CPU with 8 cores each) with 
SAN based storage as nodes, the system got degradation with having high 
read/write. In the end those was replaced by standard NFS servers which 
gave more stability and then have replication from one SAN to another, 
sure not a fully HA solution.

I think I should have pushed more for Lustre and the guys at CERN were 
really helpful when I did some testing with just a simple setup which 
needed a bit more nodes, sadly the requirements changed on the way that 
made we needed to provide the file system to a closed source operating 
system with poor file system support.


> I read on internet AWS starts from 16GB of ram for GlusterFS, other 
> documents said to use 12GB of ram, do you have experience about it?
gluster.org do write, for basic nodes: 2 CPU’s, 4GB of RAM each, 1 
Gigabit network.

-- 
  //Aho

Back to alt.os.linux | Previous | Next — Previous in thread | Next in thread | Find similar

Thread

GlusterFS with replica 3 ^Bart <none@none.it> - 2025-07-05 08:41 +0200
  Re: GlusterFS with replica 3 Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-07-05 07:18 +0000
  Re: GlusterFS with replica 3 Daniel70 <daniel47@eternal-september.org> - 2025-07-05 20:08 +1000
    Re: GlusterFS with replica 3 vallor <vallor@cultnix.org> - 2025-07-06 02:09 +0000
      Re: GlusterFS with replica 3 Paul <nospam@needed.invalid> - 2025-07-06 04:12 -0400
  Re: GlusterFS with replica 3 "J.O. Aho" <user@example.net> - 2025-07-05 17:25 +0200
    Re: GlusterFS with replica 3 ^Bart <none@none.it> - 2025-07-07 22:52 +0200
      Re: GlusterFS with replica 3 "J.O. Aho" <user@example.net> - 2025-07-08 09:10 +0200
        Re: GlusterFS with replica 3 ^Bart <none@none.it> - 2025-10-26 21:25 +0100
          Re: GlusterFS with replica 3 Lawrence D’Oliveiro <ldo@nz.invalid> - 2025-10-26 20:56 +0000
            Re: GlusterFS with replica 3 Joerg Walther <joerg.walther@magenta.de> - 2025-10-27 17:40 +0100
              Re: GlusterFS with replica 3 Lawrence D’Oliveiro <ldo@nz.invalid> - 2025-10-27 21:15 +0000
                Re: GlusterFS with replica 3 "J.O. Aho" <user@example.net> - 2025-10-28 09:10 +0100
                Re: GlusterFS with replica 3 Lawrence D’Oliveiro <ldo@nz.invalid> - 2025-10-28 23:09 +0000

csiph-web