Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.os.linux.misc > #1212 > unrolled thread

ext3 max file size?

Started byRui Maciel <rui.maciel@gmail.com>
First post2011-05-23 01:31 +0100
Last post2011-05-24 21:46 +0000
Articles 12 — 6 participants

Back to article view | Back to comp.os.linux.misc


Contents

  ext3 max file size? Rui Maciel <rui.maciel@gmail.com> - 2011-05-23 01:31 +0100
    Re: ext3 max file size? Aragorn <aragorn@chatfactory.invalid> - 2011-05-23 03:26 +0200
      Re: ext3 max file size? Rui Maciel <rui.maciel@gmail.com> - 2011-05-24 16:56 +0100
    Re: ext3 max file size? Jon Solberg <news@jonsolberg.nospam.se> - 2011-05-23 06:55 +0000
    Re: ext3 max file size? Balwinder S Dheeman <bsd.SANSPAM@anu.homelinux.net> - 2011-05-23 18:50 +0530
      Re: ext3 max file size? Robert Heller <heller@deepsoft.com> - 2011-05-23 10:08 -0500
      Re: ext3 max file size? Rui Maciel <rui.maciel@gmail.com> - 2011-05-24 17:11 +0100
        Re: ext3 max file size? Aragorn <aragorn@chatfactory.invalid> - 2011-05-24 18:35 +0200
          Re: ext3 max file size? Rui Maciel <rui.maciel@gmail.com> - 2011-05-24 17:49 +0100
            Re: ext3 max file size? Robert Heller <heller@deepsoft.com> - 2011-05-24 12:18 -0500
              Re: ext3 max file size? Rui Maciel <rui.maciel@gmail.com> - 2011-05-24 18:31 +0100
            Re: ext3 max file size? Loki Harfagr <l0k1@thedarkdesign.free.fr.INVALID> - 2011-05-24 21:46 +0000

#1212 — ext3 max file size?

FromRui Maciel <rui.maciel@gmail.com>
Date2011-05-23 01:31 +0100
Subjectext3 max file size?
Message-ID<4dd9aae5$0$23410$a729d347@news.telepac.pt>
Does anyone know what's the maximum file size for a file stored in an ext3 
file system?


Thanks in advance,
Rui Maciel

[toc] | [next] | [standalone]


#1213

FromAragorn <aragorn@chatfactory.invalid>
Date2011-05-23 03:26 +0200
Message-ID<ircd3l$e7l$4@dont-email.me>
In reply to#1212
On Monday 23 May 2011 02:31 in comp.os.linux.misc, somebody identifying
as Rui Maciel wrote...

> Does anyone know what's the maximum file size for a file stored in an
> ext3 file system?

It depends on the chosen block size.  This page here...

        http://en.wikipedia.org/wiki/Ext3

... has a nice table. ;-)

-- 
*Aragorn*
(registered GNU/Linux user #223157)

[toc] | [prev] | [next] | [standalone]


#1232

FromRui Maciel <rui.maciel@gmail.com>
Date2011-05-24 16:56 +0100
Message-ID<4ddbd512$0$24144$a729d347@news.telepac.pt>
In reply to#1213
Aragorn wrote:

> It depends on the chosen block size.  This page here...
> 
> http://en.wikipedia.org/wiki/Ext3
> 
> ... has a nice table. ;-)

Yes, but it isn't very useful.  The article only lists a set of limits 
which an implementation might get, and from there, if those limits are 
true, we can only say that the max file size is somewhere between 16GiB 
and 2TiB.  

Is there a way to know what's the maximum file size of a given 
implementation?


Rui Maciel

[toc] | [prev] | [next] | [standalone]


#1215

FromJon Solberg <news@jonsolberg.nospam.se>
Date2011-05-23 06:55 +0000
Message-ID<slrnitk17o.cfa.news@jonsolberg.se>
In reply to#1212
On 2011-05-23, Rui Maciel <rui.maciel@gmail.com> wrote:
> Does anyone know what's the maximum file size for a file stored in an ext3 
> file system?

http://www.google.com/search?q=max+file+size+ext3&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-a

-- 
Jon Solberg (remove "nospam." from email address)

[toc] | [prev] | [next] | [standalone]


#1217

FromBalwinder S Dheeman <bsd.SANSPAM@anu.homelinux.net>
Date2011-05-23 18:50 +0530
Message-ID<3i3qa8xg99.ln2@news.homelinux.net>
In reply to#1212
On 05/23/2011 06:01 AM, Rui Maciel wrote:
> Does anyone know what's the maximum file size for a file stored in an ext3
> file system?

Max file size		16 GB – 2 TB
(I think, the above depends on volume size)
Max number of files	Variable, allocated at creation time[1]
Max filename length	254 bytes[citation needed]
Max volume size		2 TB – 16 TB

See http://en.wikipedia.org/wiki/Ext3 for further details.

-- 
Balwinder S "bdheeman" Dheeman
(http://werc.homelinux.net/contact/)

[toc] | [prev] | [next] | [standalone]


#1218

FromRobert Heller <heller@deepsoft.com>
Date2011-05-23 10:08 -0500
Message-ID<lc2dnWOlbYTB5UfQnZ2dnUVZ_qWdnZ2d@posted.localnet>
In reply to#1217
At Mon, 23 May 2011 18:50:35 +0530 Balwinder S Dheeman <bsd.SANSPAM@anu.homelinux.net> wrote:

> 
> On 05/23/2011 06:01 AM, Rui Maciel wrote:
> > Does anyone know what's the maximum file size for a file stored in an ext3
> > file system?
> 
> Max file size		16 GB – 2 TB
> (I think, the above depends on volume size)
> Max number of files	Variable, allocated at creation time[1]
> Max filename length	254 bytes[citation needed]
> Max volume size		2 TB – 16 TB

I *think* it might also be dependent on whether a 32-bit or 64-bit O/S
is installed -- there was a discussion on the CentOS mailling list about
someone who (for some strange reason) had installed the 32-bit version
of the OS and was having trouble with a really large disk array or something.

> 
> See http://en.wikipedia.org/wiki/Ext3 for further details.
> 

-- 
Robert Heller             -- 978-544-6933 / heller@deepsoft.com
Deepwoods Software        -- http://www.deepsoft.com/
()  ascii ribbon campaign -- against html e-mail
/\  www.asciiribbon.org   -- against proprietary attachments


                                    

[toc] | [prev] | [next] | [standalone]


#1233

FromRui Maciel <rui.maciel@gmail.com>
Date2011-05-24 17:11 +0100
Message-ID<4ddbd8ba$0$24146$a729d347@news.telepac.pt>
In reply to#1217
Balwinder S Dheeman wrote:

> Max file size           16 GB – 2 TB
> (I think, the above depends on volume size)
> Max number of files     Variable, allocated at creation time[1]
> Max filename length     254 bytes[citation needed]
> Max volume size         2 TB – 16 TB
> 
> See http://en.wikipedia.org/wiki/Ext3 for further details.

As those limits vary from platform to platform, is there a way to tell 
what's the file size limit for any given file system?


Thanks in advance,
Rui Maciel

[toc] | [prev] | [next] | [standalone]


#1234

FromAragorn <aragorn@chatfactory.invalid>
Date2011-05-24 18:35 +0200
Message-ID<irgmp8$4jo$3@dont-email.me>
In reply to#1233
On Tuesday 24 May 2011 18:11 in comp.os.linux.misc, somebody identifying
as Rui Maciel wrote...

> Balwinder S Dheeman wrote:
> 
>> Max file size           16 GB – 2 TB
>> (I think, the above depends on volume size)
>> Max number of files     Variable, allocated at creation time[1]
>> Max filename length     254 bytes[citation needed]
>> Max volume size         2 TB – 16 TB
>> 
>> See http://en.wikipedia.org/wiki/Ext3 for further details.
> 
> As those limits vary from platform to platform, is there a way to tell
> what's the file size limit for any given file system?

It *does* vary from platform to platform.  There's no way around that. 
For instance, an x86-32 system is not the same as, say, a SPARC64
system.  Furthermore, different block sizes also have an impact on
maximum filesize between filesystems (by which I mean "block devices").

Here's a more complete comparison...:

        http://en.wikipedia.org/wiki/Comparison_of_file_systems

That table - and the other one I gave you erlier, and which Baldwinder
also gave you - states that 2 TB is the absolute maximum size for a
file on an ext3 filesystem.

-- 
*Aragorn*
(registered GNU/Linux user #223157)

[toc] | [prev] | [next] | [standalone]


#1236

FromRui Maciel <rui.maciel@gmail.com>
Date2011-05-24 17:49 +0100
Message-ID<4ddbe185$0$24153$a729d347@news.telepac.pt>
In reply to#1234
Aragorn wrote:

> It *does* vary from platform to platform.  There's no way around that.

Yes, but is there a way to know what are the file size limits of any given 
ext3 file system?  To put it differently, if you found yourself using any 
random computer which has access to an ext3 partition, is there a way to 
check what's the file size limit of that particular ext3 file system?


Rui Maciel

[toc] | [prev] | [next] | [standalone]


#1237

FromRobert Heller <heller@deepsoft.com>
Date2011-05-24 12:18 -0500
Message-ID<QeadnSMZuoLOdUbQnZ2dnUVZ_t6dnZ2d@posted.localnet>
In reply to#1236
At Tue, 24 May 2011 17:49:11 +0100 Rui Maciel <rui.maciel@gmail.com> wrote:

> 
> Aragorn wrote:
> 
> > It *does* vary from platform to platform.  There's no way around that.
> 
> Yes, but is there a way to know what are the file size limits of any given 
> ext3 file system?  To put it differently, if you found yourself using any 
> random computer which has access to an ext3 partition, is there a way to 
> check what's the file size limit of that particular ext3 file system?
> 
> 
> Rui Maciel
>                                                                                                                      

Does this answer your question:

sauron.deepsoft.com% df /home
Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/mapper/sauron-home
                      10321208   8884168    912752  91% /home
sauron.deepsoft.com% sudo dumpe2fs -h /dev/mapper/sauron-home
dumpe2fs 1.39 (29-May-2006)
Filesystem volume name:   /home
Last mounted on:          <not available>
Filesystem UUID:          82438e28-c63a-4d7e-87bf-1805b9070c40
Filesystem magic number:  0xEF53
Filesystem revision #:    1 (dynamic)
Filesystem features:      has_journal ext_attr resize_inode filetype
needs_recovery sparse_super large_file
Default mount options:    (none)
Filesystem state:         clean
Errors behavior:          Continue
Filesystem OS type:       Linux
Inode count:              1310720
Block count:              2621440
Reserved block count:     131072
Free blocks:              559842
Free inodes:              1192598
First block:              0
Block size:               4096
Fragment size:            4096
Reserved GDT blocks:      639
Blocks per group:         32768
Fragments per group:      32768
Inodes per group:         16384
Inode blocks per group:   512
Filesystem created:       Mon Nov 16 16:51:45 2009
Last mount time:          Fri Apr 22 09:45:58 2011
Last write time:          Fri Apr 22 09:45:58 2011
Mount count:              1
Maximum mount count:      21
Last checked:             Fri Apr 22 09:43:50 2011
Check interval:           15552000 (6 months)
Next check after:         Wed Oct 19 09:43:50 2011
Reserved blocks uid:      0 (user root)
Reserved blocks gid:      0 (group root)
First inode:              11
Inode size:               128
Journal inode:            8
First orphan inode:       99124
Default directory hash:   tea
Directory Hash Seed:      4d07c9c6-6b71-4ada-972e-0f5988fa0c57
Journal backup:           inode blocks
Journal size:             32M

(No it does not give you an exact answer, but I suspect that the max
file size can be computed from information dumped by the dumpe2fs
command, eg info like the Block size, etc.)

-- 
Robert Heller             -- 978-544-6933 / heller@deepsoft.com
Deepwoods Software        -- http://www.deepsoft.com/
()  ascii ribbon campaign -- against html e-mail
/\  www.asciiribbon.org   -- against proprietary attachments


                                                                                 

[toc] | [prev] | [next] | [standalone]


#1238

FromRui Maciel <rui.maciel@gmail.com>
Date2011-05-24 18:31 +0100
Message-ID<4ddbeb70$0$24144$a729d347@news.telepac.pt>
In reply to#1237
Robert Heller wrote:

> Does this answer your question:
> 
> sauron.deepsoft.com% df /home
> Filesystem           1K-blocks      Used Available Use% Mounted on
> /dev/mapper/sauron-home
> 10321208   8884168    912752  91% /home
> sauron.deepsoft.com% sudo dumpe2fs -h /dev/mapper/sauron-home

<snip/>

> (No it does not give you an exact answer, but I suspect that the max
> file size can be computed from information dumped by the dumpe2fs
> command, eg info like the Block size, etc.)

Thanks, Robert.  If the correspondence between block size and the file 
size limit of a given ext3 file system is exactly that which is listed in 
wikipedia's article on the ext3 file system then your suggestion does 
answer my question.  


Once again thanks for the help.  Kudos!
Rui Maciel

[toc] | [prev] | [next] | [standalone]


#1240

FromLoki Harfagr <l0k1@thedarkdesign.free.fr.INVALID>
Date2011-05-24 21:46 +0000
Message-ID<pan.2011.05.24.21.46.41@thedarkdesign.free.fr.INVALID>
In reply to#1236
Tue, 24 May 2011 17:49:11 +0100, Rui Maciel did cat :

> Aragorn wrote:
> 
>> It *does* vary from platform to platform.  There's no way around that.
> 
> Yes, but is there a way to know what are the file size limits of any
> given ext3 file system?  To put it differently, if you found yourself
> using any random computer which has access to an ext3 partition, is
> there a way to check what's the file size limit of that particular ext3
> file system?
> 
> 
> Rui Maciel

maybe a practical way, eat the pudding and fake a make until error brake?
example (untested):

$ dd if=/dev/zero of=/pathtomountfilesys/dumbig bs=256M count=1 seek=8192

$ dd if=/dev/zero of=/pathtomountfilesys/dumbig bs=128M count=1 seek=8192

$ dd if=/dev/zero of=/pathtomountfilesys/dumbig bs=32M count=1 seek=8192

Maybe chose a smaller block (that may speed up the actual writing but
would slow down the seek time) say:

$ dd if=/dev/zero of=/pathtomountfilesys/dumbig bs=1M count=1 seek=2222000

no time nor place here for a real test so if anyone around there
has a pinch off each he'll may report if that's practical or not ;-)

[toc] | [prev] | [standalone]


Back to top | Article view | comp.os.linux.misc


csiph-web