Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.arch.embedded > #18877

Re: Filesystem syntax constraints under Windows

From Don Y <this@is.not.me.com>
Newsgroups comp.arch.embedded
Subject Re: Filesystem syntax constraints under Windows
Date 2014-10-21 17:21 -0700
Organization Aioe.org NNTP Server
Message-ID <m26t9v$cb0$1@speranza.aioe.org> (permalink)
References (1 earlier) <m199ak.ao.1@stefan.msgid.phost.de> <m23e85$3jn$1@speranza.aioe.org> <m26m8c$ai5$1@dont-email.me> <m26o1u$2jg$1@speranza.aioe.org> <m26qd9$min$1@dont-email.me>

Show all headers | View raw


Hi Dimiter,

On 10/21/2014 4:32 PM, Dimiter_Popoff wrote:
> On 22.10.2014 г. 01:51, Don Y wrote:
>> ...
>>
>> Under Interix, you bypass Windows' rules for names and write directly to
>> the file system (disk media).
>
> Well writing to a directory entry not through a system call would
> easily break the directory, sure. I don't have to tell you this
> is not the way you want to go in an end product (instability,
> impredictability issues - how will the next OS version treat
> these invalid entries etc. etc.).

But there is no evidence that this is the case!  I.e., I suspect
the Interix subsystem doesn't do "raw I/O".  Rather, uses a
lower level interface to the medium than the "GUI" OS does.

Recall, original DOS treated all filenames as singlecase.
So, "AaA" was not accessible.

<http://support.microsoft.com/kb/100625>

>> So, "touch AaA" creates a file called "AaA" while "touch aaa" creates
>> ANOTHER file -- called "aaa".  Windows Explorer is smart enough (dumb
>> enough?) to display these as separate files.
>
> That's not surprising, once you trick the filesystem with an invalid
> name entry it will not try to do much on it. When it lists a directory
> it will just go through all the entries and list.

But, that's NOT the case in Windows!  :>

E.g., Windows Explorer did not list the folder/directory contents
the same way that the Interix subsystem did.  And, from a DOS box,
"DIR" performed silent translations on the file names!

E.g., "C*c" appears AS "C*c" on the actual volume.  Interix displays
its name as "C*c".  The DIR command displays it as "C?c".  And,
Windows Explorer displays it as "Cc".

I.e., they are implementing special case processing even when the
file name already exists (instead of just treating it as is!)

>> ...  And, will know which
>> one to "open" if I select it with mouse.
>
> That is more surprising to me. It means they go through some sideways
> to locate the clicked file, not by searching for it by name.

I assume the GUI code that displays a folder is given a list of
names to display.  When you click on a name (via mouse), it looks
at cursor's (x,y) and maps that to a particular "line of text"
in the display.  Then, passes a pointer to "list entry number X"
as the result of the "selection".

> In DPS, this could be done by using DEN (directory entry number, well
> it is not a number but pool_no:cluster really), i.e.
> you list the names on the menu, then for each menu entry you store
> the DEN and access the file subsequently based on that (possible
> but impractical).
> Or you can just keep all the files on the menu open and access not by
> name but by "registration" (i.e. "handle").
>
>>> If you want to copy files with duplicate names (i.e. coming from a
>>> unix filesystem) the only correct way is to rename the file(s), e.g.
>>> by appending some unique sequential number or sort of.
>>
>> This is exactly the problem I encounter when trying to "manage"
>> large file collections that originate in UN*X *under* Windows.
>
> Well I figured as much in the meantime :D . That was the underlying
> reason for your initial post I suppose.

Only indirectly.  I wanted to know what I could "get away with"
in mapping my "names" to other contexts (e.g., Windows).  I, for
example, don't reserve '/' (or '\') as path separators.  Or '>'
as a reserved shell redirection operator (artificially prohibiting
it in a filename).  Or, ':' to indicate legacy "devices" (COM1:).

So, I could have names like:

Class::Member
I/O
READ/write
--->
<---

etc.

>> E.g., Makefile and makefile collide in Windows' namespace.  So,
>> I end up with one or the other (depends on which order they are
>> REcreated).
>> .....
>> Bottom line, Windows is an annoyance.
>
> It probably is much worse than an annoyance to program under but
> in the example above I would point the finger at the person who
> has been shortsighted enough to create duplicate file names in
> the unix environment first, then on the way the unix filesystem
> is made to allow duplicate file names being created by users.

But it is not "shortsighted" -- especially as UNIX predated
ALL of MS's offerings!

Again, recall that I'm using these as "object names", not FILE names.
So, they are created by a developer and hide *inside* sources.
If, for example, process A creates an object and calls it "Fred",
it is perfectly reasonable to expect consumers of that object to
refer to it as "Fred" -- and not "fred", "FrEd", "fRED" or "Bob"!

E.g., a service can elect to name it's CURRENT clients using a
template like "client##".  If that service later tried to resolve
"ClIeNt23", it seems reasonable (nay, desireable!) that this
name should NOT resolve (Gee, can't you remember what you
called this client a few microseconds ago??)

> I don't see how you can handle this situation without inserting
> a complete name handling layer between.

I don't tolerate any deviation from that which was originally
specified (*within* my system).  "Say what you mean and mean
what you say".

Dealing with "foreign systems" (e.g., Windows) is the only issue
because it/they are inflexible in their naming conventions.  :<

But, I can accommodate them by just planning on creating
an exported namespace *intended* for their use.

E.g., if I want to make the object named "I/O" accessible, I
can create a namespace in which "io_device" is mapped to
the same object as *my* "I/O".  If the foreign system
can't handle lowercase characters, I can create a different
namespace wherein "IO_DEVICE" maps to my "I/O".  Or,
"IO$DEVICE" for VAX fans...

If Windows (it's GUI) wants to treat "Io_DeViCe" as an alternate
name for the "io_device" that I export, then so be it.  I just
have to have a "method" that fabricates viable names for exported
objects and have that method vary with the foreign system involved.

> For example, this is what I did in a similar situation -  when one
> wants to copy * from a longnamed directory into a shortnamed
> (old, 8.4) one.
> Files get copied by just using the first up to 8 characters and
> up to 4 past the last "." character; if such a name has been
> used already creation will fail (duplicate file name) and the copy
> code before retrying will modify the destination name by replacing
> the last 4 name characters (I think) by the text hex. representation
> of a counter which gets incremented every time it is used.
> No other way around it, you either have to maintain the file name
> data case dependent (human readable) or case independent (in that
> case 8 bytes per file would be plenty). Some bridging between
> these two fundamentally different cases will always be necessary
> if they have to coexist.

Back to comp.arch.embedded | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread


Thread

Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-10 00:31 -0700
  Re: Filesystem syntax constraints under Windows glen herrmannsfeldt <gah@ugcs.caltech.edu> - 2014-10-10 09:06 +0000
    Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-10 13:32 +0200
      Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-10 07:23 -0700
        Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-10 07:26 -0700
          Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-10 19:17 +0300
            Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-10 19:12 +0200
              Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-10 20:34 +0300
              Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-10 11:32 -0700
            Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-10 10:53 -0700
              Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-10 21:24 +0300
                Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-10 13:36 -0700
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-11 00:18 +0300
                Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-10 15:28 -0700
                Re: Filesystem syntax constraints under Windows Tonton Th <tTh@nowhere.invalid> - 2014-10-12 20:07 +0000
                Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-12 19:52 -0700
              Re: Filesystem syntax constraints under Windows Hans-Bernhard Bröker <HBBroeker@t-online.de> - 2014-10-10 21:15 +0200
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-10 23:04 +0300
            Re: Filesystem syntax constraints under Windows Stefan Reuther <stefan.news@arcor.de> - 2014-10-11 11:28 +0200
              Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-11 17:13 +0300
                Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-11 17:26 +0200
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-11 18:51 +0300
                Re: Filesystem syntax constraints under Windows Stefan Reuther <stefan.news@arcor.de> - 2014-10-12 12:04 +0200
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-12 15:59 +0300
                Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-12 08:04 -0700
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-12 18:47 +0300
                Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-12 09:01 -0700
                Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-12 09:05 -0700
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-12 19:17 +0300
                Re: Filesystem syntax constraints under Windows Stefan Reuther <stefan.news@arcor.de> - 2014-10-13 19:26 +0200
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-13 22:00 +0300
                Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-14 10:25 +0200
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-14 13:28 +0300
                Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-14 14:37 +0200
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-14 16:00 +0300
                Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-14 06:19 -0700
                Re: Filesystem syntax constraints under Windows Hans-Bernhard Bröker <HBBroeker@t-online.de> - 2014-10-15 19:57 +0200
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-16 00:06 +0300
                Re: Filesystem syntax constraints under Windows Stefan Reuther <stefan.news@arcor.de> - 2014-10-16 18:16 +0200
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-16 20:49 +0300
                Re: Filesystem syntax constraints under Windows Stefan Reuther <stefan.news@arcor.de> - 2014-10-14 18:59 +0200
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-14 21:39 +0300
                Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-14 23:29 +0200
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-15 00:46 +0300
                Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-15 01:38 +0200
        Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-10 17:31 +0200
          Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-10 10:34 -0700
    Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-10 06:59 -0700
  Re: Filesystem syntax constraints under Windows Stefan Reuther <stefan.news@arcor.de> - 2014-10-10 18:42 +0200
    Re: Filesystem syntax constraints under Windows glen herrmannsfeldt <gah@ugcs.caltech.edu> - 2014-10-10 19:00 +0000
    Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-10 13:43 -0700
      Re: Filesystem syntax constraints under Windows upsidedown@downunder.com - 2014-10-11 11:06 +0300
        Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-11 01:35 -0700
        Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-11 17:24 +0300
        Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-11 17:43 +0200
          Re: Filesystem syntax constraints under Windows Stefan Reuther <stefan.news@arcor.de> - 2014-10-12 12:07 +0200
            Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-12 23:41 +0200
              Re: Filesystem syntax constraints under Windows Stefan Reuther <stefan.news@arcor.de> - 2014-10-13 19:14 +0200
                Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-13 20:18 +0200
                Re: Filesystem syntax constraints under Windows Mel Wilson <mwilson@the-wire.com> - 2014-10-15 18:43 +0000
                Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-15 21:58 +0200
                Re: Filesystem syntax constraints under Windows George Neuner <gneuner2@comcast.net> - 2014-10-15 23:55 -0400
    Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-20 09:45 -0700
      Re: Filesystem syntax constraints under Windows Stefan Reuther <stefan.news@arcor.de> - 2014-10-21 18:47 +0200
        Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-21 15:38 -0700
          Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-21 17:51 -0700
          Re: Filesystem syntax constraints under Windows George Neuner <gneuner2@comcast.net> - 2014-10-22 01:35 -0400
            Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-21 23:22 -0700
              Re: Filesystem syntax constraints under Windows Stefan Reuther <stefan.news@arcor.de> - 2014-10-22 18:39 +0200
                Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-22 11:34 -0700
                Re: Filesystem syntax constraints under Windows upsidedown@downunder.com - 2014-10-22 22:11 +0300
            Re: Filesystem syntax constraints under Windows glen herrmannsfeldt <gah@ugcs.caltech.edu> - 2014-10-23 00:20 +0000
              Re: Filesystem syntax constraints under Windows George Neuner <gneuner2@comcast.net> - 2014-10-23 01:36 -0400
                Re: Filesystem syntax constraints under Windows glen herrmannsfeldt <gah@ugcs.caltech.edu> - 2014-10-23 09:08 +0000
                Re: Filesystem syntax constraints under Windows George Neuner <gneuner2@comcast.net> - 2014-10-23 14:50 -0400
                Re: Filesystem syntax constraints under Windows Hans-Bernhard Bröker <HBBroeker@t-online.de> - 2014-10-23 21:42 +0200
      Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-22 01:21 +0300
        Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-21 15:51 -0700
          Re: Filesystem syntax constraints under Windows glen herrmannsfeldt <gah@ugcs.caltech.edu> - 2014-10-21 23:27 +0000
            Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-21 16:50 -0700
            Re: Filesystem syntax constraints under Windows Hans-Bernhard Bröker <HBBroeker@t-online.de> - 2014-10-22 21:00 +0200
              Re: Filesystem syntax constraints under Windows upsidedown@downunder.com - 2014-10-22 22:54 +0300
          Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-22 02:32 +0300
            Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-21 17:21 -0700
              Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-22 03:52 +0300
                Re: Filesystem syntax constraints under Windows Don Y <this@is.not.me.com> - 2014-10-21 21:13 -0700
            Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-22 08:10 +0200
              Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-22 12:00 +0300
                Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-22 13:11 +0200
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-22 15:19 +0300
                Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-22 15:21 +0200
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-22 17:26 +0300
                Re: Filesystem syntax constraints under Windows Stefan Reuther <stefan.news@arcor.de> - 2014-10-22 18:46 +0200
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-23 02:37 +0300
                Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-22 23:09 +0200
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-23 03:06 +0300
                Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-23 10:18 +0200
                Re: Filesystem syntax constraints under Windows Dimiter_Popoff <dp@tgi-sci.com> - 2014-10-23 13:56 +0300
                Re: Filesystem syntax constraints under Windows David Brown <david.brown@hesbynett.no> - 2014-10-23 15:59 +0200

csiph-web