Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.postscript > #3759 > unrolled thread

Documentation for utf8decode and ushow (nee unicodeshow)

Back to article view | Back to comp.lang.postscript

Contents

  Documentation for utf8decode and ushow (nee unicodeshow) David Newall <davidn@davidnewall.com> - 2022-03-06 23:54 +1100
    Re: Documentation for utf8decode and ushow (nee unicodeshow) luser droog <luser.droog@gmail.com> - 2022-03-10 22:26 -0800
    Re: Documentation for utf8decode and ushow (nee unicodeshow) Anthk <anthk@disroot.org> - 2022-12-13 20:51 +0000
      Re: Documentation for utf8decode and ushow (nee unicodeshow) David Newall <davidn@davidnewall.com> - 2022-12-29 17:49 +1100
    Re: Documentation for utf8decode and ushow (nee unicodeshow) rlhamil@smart.net (Richard L. Hamilton) - 2022-12-29 11:46 +0000

#3759 — Documentation for utf8decode and ushow (nee unicodeshow)

Hello All,

I've almost finished my UTF-8 decode and Unicode show work.  Significant
changes are:

1. unicodeshow is now ushow.  The names all got a bit long.
2. The decoder has been rewritten based on code by Thompson and Pike in
    Plan 9.  They wrote an incredibly clever test for overlong sequences.
3. Documentation.  Yes, really! 
https://davidnewall.com/software/utf8show/PostScript%20UTF8%20Extension%20Reference.pdf

Have I left anything out?

Regards,

David

[toc] | [next] | [standalone]

#3760

On Sunday, March 6, 2022 at 6:55:09 AM UTC-6, David Newall wrote:
> Hello All, 
> 
> I've almost finished my UTF-8 decode and Unicode show work. Significant 
> changes are: 
> 
> 1. unicodeshow is now ushow. The names all got a bit long. 
> 2. The decoder has been rewritten based on code by Thompson and Pike in 
> Plan 9. They wrote an incredibly clever test for overlong sequences. 
> 3. Documentation. Yes, really! 
> https://davidnewall.com/software/utf8show/PostScript%20UTF8%20Extension%20Reference.pdf 
> 
> Have I left anything out? 
> 
> Regards, 
> 
> David

Beautiful! 

Found just a few typos: 
p. 3 operator summary: kushow omits map argument
p.6 "it's CharProcs dictionary" errant apostrophe

possible improvement: Maybe add example code for the ushow details.
Sure, it's everywhere else. And you see it soon enough by scrolling either
up or down to the nearest example. But if you bee-line to the simple case,
you don't get the full view/narrow scope base case model all in a nutshell,
you know? Does that make sense? 

possible improvement: show off more fancy characters in the examples?
This is friggin' brilliant. Crow it to the murder!

[toc] | [prev] | [next] | [standalone]

#3820

On 2022-03-06, David Newall <davidn@davidnewall.com> wrote:
> Hello All,
>
> I've almost finished my UTF-8 decode and Unicode show work.  Significant
> changes are:
>
> 1. unicodeshow is now ushow.  The names all got a bit long.
> 2. The decoder has been rewritten based on code by Thompson and Pike in
>     Plan 9.  They wrote an incredibly clever test for overlong sequences.
> 3. Documentation.  Yes, really! 
> https://davidnewall.com/software/utf8show/PostScript%20UTF8%20Extension%20Reference.pdf
>
> Have I left anything out?
>
> Regards,
>
> David

I coudn't get your examples running in GhostScript:

## code 
openbsd$ gs utf8test.ps 
GPL Ghostscript 9.56.1 (2022-04-04)
Copyright (C) 2022 Artifex Software, Inc.  All rights reserved.
This software is supplied under the GNU AGPLv3 and comes with NO WARRANTY:
see the file COPYING for details.
Error: /stackunderflow in --def--
Operand stack:
   Map
Execution stack:
   %interp_exit   .runexec2   --nostringval--   --nostringval--   --nostringval--   2   %stopped_push   --nostringval--   --nostringval--   --nostringval--   false   1   %stopped_push   1990   1   3   %oparray_pop   1989   1   3   %oparray_pop   1977   1   3   %oparray_pop   1833   1   3   %oparray_pop   --nostringval--   %errorexec_pop   .runexec2   --nostringval--   --nostringval--   --nostringval--   2   %stopped_push   --nostringval--
Dictionary stack:
   --dict:761/1123(ro)(G)--   --dict:0/20(G)--   --dict:75/200(L)--
Current allocation mode is local
Current file position is 561

## eof

Any tips on  using it, for instance, with an example how to 
integrate your code as a "library"?

[toc] | [prev] | [next] | [standalone]

#3825

On 14/12/22 07:51, Anthk wrote:
> On 2022-03-06, David Newall<davidn@davidnewall.com>  wrote:
>> I've almost finished my UTF-8 decode and Unicode show work
>
> I coudn't get your examples running in GhostScript:
> 
> ## code
> openbsd$ gs utf8test.ps
 > [...]
 > Any tips on  using it, for instance, with an example how to
 > integrate your code as a "library"?
You'll see some document manager directives in that file:

%%IncludeResource: procset utf8decode
%%IncludeResource: procset unicodeshow
%%IncludeResource: font unifontmedium
%%IncludeResource: encoding unifontmedium

The first two, utf8decode and unicodeshow, are in the same directory. 
The last two define unifontmedium which is a GNU font available at: 
https://fontlibrary.org/en/font/gnu-unifont.  The encoding was generated 
from that font using fontforge.

Include all unifontmedium in the correct place (or adjust the PostScript 
in utf8test) and pass the other files to GS before utf8test:

$ gs -DNOSAFER utf8decode unicodeshow unifontmedium.t42 utf8test.ps

[toc] | [prev] | [next] | [standalone]

#3826

In article <6224af22$1@news.ausics.net>,
	David Newall <davidn@davidnewall.com> writes:
[...]
> 2. The decoder has been rewritten based on code by Thompson and Pike in
>     Plan 9.  They wrote an incredibly clever test for overlong sequences.

Seeing as how they invented UTF-8 encoding, I'm not surprised they had some
elegant ideas for how to work with it. :-)

http://doc.cat-v.org/bell_labs/utf-8_history

-- 
ftp> get |fortune
377 I/O error: smart remark generator failed

Lasik/PRK theme music:
    "In the Hall of the Mountain King", from "Peer Gynt"
(read act 2, scene 6 of the play if that doesn't make sense)

[toc] | [prev] | [standalone]

Back to top | Article view | comp.lang.postscript

csiph-web