Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #76404 > unrolled thread

Re: Unicode in cgi-script with apache2

Back to article view | Back to comp.lang.python

This discussion starts older than the indexed window; earlier articles aren't shown. The article labeled Started by below is the oldest one visible, not the original post.

Contents

  Re: Unicode in cgi-script with apache2 Peter Otten <__peter__@web.de> - 2014-08-16 13:17 +0200
    Re: Unicode in cgi-script with apache2 wxjmfauth@gmail.com - 2014-08-16 07:02 -0700

#76404 — Re: Unicode in cgi-script with apache2

Dominique Ramaekers wrote:

> I've got a little script:
> 
> #!/usr/bin/env python3
> print("Content-Type: text/html")
> print("Cache-Control: no-cache, must-revalidate")    # HTTP/1.1
> print("Expires: Sat, 26 Jul 1997 05:00:00 GMT") # Date in the past
> print("")
> f = open("/var/www/cgi-data/index.html", "r")
> for line in f:
>      print(line,end='')
> 
> If I run the script in the terminal, it nicely prints the webpage
> 'index.html'.
> 
> If access the script through a webbrowser, apache gives an error:
> UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position
> 1791: ordinal not in range(128)
> 
> I've done a hole afternoon of reading on fora and blogs, I don't have a
> solution.
> 
> Can anyone help me?

If the input and output encoding are the same you can avoid the byte-to-text 
(and subsequent text-to-byte conversion) and serve the binary contents of 
the index.html file directly:

#!/usr/bin/env python3
import sys

print("Content-Type: text/html")
print("Cache-Control: no-cache, must-revalidate")    # HTTP/1.1
print("Expires: Sat, 26 Jul 1997 05:00:00 GMT") # Date in the past
print("")
sys.stdout.flush()
with open("/var/www/cgi-data/index.html", "rb") as f:
    for line in f:
        sys.stdout.buffer.write(line)

The flush() is necessary to write pending data before accessing the lowlevel 
stdout.buffer. Instead of the loop you can use any of these:

sys.stdout.buffer.write(f.read()) # not for huge files, but should be OK for
                                  # typical html file sizes
sys.stdout.buffer.writelines(f)
shutil.copyfileobj(f, sys.stdout.buffer) # show off your knowledge 
                                         # of the stdlib ;)


Alternatively you could choose an encoding via the locale:

#!/usr/bin/env python3
import locale
locale.setlocale(locale.LC_ALL, "en_US.UTF-8")

print("Content-Type: text/html")
print("Cache-Control: no-cache, must-revalidate")    # HTTP/1.1
print("Expires: Sat, 26 Jul 1997 05:00:00 GMT") # Date in the past
print("")
with open("/var/www/cgi-data/index.html") as f:
    for line in f:
        print(line, end='')

Python should then use UTF-8 as the default for i/o and the resulting 
scripts looks more familiar.

[toc] | [next] | [standalone]

#76405

Le samedi 16 août 2014 13:17:16 UTC+2, Peter Otten a écrit :
> Dominique Ramaekers wrote:
> 
> 
> 
> > I've got a little script:
> 
> > 
> 
> > #!/usr/bin/env python3
> 
> > print("Content-Type: text/html")
> 
> > print("Cache-Control: no-cache, must-revalidate")    # HTTP/1.1
> 
> > print("Expires: Sat, 26 Jul 1997 05:00:00 GMT") # Date in the past
> 
> > print("")
> 
> > f = open("/var/www/cgi-data/index.html", "r")
> 
> > for line in f:
> 
> >      print(line,end='')
> 
> > 
> 
> > If I run the script in the terminal, it nicely prints the webpage
> 
> > 'index.html'.
> 
> > 
> 
> > If access the script through a webbrowser, apache gives an error:
> 
> > UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position
> 
> > 1791: ordinal not in range(128)
> 
> > 
> 
> > I've done a hole afternoon of reading on fora and blogs, I don't have a
> 
> > solution.
> 
> > 
> 
> > Can anyone help me?
> 
> 
> 
> If the input and output encoding are the same you can avoid the byte-to-text 
> 
> (and subsequent text-to-byte conversion) and serve the binary contents of 
> 
> the index.html file directly:
> 
> 
> 
> #!/usr/bin/env python3
> 
> import sys
> 
> 
> 
> print("Content-Type: text/html")
> 
> print("Cache-Control: no-cache, must-revalidate")    # HTTP/1.1
> 
> print("Expires: Sat, 26 Jul 1997 05:00:00 GMT") # Date in the past
> 
> print("")
> 
> sys.stdout.flush()
> 
> with open("/var/www/cgi-data/index.html", "rb") as f:
> 
>     for line in f:
> 
>         sys.stdout.buffer.write(line)
> 
> 
> 
> The flush() is necessary to write pending data before accessing the lowlevel 
> 
> stdout.buffer. Instead of the loop you can use any of these:
> 
> 
> 
> sys.stdout.buffer.write(f.read()) # not for huge files, but should be OK for
> 
>                                   # typical html file sizes
> 
> sys.stdout.buffer.writelines(f)
> 
> shutil.copyfileobj(f, sys.stdout.buffer) # show off your knowledge 
> 
>                                          # of the stdlib ;)
> 
> 
> 
> 
> 
> Alternatively you could choose an encoding via the locale:
> 
> 
> 
> #!/usr/bin/env python3
> 
> import locale
> 
> locale.setlocale(locale.LC_ALL, "en_US.UTF-8")
> 
> 
> 
> print("Content-Type: text/html")
> 
> print("Cache-Control: no-cache, must-revalidate")    # HTTP/1.1
> 
> print("Expires: Sat, 26 Jul 1997 05:00:00 GMT") # Date in the past
> 
> print("")
> 
> with open("/var/www/cgi-data/index.html") as f:
> 
>     for line in f:
> 
>         print(line, end='')
> 
> 
> 
> Python should then use UTF-8 as the default for i/o and the resulting 
> 
> scripts looks more familiar.

Wrong. It will not work with a Japanese or a Korean iso-2022-xx
html file.

jmf

[toc] | [prev] | [standalone]

Back to top | Article view | comp.lang.python

csiph-web