Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.debian.kernel > #68770

Bug#917706: nfs v2.x

Path csiph.com!aioe.org!bofh.it!news.nic.it!robomod
From Tom H <tomh0665@gmail.com>
Newsgroups linux.debian.bugs.dist, linux.debian.kernel
Subject Bug#917706: nfs v2.x
Date Sat, 05 Dec 2020 15:40:04 +0100
Message-ID <BiGTa-5kX-9@gated-at.bofh.it> (permalink)
References <xauXV-6Yc-13@gated-at.bofh.it>
X-Mailbox-Line From debian-bugs-dist-request@lists.debian.org Sat Dec 5 14:39:08 2020
Old-Return-Path <debbugs@buxtehude.debian.org>
X-Spam-Flag NO
X-Spam-Score -2.348
Reply-To Tom H <tomh0665@gmail.com>, 917706@bugs.debian.org
Resent-To debian-bugs-dist@lists.debian.org
Resent-Cc Debian kernel team <debian-kernel@lists.debian.org>
X-Debian-Pr-Message followup 917706
X-Debian-Pr-Package src:nfs-utils
X-Debian-Pr-Source nfs-utils
X-Spam-Bayes score:0.0000 Tokens: new, 195; hammy, 150; neutral, 154; spammy, 0. spammytokens: hammytokens:0.000-+--python3, 0.000-+--nfsd, 0.000-+--nfsutils, 0.000-+--nfs-utils, 0.000-+--sysconfig
Dkim-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=RXZM7tlB5EmczlkbtM0t2LXDyIO12U5hndRcwazhczo=; b=ZaU5qMXUIQgPceo9G/vEGEshcbnnzpIQuTU4SWcFbzjvfC9IdS3Hr0uawJh8wxtyHy 6fUjAkP3GEHLzVq+9AOqPtW9qPRC+reTI6r3n6Ayhlr7SqSZhT0jSYMTx/gJ6aaMjmcq eL0mcqKfrrA70GRxMDRDxu9QRgOA6Y/1u1L+wOou1xwYzoLsyDZ17ZuoXVNt9YzIMqCA ho0+jtZeyyl/xxTIB953R0NOETWRFMpZ8qI7U4g1S2iOMQsgZDa/8513bQJTWVVt92x4 J0M3aBVRDfvfmFwPqccw1SIf5girglrhyZ7wpzQ2yiAI3t2f5BiJqB5kAbxHYWMQQMH+ pZvQ==
X-Google-Dkim-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=RXZM7tlB5EmczlkbtM0t2LXDyIO12U5hndRcwazhczo=; b=ISoFrwrV59IoTxbZdqbmbUmI+6ayfG7VFC/I0w9k7tAcCOj0U7rbjoQQRhbsJhz/Ao xEZA4u3JdsNaJdHWvbXYLfkURqvFy0y38TLP2DHfK/deRyZRo36OmVjdTrJ8JuqrXqw7 30sDEGm1zCLGRRtEDGXb3LDr9WDJoXfJK+5X8JxDILyPRc3ZxSJmoaDloqPqDmKzQR8G PjXK/CYQz+RbzxsCIX/CVNczCKF1d45RyqgbS6FstdWoYZi6yFCH18lve6fKmzpK5aYL cMSH7WWdD6MF/cuUr7Q3pxe/pzyOo5oyQjNWbTbFbCVruhNGCXtnKRsNOLV+cVJm6dYE pETw==
X-Gm-Message-State AOAM530pYRWhA2LBLoKvhg9qdYosVHHr9SGaUOJzCsTopfCqb2UTQ2Hd kyH3oKcQLHZuzSjIY6uw6sfhANA5I5iGYVoc+mZqNlpF/1Q=
X-Google-SMTP-Source ABdhPJwTGXtilc4Ed7uhxqApauI/qqqRoqXMuBIk+Zb4DSYPd565TRGYh+c3fIFWSkVxVjUG48yX/5DCAMjQCY/ea90=
X-Received by 2002:a05:6830:2083:: with SMTP id y3mr7268051otq.13.1607179016864; Sat, 05 Dec 2020 06:36:56 -0800 (PST)
MIME-Version 1.0
Content-Type text/plain; charset="UTF-8"
X-Debian-Message from BTS
X-Mailing-List <debian-bugs-dist@lists.debian.org> archive/latest/1636608
List-ID <debian-bugs-dist.lists.debian.org>
List-URL <https://lists.debian.org/debian-bugs-dist/>
Approved robomod@news.nic.it
Lines 321
Organization linux.* mail to news gateway
Sender robomod@news.nic.it
X-Original-Date Sat, 5 Dec 2020 15:36:46 +0100
X-Original-Message-ID <CAOdo=SyLKea5+Mu-o1zGAHmtO6_Axk3E6fq2xQYSWAF9NvwRUA@mail.gmail.com>
X-Original-References <CALAAWTiptifGxOxEXXH9Ge8oSkmRY5Fj4rctP0C39+cWnF8XLA@mail.gmail.com>
Xref csiph.com linux.debian.bugs.dist:1035918 linux.debian.kernel:68770

Cross-posted to 2 groups.

Show key headers only | View raw


Should the hold-up to upgrading to nfs-utils v2.x be the migration to
"/etc/nfs.conf", Fedora has a python conversion script

https://src.fedoraproject.org/rpms/nfs-utils/raw/master/f/nfsconvert.py

#!/usr/bin/env python3
"""
Read in the deprecated /etc/sysconfig/nfs file and
set the corresponding values in nfs.conf
"""

from __future__ import print_function
import os
import sys
import getopt
import subprocess
import configparser

CONF_NFS = '/etc/nfs.conf'
CONF_IDMAP = '/etc/idmapd.conf'
SYSCONF_NFS = '/etc/sysconfig/nfs'
SYSCONF_BACKUP = ".rpmsave"
CONF_TOOL = '/usr/sbin/nfsconf'

# options for nfsd found in RPCNFSDARGS
OPTS_NFSD = 'dH:p:rR:N:V:stTuUG:L:'
LONG_NFSD = ['debug', 'host=', 'port=', 'rdma=', 'nfs-version=',
'no-nfs-version=',
             'tcp', 'no-tcp', 'udp', 'no-udp', 'grace-time=', 'lease-time=']
CONV_NFSD = {'-d': (CONF_NFS, 'nfsd', 'debug', 'all'),
             '-H': (CONF_NFS, 'nfsd', 'host', ','),
             '-p': (CONF_NFS, 'nfsd', 'port', '$1'),
             '-r': (CONF_NFS, 'nfsd', 'rdma', 'nfsrdma'),
             '-R': (CONF_NFS, 'nfsd', 'rdma', '$1'),
             '-N': (CONF_NFS, 'nfsd', 'vers$1', 'n'),
             '-V': (CONF_NFS, 'nfsd', 'vers$1', 'y'),
             '-t': (CONF_NFS, 'nfsd', 'tcp', '1'),
             '-T': (CONF_NFS, 'nfsd', 'tcp', '0'),
             '-u': (CONF_NFS, 'nfsd', 'udp', '1'),
             '-U': (CONF_NFS, 'nfsd', 'udp', '0'),
             '-G': (CONF_NFS, 'nfsd', 'grace-time', '$1'),
             '-L': (CONF_NFS, 'nfsd', 'lease-time', '$1'),
             '$1': (CONF_NFS, 'nfsd', 'threads', '$1'),
             '--debug': (CONF_NFS, 'nfsd', 'debug', 'all'),
             '--host': (CONF_NFS, 'nfsd', 'host', ','),
             '--port': (CONF_NFS, 'nfsd', 'port', '$1'),
             '--rdma': (CONF_NFS, 'nfsd', 'rdma', '$1'),
             '--no-nfs-version': (CONF_NFS, 'nfsd', 'vers$1', 'n'),
             '--nfs-version': (CONF_NFS, 'nfsd', 'vers$1', 'y'),
             '--tcp': (CONF_NFS, 'nfsd', 'tcp', '1'),
             '--no-tcp': (CONF_NFS, 'nfsd', 'tcp', '0'),
             '--udp': (CONF_NFS, 'nfsd', 'udp', '1'),
             '--no-udp': (CONF_NFS, 'nfsd', 'udp', '0'),
             '--grace-time': (CONF_NFS, 'nfsd', 'grace-time', '$1'),
             '--lease-time': (CONF_NFS, 'nfsd', 'lease-time', '$1'),
            }

# options for mountd found in RPCMOUNTDOPTS
OPTS_MOUNTD = 'go:d:H:p:N:nrs:t:V:'
LONG_MOUNTD = ['descriptors=', 'debug=', 'nfs-version=', 'no-nfs-version=',
               'port=', 'no-tcp', 'ha-callout=', 'state-directory-path=',
               'num-threads=', 'reverse-lookup', 'manage-gids', 'no-udp']

CONV_MOUNTD = {'-g': (CONF_NFS, 'mountd', 'manage-gids', '1'),
               '-o': (CONF_NFS, 'mountd', 'descriptors', '$1'),
               '-d': (CONF_NFS, 'mountd', 'debug', '$1'),
               '-H': (CONF_NFS, 'mountd', 'ha-callout', '$1'),
               '-p': (CONF_NFS, 'mountd', 'port', '$1'),
               '-N': (CONF_NFS, 'nfsd', 'vers$1', 'n'),
               '-V': (CONF_NFS, 'nfsd', 'vers$1', 'y'),
               '-n': (CONF_NFS, 'nfsd', 'tcp', '0'),
               '-s': (CONF_NFS, 'mountd', 'stat-directory-path', '$1'),
               '-t': (CONF_NFS, 'mountd', 'threads', '$1'),
               '-r': (CONF_NFS, 'mountd', 'reverse-lookup', '1'),
               '-u': (CONF_NFS, 'nfsd', 'udp', '0'),
               '--manage-gids': (CONF_NFS, 'mountd', 'manage-gids', '1'),
               '--descriptors': (CONF_NFS, 'mountd', 'descriptors', '$1'),
               '--debug': (CONF_NFS, 'mountd', 'debug', '$1'),
               '--ha-callout': (CONF_NFS, 'mountd', 'ha-callout', '$1'),
               '--port': (CONF_NFS, 'mountd', 'port', '$1'),
               '--nfs-version': (CONF_NFS, 'nfsd', 'vers$1', 'y'),
               '--no-nfs-version': (CONF_NFS, 'nfsd', 'vers$1', 'n'),
               '--no-tcp': (CONF_NFS, 'nfsd', 'tcp', '0'),
               '--state-directory-path': (CONF_NFS, 'mountd',
'state-directory-path', '$1'),
               '--num-threads': (CONF_NFS, 'mountd', 'threads', '$1'),
               '--reverse-lookup': (CONF_NFS, 'mountd', 'reverse-lookup', '1'),
               '--no-udp': (CONF_NFS, 'nfsd', 'udp', '0'),
              }

# options for statd found in STATDARG
OPTS_STATD = 'o:p:T:U:n:P:H:'
LONG_STATD = ['outgoing-port=', 'port=', 'name=', 'state-directory-path=',
              'ha-callout=', 'nlm-port=', 'nlm-udp-port=']
CONV_STATD = {'-o': (CONF_NFS, 'statd', 'outgoing-port', '$1'),
              '-p': (CONF_NFS, 'statd', 'port', '$1'),
              '-T': (CONF_NFS, 'lockd', 'port', '$1'),
              '-U': (CONF_NFS, 'lockd', 'udp-port', '$1'),
              '-n': (CONF_NFS, 'statd', 'name', '$1'),
              '-P': (CONF_NFS, 'statd', 'state-directory-path', '$1'),
              '-H': (CONF_NFS, 'statd', 'ha-callout', '$1'),
              '--outgoing-port': (CONF_NFS, 'statd', 'outgoing-port', '$1'),
              '--port': (CONF_NFS, 'statd', 'port', '$1'),
              '--name': (CONF_NFS, 'statd', 'name', '$1'),
              '--state-directory-path': (CONF_NFS, 'statd',
'state-directory-path', '$1'),
              '--ha-callout': (CONF_NFS, 'statd', 'ha-callout', '$1'),
              '--nlm-port': (CONF_NFS, 'lockd', 'port', '$1'),
              '--nlm-udp-port': (CONF_NFS, 'lockd', 'udp-port', '$1'),
             }

# options for sm-notify found in SMNOTIFYARGS
OPTS_SMNOTIFY = 'dm:np:v:P:'
CONV_SMNOTIFY = {'-d': (CONF_NFS, 'sm-notify', 'debug', 'all'),
                 '-m': (CONF_NFS, 'sm-notify', 'retry-time', '$1'),
                 '-n': (CONF_NFS, 'sm-notify', 'update-state', '1'),
                 '-p': (CONF_NFS, 'sm-notify', 'outgoing-port', '$1'),
                 '-v': (CONF_NFS, 'sm-notify', 'outgoing-addr', '$1'),
                 '-P': (CONF_NFS, 'statd', 'state-directory-path', '$1'),
                }

# options for idmapd found in RPCIDMAPDARGS
OPTS_IDMAPD = 'vp:CS'
CONV_IDMAPD = {'-v': (CONF_IDMAP, 'general', 'verbosity', '+'),
               '-p': (CONF_NFS, 'general', 'pipefs-directory', '$1'),
               '-C': (CONF_IDMAP, 'general', 'client-only', '1'),
               '-S': (CONF_IDMAP, 'general', 'server-only', '1'),
              }

# options for gssd found in RPCGSSDARGS
OPTS_GSSD = 'Mnvrp:k:d:t:T:R:lD'
CONV_GSSD = {'-M': (CONF_NFS, 'gssd', 'use-memcache', '1'),
             '-n': (CONF_NFS, 'gssd', 'root_uses_machine_creds', '0'),
             '-v': (CONF_NFS, 'gssd', 'verbosity', '+'),
             '-r': (CONF_NFS, 'gssd', 'rpc-verbosity', '+'),
             '-p': (CONF_NFS, 'general', 'pipefs-directory', '$1'),
             '-k': (CONF_NFS, 'gssd', 'keytab-file', '$1'),
             '-d': (CONF_NFS, 'gssd', 'cred-cache-directory', '$1'),
             '-t': (CONF_NFS, 'gssd', 'context-timeout', '$1'),
             '-T': (CONF_NFS, 'gssd', 'rpc-timeout', '$1'),
             '-R': (CONF_NFS, 'gssd', 'preferred-realm', '$1'),
             '-l': (CONF_NFS, 'gssd', 'limit-to-legacy-enctypes', '0'),
             '-D': (CONF_NFS, 'gssd', 'avoid-dns', '0'),
            }

# options for blkmapd found in BLKMAPDARGS
OPTS_BLKMAPD = ''
CONV_BLKMAPD = {}

# meta list of all the getopt lists
GETOPT_MAPS = [('RPCNFSDARGS', OPTS_NFSD, LONG_NFSD, CONV_NFSD),
               ('RPCMOUNTDOPTS', OPTS_MOUNTD, LONG_MOUNTD, CONV_MOUNTD),
               ('STATDARG', OPTS_STATD, LONG_STATD, CONV_STATD),
               ('STATDARGS', OPTS_STATD, LONG_STATD, CONV_STATD),
               ('SMNOTIFYARGS', OPTS_SMNOTIFY, [], CONV_SMNOTIFY),
               ('RPCIDMAPDARGS', OPTS_IDMAPD, [], CONV_IDMAPD),
               ('RPCGSSDARGS', OPTS_GSSD, [], CONV_GSSD),
               ('BLKMAPDARGS', OPTS_BLKMAPD, [], CONV_BLKMAPD),
              ]

# map for all of the single option values
VALUE_MAPS = {'LOCKD_TCPPORT': (CONF_NFS, 'lockd', 'port', '$1'),
              'LOCKD_UDPPORT': (CONF_NFS, 'lockd', 'udp-port', '$1'),
              'RPCNFSDCOUNT': (CONF_NFS, 'nfsd', 'threads', '$1'),
              'NFSD_V4_GRACE': (CONF_NFS, 'nfsd', 'grace-time', '$1'),
              'NFSD_V4_LEASE': (CONF_NFS, 'nfsd', 'lease-time', '$1'),
              'MOUNTD_PORT': (CONF_NFS, 'mountd', 'port', '$1'),
              'STATD_PORT': (CONF_NFS, 'statd', 'port', '$1'),
              'STATD_OUTGOING_PORT': (CONF_NFS, 'statd', 'outgoing-port', '$1'),
              'STATD_HA_CALLOUT': (CONF_NFS, 'statd', 'ha-callout', '$1'),
              'GSS_USE_PROXY': (CONF_NFS, 'gssd', 'use-gss-proxy', '$1')
             }

def eprint(*args, **kwargs):
    """ Print error to stderr """
    print(*args, file=sys.stderr, **kwargs)

def makesub(param, value):
    """ Variable substitution """
    return param.replace('$1', value)

def set_value(value, entry):
    """ Set a configuration value by running nfsconf tool"""
    cfile, section, tag, param = entry

    tag = makesub(tag, value)
    param = makesub(param, value)
    if param == '+':
        param = value
    if param == ',':
        param = value
    args = [CONF_TOOL, "--file", cfile, "--set", section, tag, param]

    try:
        subprocess.check_output(args, stderr=subprocess.STDOUT)
    except subprocess.CalledProcessError as e:
        print("Error running nfs-conf tool:\n %s" % (e.output.decode()))
        print("Args: %s\n" % args)
        raise Exception

def convert_getopt(optname, options, optstring, longopts, conversions):
    """ Parse option string into seperate config items

        Take a getopt string and a table of conversions
        parse it all and spit out the converted config

        Keyword arguments:
        options -- the argv string to convert
        optstring --  getopt format option list
        conversions -- table of translations
    """
    optcount = 0
    try:
        args = options.strip('\"').split()
        optlist, optargs = getopt.gnu_getopt(args, optstring, longopts=longopts)
    except getopt.GetoptError as err:
        eprint(err)
        raise Exception

    setlist = {}
    for (k, v) in optlist:
        if k in conversions:
            # it's already been set once
            param = conversions[k][3]
            tag = k + makesub(conversions[k][2], v)
            if tag in setlist:
                value = setlist[tag][0]
                # is it a cummulative entry
                if param == '+':
                    value = str(int(value) + 1)
                if param == ',':
                    value += "," + v
            else:
                if param == '+':
                    value = "1"
                elif param == ',':
                    value = v
                else:
                    value = v
            setlist[tag] = (value, conversions[k])
        else:
            if v:
                eprint("Ignoring unrecognised option %s=%s in %s" %
(k, v, optname))
            else:
                eprint("Ignoring unrecognised option %s in %s" % (k, optname))


    for v, c in setlist.values():
        try:
            set_value(v, c)
            optcount += 1
        except Exception:
            raise

    i = 1
    for o in optargs:
        opname = '$' + str(i)
        if opname in conversions:
            try:
                set_value(o, conversions[opname])
                optcount += 1
            except Exception:
                raise
        else:
            eprint("Unrecognised trailing arguments")
            raise Exception
        i += 1

    return optcount

def map_values():
    """ Main function """
    mapcount = 0

    # Lets load the old config
    with open(SYSCONF_NFS) as cfile:
        file_content = '[sysconf]\n' + cfile.read()
    sysconfig = configparser.RawConfigParser()
    sysconfig.read_string(file_content)

    # Map all the getopt option lists
    for (name, opts, lopts, conv) in GETOPT_MAPS:
        if name in sysconfig['sysconf']:
            try:
                mapcount += convert_getopt(name,
sysconfig['sysconf'][name], opts,
                                           lopts, conv)
            except Exception:
                eprint("Error whilst converting %s to nfsconf
options." % (name))
                raise

    # Map the single value options
    for name, opts in VALUE_MAPS.items():
        if name in sysconfig['sysconf']:
            try:
                value = sysconfig['sysconf'][name]
                set_value(value.strip('\"'), opts)
                mapcount += 1
            except Exception:
                raise

    # All went well, move aside the old file
    # but dont bother if there were no changes and
    # an old config file already exists
    backupfile = SYSCONF_NFS + SYSCONF_BACKUP
    if mapcount > 0 or not os.path.exists(backupfile):
        try:
            os.replace(SYSCONF_NFS, backupfile)
        except OSError as err:
            eprint("Error moving old config %s: %s" % (SYSCONF_NFS, err))
            raise

# Main routine
try:
    map_values()
except Exception as e:
    eprint(e)
    eprint("Conversion failed. Please correct the error and try again.")
    exit(1)

Back to linux.debian.kernel | Previous | NextPrevious in thread | Find similar | Unroll thread


Thread

Bug#917706: nfs-utils: New upstream release available Christopher Martin <chrsmrtn@gmail.com> - 2018-12-29 23:10 +0100
  Bug#917706: nfs v2.x Tom H <tomh0665@gmail.com> - 2020-12-05 15:40 +0100

csiph-web