Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #60512

Re: parsing nested unbounded XML fields with ElementTree

Path csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!goblin1!goblin.stu.neva.ru!uio.no!news.tele.dk!news.tele.dk!small.news.tele.dk!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path <python-python-list@m.gmane.org>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.000
X-Spam-Evidence '*H*': 1.00; '*S*': 0.00; 'else:': 0.03; 'root': 0.05; 'element': 0.07; 'nested': 0.07; 'iterate': 0.09; 'parsing': 0.09; 'path)': 0.09; 'received:80.91': 0.09; 'received:80.91.229': 0.09; 'received:gmane.org': 0.09; 'received:list': 0.09; 'stack.': 0.09; 'subject:fields': 0.09; 'subject:parsing': 0.09; 'def': 0.12; '"e"': 0.16; '[])': 0.16; 'from:addr:behnel.de': 0.16; 'from:addr:stefan_ml': 0.16; 'from:name:stefan behnel': 0.16; 'iterable,': 0.16; 'nesting': 0.16; 'node,': 0.16; 'node.': 0.16; 'nodes': 0.16; 'parent:': 0.16; 'pop()': 0.16; 'preserve': 0.16; 'received:80.91.229.3': 0.16; 'received:dip0.t-ipconnect.de': 0.16; 'received:plane.gmane.org': 0.16; 'received:t-ipconnect.de': 0.16; 'redundant.': 0.16; 'subject:XML': 0.16; 'wrote:': 0.18; 'result.': 0.19; 'stefan': 0.19; 'examples': 0.20; 'seems': 0.21; '>>>': 0.22; 'putting': 0.22; 'print': 0.22; 'header:User- Agent:1': 0.23; 'parse': 0.24; 'tells': 0.24; 'fairly': 0.24; 'pass': 0.26; 'header:X-Complaints-To:1': 0.27; 'header:In-Reply- To:1': 0.27; 'tried': 0.27; 'function': 0.29; 'skip:p 30': 0.29; 'am,': 0.29; 'xml': 0.29; 'statement': 0.30; "i'm": 0.30; 'code': 0.31; 'reply.': 0.31; 'depth': 0.31; 'end,': 0.31; 'larry': 0.31; 'node': 0.31; 'file': 0.32; 'this.': 0.32; 'up.': 0.33; 'running': 0.33; 'beginning': 0.33; 'could': 0.34; 'problem': 0.35; 'subject:with': 0.35; "can't": 0.35; 'common': 0.35; 'done.': 0.35; 'but': 0.35; 'i.e.': 0.36; 'done': 0.36; 'thanks': 0.36; 'should': 0.36; 'list': 0.37; 'level': 0.37; 'nov': 0.38; 'to:addr :python-list': 0.38; 'to:addr:python.org': 0.39; 'received:org': 0.40; 'called': 0.40; 'how': 0.40; 'remove': 0.60; 'skip:n 30': 0.60; 'then,': 0.60; 'reaching': 0.61; 'entire': 0.61; 'name:': 0.61; 'simply': 0.61; "you're": 0.61; 'times': 0.62; "you'll": 0.62; 'show': 0.63; 'name': 0.63; 'visit': 0.64; '26,': 0.68; 'received:87.139': 0.84; 'unclear': 0.84; '2013': 0.98
X-Injected-Via-Gmane http://gmane.org/
To python-list@python.org
From Stefan Behnel <stefan_ml@behnel.de>
Subject Re: parsing nested unbounded XML fields with ElementTree
Date Tue, 26 Nov 2013 14:20:28 +0100
References <d75d1f2c-05c6-4fa6-ae0a-28e13de3097a@googlegroups.com> <l71j4q$c8l$1@ger.gmane.org> <CACwCsY4srm_ntffQJoMYX9eS=_E+2U=5SHqE-zrZWNhpwTa1DA@mail.gmail.com>
Mime-Version 1.0
Content-Type text/plain; charset=UTF-8
Content-Transfer-Encoding 7bit
X-Gmane-NNTP-Posting-Host p578baff2.dip0.t-ipconnect.de
User-Agent Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.1.1
In-Reply-To <CACwCsY4srm_ntffQJoMYX9eS=_E+2U=5SHqE-zrZWNhpwTa1DA@mail.gmail.com>
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.15
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list/>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups comp.lang.python
Message-ID <mailman.3238.1385472043.18130.python-list@python.org> (permalink)
Lines 78
NNTP-Posting-Host 2001:888:2000:d::a6
X-Trace 1385472043 news.xs4all.nl 15957 [2001:888:2000:d::a6]:38722
X-Complaints-To abuse@xs4all.nl
Xref csiph.com comp.lang.python:60512

Show key headers only | View raw


Larry Martell, 26.11.2013 13:23:
> On Tue, Nov 26, 2013 at 2:38 AM, Stefan Behnel wrote:
>> Larry.Martell...@gmail.com, 25.11.2013 23:22:
>>> I have an XML file that has an element called "Node". These can be nested to any depth and the depth of the nesting is not known to me. I need to parse the file and preserve the nesting. For exmaple, if the XML file had:
>>>
>>> <Node Name="A">
>>>    <Node Name="B">
>>>       <Node Name="C">
>>>         <Node Name="D">
>>>           <Node Name="E">
>>>
>>> When I'm parsing Node "E" I need to know I'm in A/B/C/D/E. Problem is I don't know how deep this can be. This is the code I have so far:
>>>
>>> nodes = []
>>>
>>> def parseChild(c):
>>>     if c.tag == 'Node':
>>>         if 'Name' in c.attrib:
>>>             nodes.append(c.attrib['Name'])
>>>         for c1 in c:
>>>             parseChild(c1)
>>>     else:
>>>         for node in nodes:
>>>             print node,
>>>         print c.tag
>>>
>>> for parent in tree.getiterator():
>>>     for child in parent:
>>>         for x in child:
>>>             parseChild(x)
>>
>> This seems hugely redundant. tree.getiterator() already returns a recursive
>> iterable, and then, for each nodes in your document, you are running
>> recursively over its entire subtree. Meaning that you'll visit each node as
>> many times as its depth in the tree.
>>
>>
>>> My problem is that I don't know when I'm done with a node and I should
>>> remove a level of nesting. I would think this is a fairly common
>>> situation, but I could not find any examples of parsing a file like
>>> this. Perhaps I'm going about it completely wrong.
>>
>> Your recursive traversal function tells you when you're done. If you drop
>> the getiterator() bit, reaching the end of parseChild() means that you're
>> done with the element and start backing up. So you can simply pass down a
>> list of element names that you append() at the beginning of the function
>> and pop() at the end, i.e. a stack. That list will then always give you the
>> current path from the root node.
> 
> Thanks for the reply. How can I remove getiterator()? Then I won't be
> traversing the nodes of the tree. I can't iterate over tree. I am also
> unclear on where to do the pop(). I tried putting it just after the
> recursive call to parseChild() and I tried putting as the very last
> statement in parseChild() - neither one gave the desired result. Can
> you show me in code what you mean?

untested:

  nodes = []

  def process_subtree(c, path):
      name = c.get('Name') if c.tag == 'Node' else None
      if name:
          path.append(name)
          nodes.append('/'.join(path))

      for c1 in c:
          process_subtree(c1, path)

      if name:
          path.pop()

  process_subtree(tree.getroot(), [])


Stefan

Back to comp.lang.python | Previous | NextPrevious in thread | Next in thread | Find similar | Unroll thread


Thread

parsing nested unbounded XML fields with ElementTree "Larry.Martell@gmail.com" <Larry.Martell@gmail.com> - 2013-11-25 14:22 -0800
  Re: parsing nested unbounded XML fields with ElementTree Chris Angelico <rosuav@gmail.com> - 2013-11-26 09:30 +1100
  Re: parsing nested unbounded XML fields with ElementTree Stefan Behnel <stefan_ml@behnel.de> - 2013-11-26 08:38 +0100
  Re: parsing nested unbounded XML fields with ElementTree Larry Martell <larry.martell@gmail.com> - 2013-11-26 07:23 -0500
  Re: parsing nested unbounded XML fields with ElementTree Stefan Behnel <stefan_ml@behnel.de> - 2013-11-26 14:20 +0100
  Re: parsing nested unbounded XML fields with ElementTree Neil Cerutti <mr.cerutti@gmail.com> - 2013-11-26 10:27 -0500
  Re: parsing nested unbounded XML fields with ElementTree Larry Martell <larry.martell@gmail.com> - 2013-11-27 09:58 -0500

csiph-web