All geek questions in one place

Convert xml to python dict

I am trying to make a dict class for xml processing, but it’s stuck, I am really running out of ideas. If anyone could lead this topic, it would be great.

code developed so far:

class XMLResponse(dict): def __init__(self, xml): self.result = True self.message = '' pass def __setattr__(self, name, val): self[name] = val def __getattr__(self, name): if name in self: return self[name] return None message="<?xml version="1.0"?><note><to>Tove</to><from>Jani</from><heading>Reminder</heading><body>Don't forget me this weekend!</body></note>" XMLResponse(message)
+6
source share
4 answers

You can use the xmltodict module:

 import xmltodict message = """<?xml version="1.0"?><note><to>Tove</to><from>Jani</from><heading>Reminder</heading><body>Don't forget me this weekend!</body></note>""" print xmltodict.parse(message)['note']

which creates an OrderedDict :

 OrderedDict([(u'to', u'Tove'), (u'from', u'Jani'), (u'heading', u'Reminder'), (u'body', u"Don't forget me this weekend!")])

which can be converted to dict if the order doesn't matter:

 print dict(xmltodict.parse(message)['note'])

Print

 {u'body': u"Don't forget me this weekend!", u'to': u'Tove', u'from': u'Jani', u'heading': u'Reminder'}
+18
source

You have to check

https://github.com/martinblech/xmltodict

I think this is one of the best standard xml handlers I've seen.

However, I must warn you that xml and dict are not completely compatible data structures.

+5
source

You would think that by now we would have a good answer to this question, but we obviously did not. After looking at half a dozen similar questions about stackoverflow, here is what worked for me:

 from lxml import etree # arrow is an awesome lib for dealing with dates in python import arrow # converts an etree to dict, useful to convert xml to dict def etree2dict(tree): root, contents = recursive_dict(tree) return {root: contents} def recursive_dict(element): if element.attrib and 'type' in element.attrib and element.attrib['type'] == "array": return element.tag, [(dict(map(recursive_dict, child)) or getElementValue(child)) for child in element] else: return element.tag, dict(map(recursive_dict, element)) or getElementValue(element) def getElementValue(element): if element.text: if element.attrib and 'type' in element.attrib: attr_type = element.attrib.get('type') if attr_type == 'integer': return int(element.text.strip()) if attr_type == 'float': return float(element.text.strip()) if attr_type == 'boolean': return element.text.lower().strip() == 'true' if attr_type == 'datetime': return arrow.get(element.text.strip()).timestamp else: return element.text elif element.attrib: if 'nil' in element.attrib: return None else: return element.attrib else: return None

and here is how you use it:

 from lxml import etree message="""<?xml version="1.0"?><note><to>Tove</to><from>Jani</from><heading>Reminder</heading><body>Don't forget me this weekend!</body></note>"'' tree = etree.fromstring(message) etree2dict(tree)

Hope this helps :-)

+3
source

You can use lxml library . Convert the string to an xml object using objectify.fromstring , and then find the dir method of the objects. For instance:

 from lxml import objectify xml_string = """<?xml version="1.0" encoding="UTF-8"?><NewOrderResp><IndustryType></IndustryType><MessageType>R</MessageType><MerchantID>700000005894</MerchantID><TerminalID>0031</TerminalID><CardBrand>AMEX</CardBrand><AccountNum>3456732800000010</AccountNum><OrderID>TESTORDER1</OrderID><TxRefNum>55A69B278025130CD36B3A95435AA84DC45363</TxRefNum><TxRefIdx>10</TxRefIdx><ProcStatus>0</ProcStatus><ApprovalStatus>1</ApprovalStatus><RespCode></RespCode><AVSRespCode></AVSRespCode><CVV2RespCode></CVV2RespCode><AuthCode></AuthCode><RecurringAdviceCd></RecurringAdviceCd><CAVVRespCode></CAVVRespCode><StatusMsg></StatusMsg><RespMsg></RespMsg><HostRespCode></HostRespCode><HostAVSRespCode></HostAVSRespCode><HostCVV2RespCode></HostCVV2RespCode><CustomerRefNum>A51C5B2B1811E5991208</CustomerRefNum><CustomerName>BOB STEVEN</CustomerName><ProfileProcStatus>0</ProfileProcStatus><CustomerProfileMessage>Profile Created</CustomerProfileMessage><RespTime>13055</RespTime><PartialAuthOccurred></PartialAuthOccurred><RequestedAmount></RequestedAmount><RedeemedAmount></RedeemedAmount><RemainingBalance></RemainingBalance><CountryFraudFilterStatus></CountryFraudFilterStatus><IsoCountryCode></IsoCountryCode></NewOrderResp>""" xml_object = objectify.fromstring(xml_string) print xml_object.__dict__ / StatusMsg> <RespMsg> </ RespMsg> <HostRespCode> </ HostRespCode> <HostAVSRespCode> </ HostAVSRespCode> <HostCVV2RespCode> </ HostCVV2RespCode> <CustomerRefNum> A51C5B2B1811E5991208 </ CustomerRefNum> <CustomerName> from lxml import objectify xml_string = """<?xml version="1.0" encoding="UTF-8"?><NewOrderResp><IndustryType></IndustryType><MessageType>R</MessageType><MerchantID>700000005894</MerchantID><TerminalID>0031</TerminalID><CardBrand>AMEX</CardBrand><AccountNum>3456732800000010</AccountNum><OrderID>TESTORDER1</OrderID><TxRefNum>55A69B278025130CD36B3A95435AA84DC45363</TxRefNum><TxRefIdx>10</TxRefIdx><ProcStatus>0</ProcStatus><ApprovalStatus>1</ApprovalStatus><RespCode></RespCode><AVSRespCode></AVSRespCode><CVV2RespCode></CVV2RespCode><AuthCode></AuthCode><RecurringAdviceCd></RecurringAdviceCd><CAVVRespCode></CAVVRespCode><StatusMsg></StatusMsg><RespMsg></RespMsg><HostRespCode></HostRespCode><HostAVSRespCode></HostAVSRespCode><HostCVV2RespCode></HostCVV2RespCode><CustomerRefNum>A51C5B2B1811E5991208</CustomerRefNum><CustomerName>BOB STEVEN</CustomerName><ProfileProcStatus>0</ProfileProcStatus><CustomerProfileMessage>Profile Created</CustomerProfileMessage><RespTime>13055</RespTime><PartialAuthOccurred></PartialAuthOccurred><RequestedAmount></RequestedAmount><RedeemedAmount></RedeemedAmount><RemainingBalance></RemainingBalance><CountryFraudFilterStatus></CountryFraudFilterStatus><IsoCountryCode></IsoCountryCode></NewOrderResp>""" xml_object = objectify.fromstring(xml_string) print xml_object.__dict__

Converting an xml object to a dict will return a dict:

 {'RemainingBalance': u'', 'AVSRespCode': u'', 'RequestedAmount': u'', 'AccountNum': 3456732800000010, 'IsoCountryCode': u'', 'HostCVV2RespCode': u'', 'TerminalID': 31, 'CVV2RespCode': u'', 'RespMsg': u'', 'CardBrand': 'AMEX', 'MerchantID': 700000005894, 'RespCode': u'', 'ProfileProcStatus': 0, 'CustomerName': 'BOB STEVEN', 'PartialAuthOccurred': u'', 'MessageType': 'R', 'ProcStatus': 0, 'TxRefIdx': 10, 'RecurringAdviceCd': u'', 'IndustryType': u'', 'OrderID': 'TESTORDER1', 'StatusMsg': u'', 'ApprovalStatus': 1, 'RedeemedAmount': u'', 'CountryFraudFilterStatus': u'', 'TxRefNum': '55A69B278025130CD36B3A95435AA84DC45363', 'CustomerRefNum': 'A51C5B2B1811E5991208', 'CustomerProfileMessage': 'Profile Created', 'AuthCode': u'', 'RespTime': 13055, 'HostAVSRespCode': u'', 'CAVVRespCode': u'', 'HostRespCode': u''}

The xml line I used is a response from a payment payment gateway to show a real-world example.

Also note that the above example is not recursive, so if there are dicts in dicts, you should do some recursion. See the Recursive function I wrote that you can use:

 from lxml import objectify def xml_to_dict_recursion(xml_object): dict_object = xml_object.__dict__ if not dict_object: return xml_object for key, value in dict_object.items(): dict_object[key] = xml_to_dict_recursion(value) return dict_object def xml_to_dict(xml_str): return xml_to_dict_recursion(objectify.fromstring(xml_str)) xml_string = """<?xml version="1.0" encoding="UTF-8"?><Response><NewOrderResp> <IndustryType>Test</IndustryType><SomeData><SomeNestedData1>1234</SomeNestedData1> <SomeNestedData2>3455</SomeNestedData2></SomeData></NewOrderResp></Response>""" print xml_to_dict(xml_string)

Here is an option that saves the parent key / element:

 def xml_to_dict(xml_str): """ Convert xml to dict, using lxml v3.4.2 xml processing library, see http://lxml.de/ """ def xml_to_dict_recursion(xml_object): dict_object = xml_object.__dict__ if not dict_object: # if empty dict returned return xml_object for key, value in dict_object.items(): dict_object[key] = xml_to_dict_recursion(value) return dict_object xml_obj = objectify.fromstring(xml_str) return {xml_obj.tag: xml_to_dict_recursion(xml_obj)}

And if you only want to return the subtree and convert it to a dict, you can use Element.find ():

 xml_obj.find('.//') # lxml.objectify.ObjectifiedElement instance

There are many options for this, but this is great if you are already using lxml. In this example, lxml-3.4.2 was used. Thanks!

0
source

Source: https://habr.com/ru/post/947587/

More articles:


All Articles