Memory Error While Parsing\loading Very Large Xml File

I got a large database in one xml file and I need to process the data in it (using python). I tried to parse it with xml library using xml.dom.minidom and (in another script) xml.e

Solution 1:

Try this xml library. pip install simplified_scrapy

from simplified_scrapy import SimplifiedDoc, utils

doc = SimplifiedDoc()
doc.loadFile('test.xml', lineByline=True) # Read data line by line

for s in doc.getIterable('s'): 
    print (s.selects('t'))