SCNC Tech, LLC scnctech
scnctech
/ xml_split.py
Created
March 31, 2020 20:49
I took this gist https://gist.github.com/benallard/8042835 and modified it a little so it worked for my needs. (mainly encoding issues and bigger file chunks)
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env python | |
| #based off this gist https://gist.github.com/benallard/8042835 | |
| #modified it a little so it worked for my needs. (mainly encoding issues and bigger file chunks) | |
| import os | |
| import xml.parsers.expat | |
| from xml.sax.saxutils import escape | |
| from optparse import OptionParser | |
| from math import log10 |
benallard
/ xml_split.py
Last active
August 28, 2024 23:00
Small python script to split huge XML files into parts. It takes one or two parameters. The first is always the huge XML file, and the second the size of the wished chunks in Kb (default to 1Mb) (0 spilt wherever possible) The generated files are called like the original one with an index between the filename and the extension like that: bigxml.…
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env python | |
| import os | |
| import xml.parsers.expat | |
| from xml.sax.saxutils import escape | |
| from optparse import OptionParser | |
| from math import log10 | |
| # How much data we process at a time |