Currently the only option would be to use the plugin ‘Exclude areas from comparison’ and then configure the area that contains the SVG in the used comparison profile. SVGs are converted to PDF native drawings when exported to PDF. So from the PDF perspective an exported SVG is just native vector graphics like any other.