View Issue Details
|ID||Project||Category||View Status||Date Submitted||Last Update|
|0005437||SUMo||Bug||public||2019-04-22 02:02||2019-05-12 09:44|
|Summary||0005437: wrong quoting in CSV table export|
|Description||As already indicated in my note https://www.kcsoftwares.com/bugs/view_user_page.php?id=691 of issue 0004989, SUMO does not export its report table in table format correctly. In case that a data field does contain the field separator chosen by SUMO for table export, such a data field needs to be quoted. It you don't want to check for such a case, you can do this quoting for every text data field.|
Then this quoting needs to be documented so that the users configure their import filter accordingly. My proposed change in issue 0004989 then needs to expanded even further to "table export in CSV format with separator ';' and '"' as quote protection of text". (Mantis doesn't seem to provide support for better formatting.)
Find attached a case which is an extract of the export report file of SUMO after import into LibreOffice Calc 220.127.116.11 with semi-colon as configured separator. As you can see, it seems that the version info of detected application nssm contains semi-colon in its organisation field "Public Domain; Author Iain Patterson" as SUMO shows it in its report and also exported text file.
|Steps To Reproduce||Repeat export in table format and look for the lines with 5 out of 4 existing columns.|
|Additional Information||Already indicated in issue 0004989.|
On my device, this is the only application detected where semi-colon is used in a version information field among several hundred applications detected, in 32-bit and 64-bit version.
|Tags||No tags attached.|
I found a work around. Note https://www.kcsoftwares.com/bugs/view.php?id=5438#c3273 indicates the hint as it works with LibreOffice Calc for me. Investigation in that note showed that the tabulator character is used as separator which is seldom part of another field as opposed to semi-colon used for your export to table format. So even with wrong quoting, I exported to text, then renamed its file name extension of txt to csv, and then tried several times to import it into LibreOffice. With the text found it assumes UTF-16 encoding which produced signs as if it would be chinese or other far eastern language. Changeing the assumption of the importer resulted in no error with much more than 1400 entries in my case when I specified in the LibreOffice Calc importer to use the tabulator as field separator and text encoding ISO-Latin-15. Even with UTF-8 there remained errors, not in field separation but in the text, especially with the trademark and copyright signs used in some tool names.
A work-around is no fix. It may only impact priority.
||ok, thanks !|
|2019-04-22 02:02||wolf||New Issue|
|2019-04-22 02:02||wolf||File Added: sumo.export.csvquote.png|
|2019-04-22 11:49||Kyle_Katarn||Relationship added||related to 0004989|
|2019-04-22 11:51||Kyle_Katarn||Assigned To||=> Kyle_Katarn|
|2019-04-22 11:51||Kyle_Katarn||Status||new => acknowledged|
|2019-04-22 11:51||Kyle_Katarn||Target Version||=> Short term|
|2019-04-22 11:51||Kyle_Katarn||Target Version||Short term => 5.11.x|
|2019-05-11 23:53||wolf||Note Added: 0003275|
|2019-05-12 09:44||Kyle_Katarn||Relationship added||related to 0005438|
|2019-05-12 09:44||Kyle_Katarn||Note Added: 0003276|