View Issue Details

IDProjectCategoryView StatusLast Update
0005437SUMoBugpublic2019-05-12 09:44
ReporterwolfAssigned ToKyle_Katarn 
PrioritynormalSeverityminorReproducibilityalways
Status acknowledgedResolutionopen 
Product Version5.8.12 
Target Version5.9.xFixed in Version 
Summary0005437: wrong quoting in CSV table export
DescriptionAs already indicated in my note https://www.kcsoftwares.com/bugs/view_user_page.php?id=691 of issue 0004989, SUMO does not export its report table in table format correctly. In case that a data field does contain the field separator chosen by SUMO for table export, such a data field needs to be quoted. It you don't want to check for such a case, you can do this quoting for every text data field.

Then this quoting needs to be documented so that the users configure their import filter accordingly. My proposed change in issue 0004989 then needs to expanded even further to "table export in CSV format with separator ';' and '"' as quote protection of text". (Mantis doesn't seem to provide support for better formatting.)

Find attached a case which is an extract of the export report file of SUMO after import into LibreOffice Calc 6.1.5.2 with semi-colon as configured separator. As you can see, it seems that the version info of detected application nssm contains semi-colon in its organisation field "Public Domain; Author Iain Patterson" as SUMO shows it in its report and also exported text file.
Steps To ReproduceRepeat export in table format and look for the lines with 5 out of 4 existing columns.
Additional InformationAlready indicated in issue 0004989.

On my device, this is the only application detected where semi-colon is used in a version information field among several hundred applications detected, in 32-bit and 64-bit version.
TagsNo tags attached.

Relationships

related to 0004989 acknowledgedKyle_Katarn Excel Export Error 
related to 0005438 acknowledgedKyle_Katarn change the behaviour or configuration option for the export feature 

Activities

wolf

2019-04-22 02:02

reporter  

sumo.export.csvquote.png (38,883 bytes)
sumo.export.csvquote.png (38,883 bytes)

wolf

2019-05-11 23:53

reporter   ~0003275

I found a work around. Note https://www.kcsoftwares.com/bugs/view.php?id=5438#c3273 indicates the hint as it works with LibreOffice Calc for me. Investigation in that note showed that the tabulator character is used as separator which is seldom part of another field as opposed to semi-colon used for your export to table format. So even with wrong quoting, I exported to text, then renamed its file name extension of txt to csv, and then tried several times to import it into LibreOffice. With the text found it assumes UTF-16 encoding which produced signs as if it would be chinese or other far eastern language. Changeing the assumption of the importer resulted in no error with much more than 1400 entries in my case when I specified in the LibreOffice Calc importer to use the tabulator as field separator and text encoding ISO-Latin-15. Even with UTF-8 there remained errors, not in field separation but in the text, especially with the trademark and copyright signs used in some tool names.

A work-around is no fix. It may only impact priority.

Kyle_Katarn

2019-05-12 09:44

administrator   ~0003276

ok, thanks !

Issue History

Date Modified Username Field Change
2019-04-22 02:02 wolf New Issue
2019-04-22 02:02 wolf File Added: sumo.export.csvquote.png
2019-04-22 11:49 Kyle_Katarn Relationship added related to 0004989
2019-04-22 11:51 Kyle_Katarn Assigned To => Kyle_Katarn
2019-04-22 11:51 Kyle_Katarn Status new => acknowledged
2019-04-22 11:51 Kyle_Katarn Target Version => Short term
2019-04-22 11:51 Kyle_Katarn Target Version Short term => 5.9.x
2019-05-11 23:53 wolf Note Added: 0003275
2019-05-12 09:44 Kyle_Katarn Relationship added related to 0005438
2019-05-12 09:44 Kyle_Katarn Note Added: 0003276