search

ibm-messaging / mq-smf-csv

Simple formatter for MQ's SMF records to assist with import to spreadsheets and databases
Eclipse Public License 1.0
7 stars 3 forks source link

Recent sample data #3

Open v1gnesh opened 4 months ago

v1gnesh commented 4 months ago

The test data is from 2016 (8 years ago). Please upload for MQ 9.4... and maybe more than a few kilobytes, please.

v1gnesh commented 4 months ago

Any thoughts, @ibmmqmet ?

Crosswind commented 4 months ago

@v1gnesh I am no maintainer of this repository and I don't speak on behalf of Marc but if I was a maintainer I would like to better understand the rationale behind your request. Are you having issues analyzing SMF data from your system and are looking for sample data to make sure the data you are collecting is correct?

v1gnesh commented 4 months ago

Are you having issues analyzing SMF data from your system and are looking for sample data to make sure the data you are collecting is correct?

@Crosswind I'm trying to nudge Z ecosystem to be more open, now that zOS instances are more freely available via zPDT, IBM cloud, OMP, etc. For an open source community to truly exist for Z, access to material like this needn't be this restricted/outdated. Otherwise, mainframers are forced to see GitHub as just a distribution mechanism (alternate to vendor.com), rather than true open source like CBT.

ibmmqmet commented 4 months ago

If someone provided some additional newer test data with the latest structures then I might consider using it, but it would have to be very small - the purpose of the test data here is simply to check that the program works. It is not intended to be a full-blown demonstration of what can be achieved with SMF data.

Typically, the data I use locally is not suitable to be released publicly - it would need sanitising to remove things like customer names and object definitions. And github does not really like large amounts of binary data in repos.

v1gnesh commented 4 months ago

Thanks @ibmmqmet, Perhaps something (small I suppose) from an IBM lab/testing environment?

ibmmqmet commented 1 month ago

The latest version (v5.5.1) has got a new sample data file. See testing/data/SMF_MQ940_NORDW.bin. Format it using the -f nordw option.

v1gnesh commented 1 month ago

Thank you (and Lyn) for considering, and the heftier file. Any chance of including the RDW?

ibmmqmet commented 1 month ago

No.

And since many sites' download processes now exclude the option of using the basic ftp with its rdw option, it's much more likely that working with nordw is going to be needed. So sample data that works that way is useful.

v1gnesh commented 1 month ago

When you say basic ftp, do you mean non-secure ftp? I can share a python script to do FTP TLS and perhaps make a CLI app out of it... in case it'll benefit others. Otherwise, I'm curious about how download without rdw is allowed but with isn't.

ibmmqmet commented 1 month ago

I mean that many sites now mandate use of secure transfers and only via sftp which does not have the rdw option in its command options. There are ways of using ftps, but that's different.

v1gnesh commented 1 month ago

Okay, thanks. I'll see if I can insert RDWs somehow..