PartialVolume / shredos.x86_64

Shredos Disk Eraser 64 bit for all Intel 64 bit processors as well as processors from AMD and other vendors which make compatible 64 bit chips. ShredOS - Secure disk erasure/wipe
Other
1.51k stars 64 forks source link

Certificate created but can't save to USB, Wildcat Point-LP USB. USB unavailable. #211

Open ITTTJ opened 9 months ago

ITTTJ commented 9 months ago

I have a problem that a certificate is not created. Unable to create qla2xxx trace instance, instance logging will be disabled. During the booting is shown this information: Unable to create qla2xxx trace instance, instance logging will be disabled. After that Shredos run. Doesnt matter how i set it, certificate is not created with info: No FAT32 formatted drive found, unable to archive nwipe log file. USB drive is FAT32 formatted. I even tried to make new partition on same USB drive with FAT32 file system, but it doesnt help. I tested Venoty, Rufus and also unetbootin, but same result. Also tried two diferent USB flashdisks.

Dont you please know where could be the problem?

20240128_142425 20240129_123017

PartialVolume commented 9 months ago

Unable to create qla2xxx trace instance, instance logging will be disabled. During the booting is shown this information: Unable to create qla2xxx trace instance, instance logging will be disabled.

Ignore that, it's a benign error that always occurs and isn't a problem.

The ability to copy PDF's & logs to a non vanilla USB drive, i.e one that wasn't created with dd is restricted in the current version v2023.08.02_25.0_x86-64_0.35.

The updated code in the master will now write to Ventoy created USB drives as well as dd created USB drives, however this hasn't been officially released yet.

You have three options with the current version to copy PDFs to USB:

Alternatively you will need to wait for the next release that will support that functionality for Ventoy.

One other favour to ask, if you used Rufus and also unetbootin to create the USB stick can you boot each in turn and switch to the second virtual terminal in ShredOS using ALT F2 then run the command fdisk -l (-l is -lower case L not 1) I want to see how the partition on the USB stick is named, it's probably exFAT but for both RuFus & unetbootin I want to makesure that is the case. This will allow we to be sure all four methods are supported in upcoming release. Thanks.

Example:

Disk /dev/sda: 1.88 GiB, 2013265920 bytes, 3932160 sectors
Disk model: UDisk           
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x00000000

Device     Boot Start    End Sectors  Size Id Type
/dev/sda1        1263 509075  507813  248M  c W95 FAT32 (LBA)
PartialVolume commented 9 months ago

To all Windows users with Linux experience. Is there a nice simple block copy command or windows application that just does a simple block copy like dd without messing with the drive formatting or partition table. It's so simple under Linux using dd that I can't believe somebody hasn't written a Windows application that just does a straight block by block copy. Does not Rufus or any other Windows program support a raw block copy?

Nebuli1 commented 9 months ago

https://dmde.com/download.html

free version can copy and save to file per sector

manually edit mbr and other advanced functions.

after starting the programme alt+w

Tools/Copy sector

obraz

PartialVolume commented 9 months ago

@Nebuli1

https://dmde.com/download.html

free version can copy and save to file per sector

Nice ! , Thanks for the info.

Firminator commented 9 months ago

Well there is more to it and Pete from Rufus has the why coverered in his FAQ @

PartialVolume commented 9 months ago

Thanks @Firminator some bedtime reading 👍

Firminator commented 9 months ago

Btw the qla2xxx driver is most likely a QLOGIC FC driver enabling support to connect to a FC SAN which is probably not the core idea of ShredOS. I've seen other wipers boasting with the ability to wipe FC drives, but I rather not have a software capable - on purpose or by accident - have access to a backend SAN in order to wipe it :) Also I would assume enabling WoFC (Wiping over Fiber Channel; I might just coined a new term :headscratch:) would require a bunch of new additional code. Feature creep in my mind. So in other words it could probably be removed unless I missed the discussion on how it should be added. In my environment we have QLE2xxx FC adapters on our servers so that's another driver for a different FC card from QLOGIC/Broadcom/nowMarvell... and that driver could also be removed if you added it recently.

PartialVolume commented 9 months ago

I have no problem taking those drivers out, I do have some fibre channel kit but to be honest I've got my work cut out with other things that need doing in ShredOS and nwipe so can't see me ever getting round to looking at it any time soon if ever. So they will be removed in the next release.

ITTTJ commented 9 months ago

Unable to create qla2xxx trace instance, instance logging will be disabled. During the booting is shown this information: Unable to create qla2xxx trace instance, instance logging will be disabled.

Ignore that, it's a benign error that always occurs and isn't a problem.

The ability to copy PDF's & logs to a non vanilla USB drive, i.e one that wasn't created with dd is restricted in the current version v2023.08.02_25.0_x86-64_0.35.

The updated code in the master will now write to Ventoy created USB drives as well as dd created USB drives, however this hasn't been officially released yet.

You have three options with the current version to copy PDFs to USB:

  • Use dd or dmde (see comment below) to create the USB drive by copying the .img file to it as described here
  • Manually copy the PDFs using mount & cp described here
  • Build the master copy from source (something that's maybe not worthwhile unless you are serious about contributing as a developer long term)

Alternatively you will need to wait for the next release that will support that functionality for Ventoy.

One other favour to ask, if you used Rufus and also unetbootin to create the USB stick can you boot each in turn and switch to the second virtual terminal in ShredOS using ALT F2 then run the command fdisk -l (-l is -lower case L not 1) I want to see how the partition on the USB stick is named, it's probably exFAT but for both RuFus & unetbootin I want to makesure that is the case. This will allow we to be sure all four methods are supported in upcoming release. Thanks.

Example:

Disk /dev/sda: 1.88 GiB, 2013265920 bytes, 3932160 sectors
Disk model: UDisk           
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x00000000

Device     Boot Start    End Sectors  Size Id Type
/dev/sda1        1263 509075  507813  248M  c W95 FAT32 (LBA)
ITTTJ commented 9 months ago

To the Rufus and Unetbootin question. I dont see USB drive in Shredos at all, only main computers harddrive. I can show you info about the USB drive from windows.

This is for Rufus: 20240131_065820 20240131_070333

Info about USB drive from Windows: 20240131_071657

PartialVolume commented 9 months ago

Thanks, the Windows info isn't useful as I need to see exactly how fdisk lists the drive.

Is there something wrong with your hardware or is there something in the bios that powers down the USB hardware due to inactivity? Does unplugging it and plugging back in make it appear in fdisk.

That's a problem. ShredOS can't mount a drive if Linux can't see it in fdisk.

Is anybody else able to provide the fdisk output of a Rufus created ShredOS stick preferably from within the current version of ShredOS.

PartialVolume commented 9 months ago

@ITTTJ Can you post the output of lspci, I want to see what USB controller you have. Also Make/model of system and or motherboard make/model if home built.

I'm seriously starting to think ShredOS needs some telemetry to start recording basic non-identifiable hardware details, like the details that lspci and /proc/cpuinfo produce.

PartialVolume commented 9 months ago

@ITTTJ BTW that disabling interrupt 16 is something I've not seen before, could that error coincide with fdisk -l not finding the USB stick? If you reboot multiple times does that message disabling interrupt 16 come up everytime? If it doesn't come up everytime, then on a occasion it doesn't appear does fdisk -l see the USB flash drive. Seems to be an issue on some other distros from 13 years ago. What vintage is this equipment?

https://www.linuxquestions.org/questions/slackware-14/disabling-irq-16-a-879964/

Screenshot_20240131_150207

ITTTJ commented 9 months ago

There is nothing wrong with the hardware as far as I know, it behaves the same way with other flash drives and on other computers. Specifically in this case I am testing on a Dell Latitude E5550 laptop. Removing and reinserting the drive doesn't help, it's still not visible.

The flash drive is Kingston brand.

Even if I you reboot multiple times interrupt 16 come up everytime.

20240201_120221

PartialVolume commented 9 months ago

As I've never actually created a ShredOS stick with Rufus, as I normally just use dd, being on Linux the majority of the time. I thought I'd give it a go.

Downloaded the latest Rufus & ShredOS and created the stick, booted it, as I had not enabled nousb in the options, the USB drive appears in the nwipe selection screen as it should. Jumped over to the second virtual window ALT F2 and run fdisk.

Disk /dev/sda: 1.88 GiB, 2013265920 bytes, 3932160 sectors
Disk model: UDisk           
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x00000000

Device     Boot Start    End Sectors  Size Id Type
/dev/sda1        1263 509075  507813  248M  c W95 FAT32 (LBA)

The filesystem Type string contains FAT32 so the current release will write to USB upon completion of wipes when you hit the return key for both Rufus & dd created sticks. The next release will also write to Ventoy USB sticks which have the string exFAT in the Type field.

So, I'm thinking your Interrupt 16 may well be why your USB stick can't be seen, I see your USB hardware is Intel Wildcat Point-LP xHCI & EHCI which I've come across before but can't remember in what context.

it behaves the same way with other flash drives and on other computers.

Can you clarify that, other systems also don't show the USB stick in fdisk? Are they also Intel Wildcat USB ?

PartialVolume commented 9 months ago

Apparently on some Dell systems you can enable/disable the external USB ports in the BIOS. Do these laptops have that feature? Or anything related to USB configuration?

PartialVolume commented 9 months ago

From the Dell E5550 manual:

USB Configuration
This field configures the integrated USB controller. If Boot
Support is enabled, the system is allowed to boot any type of USB
Mass Storage Devices (HDD, memory key, floppy).
If USB port is enabled, device attached to this port is enabled and available for
OS.

If USB port is disabled, the OS cannot see any device attached
to this port.

Enable Boot Support

Enable External USB Port

Enable USB3.0 Controller

NOTE:
USB keyboard and mouse always work in the BIOS setup irrespective of these settings.

https://www.dell.com/support/manuals/en-uk/latitude-e5550-laptop/dell_latitude_e5550_bdw/system-setup-options?guid=guid-a0f58acf-0e8b-40a2-97f9-f67f38643d65&lang=en-us

ITTTJ commented 9 months ago

I have all these settings turned on and had them before. I've tried practically every possible and impossible combination, but nothing has worked. I've now tried Shredos on a Latitude 5510 and everything works without a problem, so I have no idea why the older E5550 is not working...

20240203_100834

PartialVolume commented 9 months ago

Can you post the dmesg.txt file. One way to access it by doing headless login from another system as described here

PartialVolume commented 8 months ago

Adding lspci output as text so a Google search can find it.

sh-5.2# 1spci 00:00.0 Host bridge: Intel Corporation Broadwell-U Host Bridge -OPI (rev 09) 00:02.0 VGA compatible controller: Intel Corporation HD Graphics 5500 (rev 09) 00:03.0 Audio device: Intel Corporation Broadwell-U Audio Controller (rev 09) 00:04.0 Signal processing controller: Intel Corporation Broadwell-U Processor Thermal Subsysten (rev 09) 00:14.0 USB controller: Intel Corporation Wildcat Point-LP USB xHCI Controller (rev 03) MEI Controller # 1 (rev 03) 00:16.0 Communication controller: Intel Corporation Wildcat Point-LP 00:19.0 Ethernet controller: Intel Corporation Ethernet Connection (3) 1218-LM (rev 03) 00:16.0 Audio device: Intel Corporation Wildcat Point-LP High Definition Audio Controller 00:1c.0 PCI bridge: Intel Corporation Wildcat Point-LP PCI Express Root Port # 1 (rev e3) (rev 03) 00:1c.3 PCI bridge: Intel Corporation Wildcat Point-LP PCI Express Root Port # 4 (rev e3) 00:1c.4 PCI bridge: Intel Corporation Wildcat Point-LP PCI Express Root Port # 5 (rev e3) 00:1d.0 USB controller: Intel Corporation Wildcat Point-LP USB EHCI Controller (rev 03) 00:1f.0 ISA bridge: Intel Corporation Wildcat Point-LP LPC Controller (rev 03) 00:1f.2 RAID bus controller: Intel Corporation 82801 Mobile SATA Controller [RAID node] (rev 03) 00:1f.3 SMBus: Intel Corporation Wildcat Point-LP SMBus Controller (rev 03) 01:00.0 SD Host controller: 02 Micro, Inc. SD/MMC Card Reader Controller (rev 01) 02:00.0 Network controller: Intel Corporation Wireless 7265 (rev 59) sh-5.2#

PartialVolume commented 8 months ago

Same as #224 Wildcat Point-LP USB

ITTTJ commented 8 months ago

Can you post the dmesg.txt file. One way to access it by doing headless login from another system as described here

I tried, but it was not working. I connected laptop into local network through cable, booted the computer into shredos, but remote connection was not working. I found IP address of device, but even i tried 3 different software to telnet connection no one worked. I there please anything else i can do?

PartialVolume commented 8 months ago

Unfortunately, with the current version headless login doesn't work as the telnetd software is missing. It will be present in the next version. If your bios is up to date you may have to wait for the next version of ShredOS which will have updated kernel & drivers.

PartialVolume commented 8 months ago

With non functional USB the only other way to get the certificates off is to FTP them as described here