Use new scorecard dir handling and remove debug parts

[mantomas]

This PR removes debug steps after scorecard directory investigation and keeps the new way of handling scorecard directories.