CMD API Help needed

[merceyz]

As "requested" in issue #73 i'm moving my question part here

I'm trying to use the CMD API to have a network learn to label some 96x96x3 (RGB) images.

I have a folder structure where each folder for each label has a bunch of images (water)

I opened cmd and ran the following commands:

1. cd "path to folder here"
2. echo off
3. cls
4. call .\bin\activate.bat
5. deepcl_unittests

This resulted in the following output

Now i'm kind of stuck, I was reading on this page at the "File types" section there is a line saying "See Loaders for information on available loaders" which doesn't work, the link leads to an 404 page

So my question/issue is: How do I give it data to train/test on?

[hughperkins]

Ok, so deepcl_unittests is for running automated unit tests, to check stuff is working ok. To run training you'll want to use deepcl_train.

[merceyz]

Yeah i figured as much, but how do i present it with my data?

[hughperkins]

Ah, good point .Link should work now https://github.com/hughperkins/DeepCL/blob/master/doc/Loaders.md

[merceyz]

That jpeg loader will use RGB right or do i have to specify something for that?

[hughperkins]

Oh, good question. I think you just need to put planes=3 in the manifest, and then it should work. Can you try ,and see if this works ok?

[hughperkins]

(I think the only requirements on the images are:

• all same size/geometry
• all square, ie width and height are the same )

[merceyz]

All requirements are met

[hughperkins]

Works ok?

[merceyz]

"Something went wrong: can't open *file name here"

[hughperkins]

Does it really say '*file name here'? or does that have an actual filepath?

[merceyz]

If you look at the first screenshot you can see the actual path

[hughperkins]

ah...

[hughperkins]

ok, can you try removing the leading /, ie 0/620cc66f-f919-...etc..

[merceyz]

Same error

[hughperkins]

Looks like the filepath is relative to the current directory, not to the datadir. That's probably not really intuitive, or correct, but I think that's how it works currently. Can you try using either absolute paths, or paths relative to the current directory? (Might need to add TestFolder/ to the start of each path?)

[merceyz]

That fixed it and it puked out a bunch of stuffs

If i'm not mistaken something is wrong tho as "training loss" says "-1.#IND" and all values are the same on each epoch finished

[hughperkins]

ah yeah, that training loss means someting went wrong...

[hughperkins]

maybe try a smaller learning rate?

[merceyz]

There we go, loss started at ~800 going down more and more

Accuracy on both the training and test keeps climbing so it appears to be working :+1:

It got to epoch 12 and "clblas teardown" showed up, i assume that's it's built in "limit"

[hughperkins]

Accuracy on both the training and test keeps climbing so it appears to be working

Cool :-)

It got to epoch 12 and "clblas teardown" showed up, i assume that's it's built in "limit"

By default, it trains 12 epochs :-P You can change that using numepochs=100 (or however many epochs yo uwant)

[merceyz]

Awesome, thanks.

Suggesting a fix to this:

Looks like the filepath is relative to the current directory, not to the datadir. That's probably not really intuitive, or correct, but I think that's how it works currently. Can you try using either absolute paths, or paths relative to the current directory? (Might need to add TestFolder/ to the start of each path?)

Otherwise i have no more questions for now so you can close this issue if you like (or keep it open as a reminder of the quote above)

[hughperkins]

I'll close this, since it is more general, but you could open an issue specifically for the filepath perhaps?

[hughperkins]

(for info, I've fixed the issue with relative path, in the sourcecode. Question: are you using a prebuilt release, or building from source?)

[merceyz]

Prebuilt. http://deepcl.hughperkins.com/Downloads/ http://deepcl.hughperkins.com/Downloads/deepcl-win64-v8.3.1.zip