oeg-upm / soca

Software Catalog Creator. A repository that given an organization URL, it will create a software catalog for browsing all repositories
Apache License 2.0
11 stars 5 forks source link

Unable to run the sample example #118

Closed debkantap closed 2 months ago

debkantap commented 2 months ago

I was trying to run the sample example as per the instructions given:

$soca fetch -i oeg-upm --org -o oeg-upm_repos.csv

--output --- Fetching repositories from orgs oeg-upm: please provide Valid Authorisation Token

Will commence fetch WITHOUT token

Request 1. 50 repositories are downloaded per request Request 2. 50 repositories are downloaded per request Request 3. 50 repositories are downloaded per request Request 4. 50 repositories are downloaded per request Request 5. 50 repositories are downloaded per request Request 6. 50 repositories are downloaded per request Request 7. 25 repositories are downloaded per request

$soca extract -i oeg-upm_repos.csv -o oeg-upm_metadata -i4p

------output ------------------ Traceback (most recent call last): File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in _run_code exec(code, run_globals) File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\Scripts\soca.exe__main.py", line 7, in File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 764, in call return self.main(args, kwargs) File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 717, in main rv = self.invoke(ctx) File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 1137, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 956, in invoke return ctx.invoke(self.callback, ctx.params) File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 555, in invoke return callback(args, **kwargs) File "C:\Deb\Working\Poc\soca\src\soca\main__.py", line 70, in extract extract_metadata.extract(input, output, inspect4py, verbose, keep) File "C:\Deb\Working\Poc\soca\src\soca\commands\extract_metadata.py", line 38, in extract repos_url = [c[0] for c in csv.reader(repos, delimiter=',')] File "C:\Deb\Working\Poc\soca\src\soca\commands\extract_metadata.py", line 38, in repos_url = [c[0] for c in csv.reader(repos, delimiter=',')] IndexError: list index out of range


$soca portal -i oeg-upm_metadata -o oeg-upm_portal ---------------Output-----------------------

✅ A total of 0 cards saved in: C:\Deb\Working\Poc\soca\oeg-upm_portal/cards_data.json With no failures! ✅ Portal saved in: C:\Deb\Working\Poc\soca\oeg-upm_portal/index.html


Now when I open the "C:\Deb\Working\Poc\soca\oeg-upm_portal/index.html", I get the blank screen as attached. ![Uploading soca.jpg…]()

Please help where I am doing wrong.

TR Deb

dgarijo commented 2 months ago

It looks like you are running on Windows and Python 3.10. We'll have a look at this issue, so at least the Docker image runs correctly. We run the pipeline daily (see https://software.oeg.fi.upm.es/ bottom left corner), so we'll have to try and reproduce this issue.

dgarijo commented 2 months ago

Btw, is there something in the csv that soca creates after fetch?

debkantap commented 2 months ago

Hi @dgarijo . Thanks for the quick response. Yes ..the csv has data ..I think it has the link of the repos within the org. attached is the csv file

TR Deb [Uploading oeg-upm_repos.csv…]()

debkantap commented 2 months ago

Hi @dgarijo,

Do you have any update pls

TR Deb

dgarijo commented 2 months ago

@esgg was going to have a look

esgg commented 2 months ago

Hi @debkantap !

Do you remember how many repositories were analyzed before the error? I can't reproduce the error.

Could you send me the CSDV file?. I think the link you copied yesterday doesn't work.

debkantap commented 2 months ago

Hi @esgg ..

Yes, the csv file has 325 entries. Attaching again. oeg-upm_repos.csv

Here are the screenshots. Screenshot for: soca fetch -i oeg-upm --org -o oeg-upm_repos.csv -na soca-fetch

Screenshot for: soca extract -i oeg-upm_repos.csv -o oeg-upm_metadata -i4p soca-extract

screenshot for: soca portal -i oeg-upm_metadata -o oeg-upm_portal soca-portal

"oeg-upm_metadata" directory is empty after 'extract' command "oeg-upm_portal" directory don't have metadata for all the repos with the "oeg-upm_repos" org

Attaching the zip of the output portal oeg-upm_portal.zip

TR Deb

esgg commented 2 months ago

In this case, you are executing the commands outside of the docker, right?

How do you install soca? Do you clone the repo?

debkantap commented 2 months ago

Yes I cloned the soca from Git and then run

git clone https://github.com/oeg-upm/soca cd soca pip install -e .

I think we can park the issue now as docker soca seems generating the portal. Running the portal is issue now.

TR Deb