Closed debkantap closed 2 months ago
It looks like you are running on Windows and Python 3.10. We'll have a look at this issue, so at least the Docker image runs correctly. We run the pipeline daily (see https://software.oeg.fi.upm.es/ bottom left corner), so we'll have to try and reproduce this issue.
Btw, is there something in the csv that soca creates after fetch?
Hi @dgarijo . Thanks for the quick response. Yes ..the csv has data ..I think it has the link of the repos within the org. attached is the csv file
TR Deb [Uploading oeg-upm_repos.csv…]()
Hi @dgarijo,
Do you have any update pls
TR Deb
@esgg was going to have a look
Hi @debkantap !
Do you remember how many repositories were analyzed before the error? I can't reproduce the error.
Could you send me the CSDV file?. I think the link you copied yesterday doesn't work.
Hi @esgg ..
Yes, the csv file has 325 entries. Attaching again. oeg-upm_repos.csv
Here are the screenshots.
Screenshot for:
soca fetch -i oeg-upm --org -o oeg-upm_repos.csv -na
Screenshot for:
soca extract -i oeg-upm_repos.csv -o oeg-upm_metadata -i4p
screenshot for:
soca portal -i oeg-upm_metadata -o oeg-upm_portal
"oeg-upm_metadata" directory is empty after 'extract' command "oeg-upm_portal" directory don't have metadata for all the repos with the "oeg-upm_repos" org
Attaching the zip of the output portal oeg-upm_portal.zip
TR Deb
In this case, you are executing the commands outside of the docker, right?
How do you install soca? Do you clone the repo?
Yes I cloned the soca from Git and then run
git clone https://github.com/oeg-upm/soca cd soca pip install -e .
I think we can park the issue now as docker soca seems generating the portal. Running the portal is issue now.
TR Deb
I was trying to run the sample example as per the instructions given:
$soca fetch -i oeg-upm --org -o oeg-upm_repos.csv
--output --- Fetching repositories from orgs oeg-upm: please provide Valid Authorisation Token
Will commence fetch WITHOUT token
Request 1. 50 repositories are downloaded per request Request 2. 50 repositories are downloaded per request Request 3. 50 repositories are downloaded per request Request 4. 50 repositories are downloaded per request Request 5. 50 repositories are downloaded per request Request 6. 50 repositories are downloaded per request Request 7. 25 repositories are downloaded per request
$soca extract -i oeg-upm_repos.csv -o oeg-upm_metadata -i4p
------output ------------------ Traceback (most recent call last): File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in _run_code exec(code, run_globals) File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\Scripts\soca.exe__main.py", line 7, in
File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 764, in call
return self.main(args, kwargs)
File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 717, in main
rv = self.invoke(ctx)
File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 1137, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 956, in invoke
return ctx.invoke(self.callback, ctx.params)
File "C:\Users\Deb\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 555, in invoke
return callback(args, **kwargs)
File "C:\Deb\Working\Poc\soca\src\soca\main__.py", line 70, in extract
extract_metadata.extract(input, output, inspect4py, verbose, keep)
File "C:\Deb\Working\Poc\soca\src\soca\commands\extract_metadata.py", line 38, in extract
repos_url = [c[0] for c in csv.reader(repos, delimiter=',')]
File "C:\Deb\Working\Poc\soca\src\soca\commands\extract_metadata.py", line 38, in
repos_url = [c[0] for c in csv.reader(repos, delimiter=',')]
IndexError: list index out of range
$soca portal -i oeg-upm_metadata -o oeg-upm_portal ---------------Output-----------------------
✅ A total of 0 cards saved in: C:\Deb\Working\Poc\soca\oeg-upm_portal/cards_data.json With no failures! ✅ Portal saved in: C:\Deb\Working\Poc\soca\oeg-upm_portal/index.html
Now when I open the "C:\Deb\Working\Poc\soca\oeg-upm_portal/index.html", I get the blank screen as attached. ![Uploading soca.jpg…]()
Please help where I am doing wrong.
TR Deb