search

sebdelsol / sfvip-all

Sfvip All wraps Sfvip Player with a local proxy that inserts an All category so you can easily search your entire catalog. It updates Mpv and Sfvip Player so you can enjoy their latest features. It supports an external EPG. It creates a cache for Mac account all categories to access those faster.
MIT License
61 stars 5 forks source link

Failing to import from epgshare01 #2

Closed max1c closed 11 months ago

max1c commented 11 months ago

I'm not sure if it's because it's too large but the epg_ripper_ALL_SOURCES1.xml.gz from https://epgshare01.online/epgshare01/ is failing to import. The others ones seem to work well.

EDIT: Also, is there a portable version?

sebdelsol commented 11 months ago

I'm not sure if it's because it's too large

Yeah the xml is huge (~20 000 channels and ~2 000 000 programmes) and causes memory issues. So I'll have to find a way to serialize it on the fly. Expect a new version in the following days.

Also, is there a portable version?

There's no portable version anymore : I've switched from Nuitka single file to Nsis because it gives way less AV false positive. And maintaining a portable version became a PITA. So I ditched it.

sebdelsol commented 11 months ago

It's fixed in v1.4.12.4: I now use lxml.etree.iterparse that processes the tree on the fly and prevents the memory issue. The whole epg is processed into a dictionary: for this huge one it takes only 1GB instead of 10GB when it was an xml tree. The epg is longer to process though : it takes 30s to 1mn for this one. So its progress is shown in the UI and can be interrupted.

EDIT: thanks a lot for raising this issue.

max1c commented 11 months ago

Hey, thanks so much for a quick turn around. I appreciate it. I also understand the complications with portable version. Cheers!