search

hfaran / slack-export-viewer

A Slack Export archive viewer that allows you to easily view and share your Slack team's export
https://pypi.python.org/pypi/slack-export-viewer
MIT License
939 stars 194 forks source link

Pagination support #73

Open ikeji opened 6 years ago

ikeji commented 6 years ago

I have a log data that like 200M. One room has 20M data. Opening slack-export-viewer will freeze my browser.

Do you have a plan to add per day/month page?

hfaran commented 6 years ago

I do not currently have plans to add pagination, but I welcome any PRs or proposals for adding it. This is something I'll consider but it might mean it would make more sense to re-write this project as an SPA instead of server-side rendered so that would be a big undertaking.

semperrabbit commented 5 years ago

I'm playing with this for an open slack that was created new years '16 so I am having issues with this too. Since all of the rendering is server-side, would it be easier to add a date range at the top of the page, and only render the chat between those dates? it could default to the most recent month to keep from overwhelming the browser, and getting quicker load times. So far, it's taken about 22 minutes to load 7.5 months of chat.

hfaran commented 5 years ago

@semperrabbit That sounds like a reasonable proposal, and I'd welcome a PR if anyone wants to put one up. I could work on this myself, but it's not something I'd be able to get to within the next couple months likely.

huyz commented 4 years ago

it would make more sense to re-write this project as an SPA

The easiest may be to port to using static site generators such as GatsbyJS, which has plugins to handle pagination for you.

huyz commented 4 years ago

@ikeji @semperrabbit I've found that the simplest solution was to import the Slack export into Mattermost. This solves the scalability issue

semperrabbit commented 4 years ago

@huyz Unfortunately, that's not a feasible solution for my slack community (>20k members) and our mod team. Even the game devs have reluctantly agreed we should not fracture the community. We've looked into alternatives about a year ago when a small vocal minority pushed for moving us to discord and the devs nixed it. I have a reasonable belief that the devs would host a slack history of we (community/mod team) found a good solution for displaying it.

huyz commented 4 years ago

@semperrabbit That's not what I'm suggesting. I'm not saying "migrate". I'm saying "use Mattermost as a read-only UI for viewing and searching", which is exactly what you want slack-export-viewer to do.