steemit / steem-js

Steem.js the official JavaScript library for Steem blockchain
https://www.npmjs.com/package/steem
MIT License
472 stars 225 forks source link

Old posts are not visible #203

Open doojinkang opened 7 years ago

doojinkang commented 7 years ago

Usually I read steemit by TAGs ( created/TAG, trending/TAG ) I found old posts are not visible. (You need to scroll down down down to list up older posts)

However the date when old posts invisible differs. Some tags only list 80 posts of the latest 7 days, The others 5000 posts, almost a year ago.

Can I see the whole posts from the first one by TAG? I want to make a list of the whole posts for the TAG I like.

I'm also wondering why the dates differ by TAGs?

Expected behavior

All the posts are visible from the first one.

Actual behavior

Old posts prior to a certain time are not visible. The time differs by TAGs.

How to reproduce

  1. Scroll down the created/TAG steemit web page.
  2. Use steem.api.getDiscussionByCreated API to get posts. I called this API continuously with the query set start_author, start_permlink with the last one.

Thank you...

sean-lloyd commented 6 years ago

I'm not sure, but I think there may be a limit to the number of posts returned. So if the # of posts with a given tag is less than that limit, you'll get everything. If the # of posts is greater than the limit, you'll receive the posts up to that limit.

More & more, I've been thinking about just how invisible older posts are in Steemit. It's a problem, imo.

startailcoon commented 6 years ago

This is still an issue for tags/categories that doesn't have much traffic, even on steemit.com. The weird thing is that the tag gridcoinstats that I use for my page only returns one post from last year, even though I've posted several posts since then in that category.

https://steemit.com/created/gridcoinstats

cryptouru commented 6 years ago

Are there any news or workarounds regarding this issue?

I am trying to build an application, but this limitation is killing me. Trimming my apps post on a daily basis. I would love to at least see some sort of documentation explaining this, and maybe information on the minimum required to avoid the post from disappearing.

toniwidmo commented 6 years ago

I used to really like the Created tab on steemit before it broke. Does steemit.com use steem-js for that feed, or is this a bug upstream in the API itself?

I can confirm, it isn't just old posts that get excluded. Indeed, sometimes old posts show up whilst more recent ones don't. It seems pretty random, but isn't. Refreshing always brings up the same list of posts on any given day.

BartolomeoItaliano commented 6 years ago

Hi, probably you should find API address or check steemit.com code, I know steem-js library could be a lot better...

https://github.com/steemit/condenser

toniwidmo commented 6 years ago

@BartolomeoItaliano I wouldn't know where to look in steemit condenser code. Looks very confusing at first glance...

BartolomeoItaliano commented 6 years ago

If I find time, I will do it for you.

cryptouru commented 6 years ago

@antonchanning,

I believe the bug is in the API itself. Also, there is no need to go into the condenser source code to see how steemit brings the feed data. You can easily check this using the network tab of Google Chrome dev tools.

There you will find the api call that lists the posts (search for api). This is what makes me think the bug is on the API itself.

I would love to see some workaround for this or getting some attention from the devs on this serious issue

ghost commented 6 years ago

I guess we have no workaround for this, or any response of what to think about the issue?

toniwidmo commented 6 years ago

@cryptouru If the bug is in the API backend, then perhaps an issue needs to be raised against its code base? Or if one already has, maybe it can be linked to from here so those interested can follow its progress?

ghost commented 6 years ago

Interesting that steemitstage has the same problems. its using appbase which, I think, has an entirely different api.

toniwidmo commented 6 years ago

Sounds like the issue might be deep in the core then? I do remember back when the it seemed to stop working on steemit. At first I thought it was a deliberate change, but that really doesn't make sense the more I think about it...

cryptouru commented 6 years ago

@antonchanning

The issue is indeed in the core of the API. As it happens even when browsing steemit or busy. It's none 'API wrapper' dependant :(