Clips API missing many clips even for small time ranges

[willlllllio]

Brief description

Time range based Clips API requests will often be missing many clips

How to reproduce

curl -H "$authheader" 'https://api.twitch.tv/helix/clips?broadcaster_id=69906737&started_at=2020-01-15T18:40:00Z&ended_at=2020-01-15T18:50:00Z&first=100'

Returns around 16 clips total, no pagination token "pagination":{}:

(only posting created_at and id for clarity)

2020-01-15T18:40:22Z        AgitatedHotGazelleNotLikeThis
2020-01-15T18:41:39Z        SaltyLitigiousBisonRlyTho
2020-01-15T18:42:23Z        EncouragingConcernedCookieCharlietheUnicorn
2020-01-15T18:43:21Z        PunchyGlutenFreeWoodcockFutureMan
2020-01-15T18:43:45Z        RockyResourcefulWormSaltBae
2020-01-15T18:44:11Z        CrunchyIgnorantCoyoteBibleThump
2020-01-15T18:44:50Z        OnerousViscousLarkChocolateRain
2020-01-15T18:45:40Z        CuriousSmilingWheelNerfBlueBlaster
2020-01-15T18:46:17Z        HandsomeSillyBunnyPJSugar
2020-01-15T18:46:31Z        PoorCovertLeopardYouDontSay
2020-01-15T18:46:54Z        NastyCloudyReubenLeeroyJenkins
2020-01-15T18:47:15Z        PiercingSmallPonyDeIlluminati
2020-01-15T18:47:37Z        EnchantingAverageHyenaSMOrc
2020-01-15T18:48:13Z        HilariousInexpensiveBadgerOSkomodo
2020-01-15T18:48:36Z        KawaiiFurryWalletPlanking
2020-01-15T18:48:51Z        SweetClearBillWholeWheat

Only about half of the existing clips in the time range are returned. Which ones appears to be somewhat random and can change over time but it never returns all of them.

Expected behavior

Return all existing clips in that 10 minute time range:

2020-01-15T18:40:22Z        AgitatedHotGazelleNotLikeThis
2020-01-15T18:40:58Z        ObliviousArbitraryPastaDatSheffy
2020-01-15T18:41:39Z        SaltyLitigiousBisonRlyTho
2020-01-15T18:42:23Z        EncouragingConcernedCookieCharlietheUnicorn
2020-01-15T18:42:30Z        UnusualStupidOryxPeteZaroll
2020-01-15T18:43:21Z        PunchyGlutenFreeWoodcockFutureMan
2020-01-15T18:43:31Z        UninterestedShinyCobblerPastaThat
2020-01-15T18:43:45Z        RockyResourcefulWormSaltBae
2020-01-15T18:44:11Z        CrunchyIgnorantCoyoteBibleThump
2020-01-15T18:44:34Z        StrangeObliviousMonitorPicoMause
2020-01-15T18:44:50Z        OnerousViscousLarkChocolateRain
2020-01-15T18:45:40Z        CuriousSmilingWheelNerfBlueBlaster
2020-01-15T18:46:15Z        MoldyGiftedShrewVoteNay
2020-01-15T18:46:17Z        HandsomeSillyBunnyPJSugar
2020-01-15T18:46:25Z        AffluentDeafCheesecakeCopyThis
2020-01-15T18:46:31Z        PoorCovertLeopardYouDontSay
2020-01-15T18:46:36Z        FrozenPlacidClintBrokeBack
2020-01-15T18:46:39Z        OnerousRenownedSkunkImGlitch
2020-01-15T18:46:44Z        ExcitedBrainyLapwingMikeHogu
2020-01-15T18:46:53Z        TenderEnticingNeanderthalPraiseIt
2020-01-15T18:46:54Z        NastyCloudyReubenLeeroyJenkins
2020-01-15T18:46:55Z        AuspiciousLaconicSangFreakinStinkin
2020-01-15T18:47:15Z        PiercingSmallPonyDeIlluminati
2020-01-15T18:47:26Z        PeacefulStylishLionWholeWheat
2020-01-15T18:47:37Z        EnchantingAverageHyenaSMOrc
2020-01-15T18:48:13Z        HilariousInexpensiveBadgerOSkomodo
2020-01-15T18:48:36Z        KawaiiFurryWalletPlanking
2020-01-15T18:48:51Z        SweetClearBillWholeWheat

Clips found via previous requests and from chat.

Screenshots

Additional context or questions I'm aware that this API will not return all clips for large time ranges with a huge number of clips in them but (seems it's limited to 1k?) but even a small 10 minute time range only returning 16 of the 28 clips in it is very surprising.

[mauerbac]

Thanks for linking @BarryCarlyon . Will close this one :)

[dmatech1]

Is there any way this ticket could be re-opened? The related tickets are all closed and seem to relate to the 1000-clip limit or the 10-minute resolution of the started_at and ended_at parameters.

https://api.twitch.tv/helix/clips?broadcaster_id=179065334&first=100&started_at=2018-07-13T21%3A45%3A00Z&ended_at=2018-07-25T07%3A30%3A00Z returns 39 records, but clip PhilanthropicModernHorseradishLitty on 2018-07-19 isn't returned despite it being in between 2018-07-13 and 2018-07-25. It's returned in a query on a longer date range, though.

[Xemdo]

Reported as still occurring. Will re-investigate