GET events API #1362

juandspy · 2022-03-07T12:45:23Z

Version

9.1.2

Steps to Reproduce

I've tried to download all the events belonging to an issue (~15K) and I was only able to get a 10% of those. I followed the documentation about pagination and built this code:

import os
import requests

SENTRY_URL = "{PLACE YOUR URL HERE}"
API_KEY = os.getenv("SENTRY_API_KEY")
FIELDNAMES = [
    'message',
    'id',
    'tags',
    'dateCreated', 'dateReceived',
    'entries',
]

def download_events(issue_id: str):
    url = f'{SENTRY_URL}/api/0/issues/{issue_id}/events/'

    events = []
    while True:
        response = requests.get(
            url,
            headers={'Authorization': 'Bearer {TOKEN}'.format(TOKEN=API_KEY)}
        )
        data = response.json()
        events.extend(data)
        link = response.links

        if len(data) == 0:
            print("Empty respose from", url)
            break
        else:
            print("Last event date: {0}".format(data[-1]['dateCreated']))
        
        if link["next"]["results"]:
            url = link["next"]['url']
        else:
            print("Next response will be empty")
            break
    print(len(events))    # This should print something ~15K
    return events


if __name__ == '__main__':
    events = download_events("1601149")

It should print something close to 15K, but I'm getting just 1750 events.

Some logging about what's happening in the script

GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641584461:0:0
      rel    : next
      results: true
      cursor : 1646641584461:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641761726:0:1
      rel    : previous
      results: false
      cursor : 1646641761726:0:1
Last event date: 2022-03-07T08:26:24.494Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641584461:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641564851:0:0
      rel    : next
      results: true
      cursor : 1646641564851:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641584461:0:1
      rel    : previous
      results: true
      cursor : 1646641584461:0:1
Last event date: 2022-03-07T08:26:05.025Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641564851:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641387982:0:0
      rel    : next
      results: true
      cursor : 1646641387982:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641564851:0:1
      rel    : previous
      results: true
      cursor : 1646641564851:0:1
Last event date: 2022-03-07T08:23:08.052Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641387982:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641203212:0:0
      rel    : next
      results: true
      cursor : 1646641203212:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641387982:0:1
      rel    : previous
      results: true
      cursor : 1646641387982:0:1
Last event date: 2022-03-07T08:20:03.247Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641203212:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641076479:0:0
      rel    : next
      results: true
      cursor : 1646641076479:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641203212:0:1
      rel    : previous
      results: true
      cursor : 1646641203212:0:1
Last event date: 2022-03-07T08:17:56.549Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641076479:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640950325:0:0
      rel    : next
      results: true
      cursor : 1646640950325:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646641076479:0:1
      rel    : previous
      results: true
      cursor : 1646641076479:0:1
Last event date: 2022-03-07T08:15:50.345Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640950325:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640757728:0:0
      rel    : next
      results: true
      cursor : 1646640757728:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640950325:0:1
      rel    : previous
      results: true
      cursor : 1646640950325:0:1
Last event date: 2022-03-07T08:12:37.754Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640757728:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640686994:0:0
      rel    : next
      results: true
      cursor : 1646640686994:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640757728:0:1
      rel    : previous
      results: true
      cursor : 1646640757728:0:1
Last event date: 2022-03-07T08:11:27.025Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640686994:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640594029:0:0
      rel    : next
      results: true
      cursor : 1646640594029:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640686994:0:1
      rel    : previous
      results: true
      cursor : 1646640686994:0:1
Last event date: 2022-03-07T08:09:54.092Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640594029:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640429428:0:0
      rel    : next
      results: true
      cursor : 1646640429428:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640594029:0:1
      rel    : previous
      results: true
      cursor : 1646640594029:0:1
Last event date: 2022-03-07T08:07:09.450Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640429428:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640305393:0:0
      rel    : next
      results: true
      cursor : 1646640305393:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640429428:0:1
      rel    : previous
      results: true
      cursor : 1646640429428:0:1
Last event date: 2022-03-07T08:05:05.651Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640305393:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640249354:0:0
      rel    : next
      results: true
      cursor : 1646640249354:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640305393:0:1
      rel    : previous
      results: true
      cursor : 1646640305393:0:1
Last event date: 2022-03-07T08:04:09.590Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640249354:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640228650:0:0
      rel    : next
      results: true
      cursor : 1646640228650:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640249354:0:1
      rel    : previous
      results: true
      cursor : 1646640249354:0:1
Last event date: 2022-03-07T08:03:48.689Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640228650:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640216955:0:0
      rel    : next
      results: true
      cursor : 1646640216955:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640228650:0:1
      rel    : previous
      results: true
      cursor : 1646640228650:0:1
Last event date: 2022-03-07T08:03:36.989Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640216955:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640195353:0:0
      rel    : next
      results: true
      cursor : 1646640195353:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640216955:0:1
      rel    : previous
      results: true
      cursor : 1646640216955:0:1
Last event date: 2022-03-07T08:03:15.395Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640195353:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640171253:0:0
      rel    : next
      results: true
      cursor : 1646640171253:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640195353:0:1
      rel    : previous
      results: true
      cursor : 1646640195353:0:1
Last event date: 2022-03-07T08:02:51.450Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640171253:0:0
Response:
    length data : 100
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646615227093:0:0
      rel    : next
      results: true
      cursor : 1646615227093:0:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646640171253:0:1
      rel    : previous
      results: true
      cursor : 1646640171253:0:1
Last event date: 2022-03-07T01:08:21.244Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646615227093:0:0
Response:
    length data : 50
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646598911629:1:0
      rel    : next
      results: false
      cursor : 1646598911629:1:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646615227093:0:1
      rel    : previous
      results: true
      cursor : 1646615227093:0:1
Last event date: 2022-03-06T20:35:11.629Z
--------------------
GET {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646598911629:1:0
Response:
    length data : 0
    next headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646598911629:1:0
      rel    : next
      results: false
      cursor : 1646598911629:1:0
    previous headers:
      url    : {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=0:0:1
      rel    : previous
      results: true
      cursor : 0:0:1
Empty respose from {SENTRY_SELF_HOSTED_URL}/api/0/issues/{ISSUE_ID}/events/?&cursor=1646598911629:1:0


TOTAL_LENGTH: 1750

The cursor never moves to 100:0 or something like that. It stays in 0:0, 0:1 or 1:0.

Expected Result

I'm expecting the whole bunch of events instead of just a portion.

Actual Result

Just a subset of the events.

The text was updated successfully, but these errors were encountered:

chadwhitacre · 2022-03-07T16:03:39Z

Are you sure the pagination docs apply to such an old version as 9.1.2? Maybe we have pagination bugs in 9 that were fixed later? 🤔

chadwhitacre · 2022-03-07T23:10:23Z

(Note to self: this made me think of #1252 but seems unrelated.)

juandspy · 2022-03-08T06:50:26Z

@chadwhitacre I'm not sure. How can I check that? I think the published documentation is just for the last version.

aminvakil · 2022-03-08T07:43:32Z

@juandspy Maybe check https://github.com/getsentry/sentry-docs/commits/master/src/api/pagination.mdx ?

First commit is after 9.1.2 has been released though, can you upgrade to recent versions?

juandspy · 2022-03-08T08:19:31Z

@juandspy Maybe check https://github.com/getsentry/sentry-docs/commits/master/src/api/pagination.mdx ?

First commit is after 9.1.2 has been released though, can you upgrade to recent versions?

I'm afraid this is not hosted by me or my team directly, so I don't think so. Thanks for the answer. I'll find another workaround!

chadwhitacre · 2022-03-14T14:32:04Z

Good luck @juandspy! :)

getsantry bot added the Status: Untriaged label Mar 7, 2022

chadwhitacre added the Type: Support Request label Mar 7, 2022

getsantry bot removed the Status: Untriaged label Mar 7, 2022

juandspy closed this as completed Mar 8, 2022

github-actions bot locked and limited conversation to collaborators Mar 30, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

GET events API #1362

GET events API #1362

juandspy commented Mar 7, 2022 •

edited

Loading

chadwhitacre commented Mar 7, 2022

Uh oh!

chadwhitacre commented Mar 7, 2022

Uh oh!

juandspy commented Mar 8, 2022

Uh oh!

aminvakil commented Mar 8, 2022

Uh oh!

juandspy commented Mar 8, 2022

Uh oh!

chadwhitacre commented Mar 14, 2022

Uh oh!

Uh oh!

GET events API #1362

GET events API #1362

Comments

juandspy commented Mar 7, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Version

Steps to Reproduce

Expected Result

Actual Result

chadwhitacre commented Mar 7, 2022

Uh oh!

chadwhitacre commented Mar 7, 2022

Uh oh!

juandspy commented Mar 8, 2022

Uh oh!

aminvakil commented Mar 8, 2022

Uh oh!

juandspy commented Mar 8, 2022

Uh oh!

chadwhitacre commented Mar 14, 2022

Uh oh!

juandspy commented Mar 7, 2022 •

edited

Loading