I have a REST api call to extract data periodically.
The API has pagination, one time return back 50 rows or something.
Let say I'm calling http://www.blabla.com/pageid=1
The return format is in json like below
{
"data" :
[
{"field1": "field value", "field2": "field2 value"},
{"field1": "field value", "field2": "field2 value"},
{"field1": "field value", "field2": "field2 value"},
..
]
,
"total" : 80
"prev_url": "http://www.blabla.com/pageid=1",
"next_url": "http://www.blabla.com/pageid=3"
}
I need to repeat the REST call till the next_url value is empty.
How can I achieve that in PDI?
Any suggestion is appreciated.
Thanks.
The API has pagination, one time return back 50 rows or something.
Let say I'm calling http://www.blabla.com/pageid=1
The return format is in json like below
{
"data" :
[
{"field1": "field value", "field2": "field2 value"},
{"field1": "field value", "field2": "field2 value"},
{"field1": "field value", "field2": "field2 value"},
..
]
,
"total" : 80
"prev_url": "http://www.blabla.com/pageid=1",
"next_url": "http://www.blabla.com/pageid=3"
}
I need to repeat the REST call till the next_url value is empty.
How can I achieve that in PDI?
Any suggestion is appreciated.
Thanks.