Quantcast
Channel: Pentaho Community Forums
Viewing all articles
Browse latest Browse all 16689

Calling REST AIP with pagination

$
0
0
I have a REST api call to extract data periodically.
The API has pagination, one time return back 50 rows or something.

Let say I'm calling http://www.blabla.com/pageid=1

The return format is in json like below
{
"data" :
[
{"field1": "field value", "field2": "field2 value"},
{"field1": "field value", "field2": "field2 value"},
{"field1": "field value", "field2": "field2 value"},
..
]
,
"total" : 80
"prev_url": "http://www.blabla.com/pageid=1",
"next_url": "http://www.blabla.com/pageid=3"
}


I need to repeat the REST call till the next_url value is empty.
How can I achieve that in PDI?


Any suggestion is appreciated.
Thanks.

Viewing all articles
Browse latest Browse all 16689

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>