Quantcast
Channel: Pentaho Community Forums
Viewing all articles
Browse latest Browse all 16689

What is the proper "ETL way" of caching and re-using webservice results?

$
0
0
I need to look-up a value from a table, if it's not there, then call a slowish web service to look it up, and cache the results in the table so it'll be there for quick use next time.

I've been struggling with a few variations of this and they have all been too complicated (high maintenance), buggy, or both.

So I'm thinking of scrapping whatever I tried and starting over. This must be a common pattern. Are there any examples I can readily adapt to my purposes?

Ideal solution would be a Step where I define the Web Service call and a Results Caching Table in one go.

Viewing all articles
Browse latest Browse all 16689

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>