Viewing a single comment thread. View all comments

matth0x01 t1_j7ayc9e wrote

Seems that you are more interested on the crawling and ETL side.

Maybe you should look more into Data warehouse or Data lake literatur. Especially the shift in paradigm from ETL (extract, transform, load) to ELT (extract, load, transform) respectively schema-on-read.

2

Ggronne OP t1_j7bg7r1 wrote

Thanks! Can you recommend any good resources for ELT (and ETL)?

1

matth0x01 t1_j7c3smm wrote

Sorry, my library seems a bit outdated on that side.

But the one from Wikipedia looks great at first sight. Ralph., Kimball (2004). The data warehouse ETL toolkit : practical techniques for extracting, cleaning, conforming, and delivering data

1