Do all the things like ++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatarSign Up
I started reading this and was like, "I bet this is going to boil down to 'at most once'"
Was not disappointed 😘
NoMad712128dAhhh the good old days I was pulling my own hair out to do data warehousing pipelines for a company using kafka... Not missing it a single bit 😛😎
NoMad712128d@mr-user yah. Don't take the data you don't need. Any data you gather should be useful to some report and have a reasonable life cycle. Don't gather mini-crap. Also, don't even think of data mining while doing warehousing. They're different activities. Books, not sure. I sat through lectures so maybe you could see some in YouTube or something.
mr-user127428d@NoMad Thank you for your info.
How about the data which does not have any usage but they may be used in the future?
What do you mean by mini-crap?
I am trying but every resource I found is just abstract. I cannot seem to link back the abstract concept into "the implementation side"