Do all the things like ++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatarSign Up
Hey are using unique identifiers or any hashing of attributes for the messages in Kafka? Just trying to help haha
@pandasama oh wow yeah the issue sounds complicated, what I usually do in those types of situations is that I invert the question... sounds weird I know but bear with me, instead of asking how Do I fix X? ask yourself How do I screw up X? list all your answers and check everything.
In your situation it might go like:
How Do I create duplicates in the system:
Maybe I can connect the database to the wrong environment (then you check if that’s the case)
Perhaps I can create false positives in the logging system.
I hope it helps even a bit dude!
@duckycode thank you ducky! That’s exactly how I’ve grown to do things too haha, I’ve checked those details too but sadly to no avail, the duplicates were intentional due to some chaos testing going on, and it’s fine to have duplicates, they just need to be ignored but aren’t even though the logs say they are ; _ ; and this works fine in other envs which is more annoying, I think anyone senior would be wasting their time on this so it’s just me for this but there’s really no clear solution to this, thanks got the tips though! Glad to know I was atleast thinking the right way :)