Walmartlabs crams everything into 1 Kafka topic. You can complain about their site, but reality is it works as well as Amazon or whatever else. It doesn't matter how.dumb your architect is, anything will work. Scaling is only a problem if you are blithely incompetent. If you hold the fact that your system is able to scale as a gold standard your standards are low. The vast majority of programmimg time is.spent on cosmetic things about the code and inane business requirements. The actual scaling nowadays is just hitting a button in AWS. And of course you'll talk about Albertsons because there isn't anything hard about scaling. Or about network switches and whatever that are now completely irrelevant in serverless. Face it, modern programming is baby stuff.
Mmm it’s perfectly fine to have one topic, as long as you have enough partitions to distribute the load and process each partition consistently? I have managed a pretty sizeable infrastructure with 500 MB/s (megabyte) flowing into one single Kafka topic. But obviously I needed to have multiple partitions and multiple consumer groups.
Lol. Sizeable.
Glad to see you’re addressing a point that’s not relevant to the discussion. Even at 500MB/s you need multiple partitions or won’t be able to keep up if you’re doing anything slightly meaningful with the messages.
Lol. Sizeable.
Reality is, most major websites get 90% of their traffic through an app or embedded os call (eg Android). Google already knows what you are going to search within a second of you typing, by the time you click to search it's already pinged every site you could be looking for and cached the entire result. So with extensive control over the local browser and native apps it gets way easier to scale.
🤦♂️
Actually Google determines what you should be typing beforehand and injects brain waves through their Android phone RF antenna and gyroscope. That is how they are able to prefetch and scale.
True story. I have seen that “brainwave to code” transformation library.
I’m wearing diapers
You have very narrow view to see things, please change your diaper first, then get more experience
Tell me about the scaling challenges at ZILLOW GROUP
Lame
Anyone can scale with PHP and a dial-up connection
That's literally facebook
if (scaleLimitReached){ dont(); }
LimitReached ? Scale() : Dont();
Just click the autoscale button
you also don’t need network switches because you have serverless 🤦♂️
Actually you have a point. I don't think AWS is solving any problems Albertsons can not. Albertsons deals with real world problems than artificial things like S3 and SQS.
How come Albertsons is always out of my favorite fruit pops in the frozen aisle?
Because all messages, I mean pops, must go through one topic, I mean distribution center.