I've come up with a new network design that will improve our packet loss even more. I've been testing it in the lab and it has drastically reduced packet loss on terrestrial and subsea link failure. It might take a few months to actually implement this new network design in PROD, but it is certainly one of my higher priorities right now. Trying to get a few things sorted with third parties to make it a reality. Will be great to improve packet loss even more!
One of the things that has triggered me to come up with a new network design that improves packet loss is due to the instability of the lowest latency cable Perth <-> Sydney. It was having issues about a week ago now and has always not been the most stable terrestrial link and I've been labing theories I've had on how to improve packet loss even more and I finally found something that drastically improved packet loss on terrestrial and subsea cable failures that certainly happen here and there. Fun times and will be happy once this new design is implemented in PROD, will post progress here I guess.
To measure the packet loss improvements I had to build a secret tool using Rust, that was a project in itself and put me in a position to be able to measure the packet loss improvements down to the ms failover times. The other tools of the market for ms packet loss measurements aren't there right now...
Bump, will replying to this make this thread at the top again?
Not sure if I jinxed it or not, but it looks like the lowest latency cable Perth <-> Sydney just had a few mins of not looking so great. Certainly highlights to me the need to get this new network design in place to reduce the packet loss drastically on terrestrial cable issues.