September 26th, 2024

New standards for a faster and more private Internet

Cloudflare has introduced Zstandard compression for faster data processing and Encrypted Client Hello to enhance user privacy, improving website load times and overall user experience in digital environments.

Read original articleLink Icon
SkepticismConcernCriticism
New standards for a faster and more private Internet

Cloudflare has introduced new standards aimed at enhancing internet speed and privacy, focusing on the implementation of the Zstandard (zstd) compression algorithm and the rollout of Encrypted Client Hello (ECH). Zstandard is a modern compression algorithm that offers data compression speeds 42% faster than Brotli while achieving similar compression levels. It also reduces file sizes by 11.3% compared to GZIP, which is crucial for improving website load times and user experience. The adoption of Zstandard is expected to significantly enhance performance, especially for dynamic content. Additionally, Cloudflare is advancing privacy measures with ECH, which prevents third parties from monitoring users' web activity by masking the Server Name Indication (SNI) during TLS handshakes. This means that only the user, Cloudflare, and the website owner can see which sites are being visited. Cloudflare's commitment to these technologies reflects a broader trend towards optimizing web performance and enhancing user privacy in an increasingly demanding digital landscape.

- Cloudflare has implemented Zstandard compression, which is faster and more efficient than existing algorithms.

- Zstandard compresses data 42% faster than Brotli and reduces file sizes compared to GZIP.

- Encrypted Client Hello (ECH) enhances user privacy by preventing third-party snooping on web activity.

- The new standards aim to improve website load times and overall user experience.

- Cloudflare continues to innovate in web technologies to meet growing demands for speed and security.

AI: What people are saying
The introduction of Zstandard compression and Encrypted Client Hello (ECH) by Cloudflare has sparked a variety of reactions among users.
  • Concerns about privacy: Some commenters argue that ECH may not enhance privacy as intended, suggesting it centralizes data control with Cloudflare.
  • Technical critiques: Users discuss the effectiveness of Zstandard compared to Brotli, questioning the benchmarks and compression levels used.
  • Implications for censorship: ECH is seen as a potential tool for users in repressive regimes, but also raises concerns about enabling malicious actors.
  • Performance skepticism: Some believe that the impact of Zstandard on user experience is minimal, primarily benefiting Cloudflare's resource management.
  • Debate over trust: There are calls for caution regarding Cloudflare's control over standards and the potential for collusion in data handling.
Link Icon 20 comments
By @rkagerer - about 2 months
ECH - if I understand correctly it's effective for sites hosted on big providers like Cloudflare, AWS, etc, but doesn't add much value when it comes to self-hosted domains or those on a dedicated server, as you'd still see traffic going to whatever IP and be able to infer from that which domain the user's browswer is talking to. I'm hoping someone can explain that I missed something.

And while we're explaining things... ODoH (indirectly mentioned in the article via the Encrypted DNS link) comes with a big bold warning it's based on the fundamental premise that the proxy and the target servers do not collude. When both are operated by the same company, how can you know they aren't colluding? Is there some mechanic in the protocol to help protect users from colluding servers?

By @Animats - about 2 months
"This means that whenever a user visits a website on Cloudflare that has ECH enabled, no one except for the user, Cloudflare, and the website owner will be able to determine which website was visited. Cloudflare is a big proponent of privacy for everyone and is excited about the prospects of bringing this technology to life.'

This isn't privacy. This is centralized snooping.

It's like Google's approach to third party cookies. Nobody other than Google can have tracking information.

By @terrelln - about 2 months
The latest Zstandard exposes several parameters which are useful for reducing time to first byte latency in web compression. They make Zstandard cut the compressed data into smaller blocks, e.g. 4 KB, with the goal to fit a compressed block within a small number of packets, so the browswer can start to decompress without waiting for a full 128 KB block to be sent.

These parameters are described in the v1.5.6 release notes [0]. ZSTD_c_targetCBlockSize is the most notable, but ZSTD_c_maxBlockSize can also be used for a lower CPU cost but larger compressed size.

Are you using these features at Cloudflare? If you need any help using these, or have any questions, please open an issue on Zstandard's GitHub!

[0] https://github.com/facebook/zstd/releases/tag/v1.5.6

By @rajnathani - about 2 months
> Zstandard’s branchless design is a crucial innovation that enhances CPU efficiency

Given how branchless algorithms are helping optimize not just network transport (compression) and even OS system libs (no citation for this one, but I’ve heard), that I really wish colleges begin teaching this along with DS/Algo course material.

By @userbinator - about 2 months
New standards for easier TLS fingerprinting and user-agent discrimination.

Edit: just look at how many sites you're locked out of if you don't have JS enabled or run an uncommon configuration.

By @sedatk - about 2 months
DPI systems in Turkey weren't even checking QUIC packets when I was there, let alone ECH. But, browsers usually start with TCP first to negotiate QUIC support, which prevented bypass of web blocks. If you could force your browser to establish connection directly using QUIC, you could bypass all the blocks. That was last year though. Not sure about the current situation.
By @lifthrasiir - about 2 months
The benchmark for Zstandard against Brotli seems to miss a key information---the compression levels used for both algorithms, because both the compression ratio and compression time will depend on them. In fact this had been my long suspicion about introducing Zstandard to the web standard, because lower compression levels for Brotli are not that slow and it was never publicly mentioned whether improving lower Brotli levels deemed infeasible or not. Given Zstandard Content-Encoding was initially proposed by Meta, I'm not even sure they have at least tried.

Given we now have two strictly better algorithms than gzip, I also wonder about a hybrid scheme that starts with Zstandard but switches to Brotli when the compression time is no longer significant for given request. We might even be able to cheaply convert the existing Zstandard stream into Brotli with some restrictions, as they are really LZSS behind the scene?

By @irq-1 - about 2 months
What will ECH mean for places like China or South Korea? Do governments have access to Cloudflare logs? Only with court orders?

ECH seems directly opposed to Chinese governments control of the web.

By @autoexec - about 2 months
Cloudflare is happy to make it harder for anyone other than Cloudflare to see everything that you're doing on the internet.
By @Rhapso - about 2 months
Don't trust cloudflare with standards control.

They do not have anybody else's best interests at heart and are actively centralizing that which was explicitly intended to not be centralized.

By @casenmgreen - about 2 months
I use Tor for privacy.

CF blocks Tor; you can't get past the captcha.

By @moralestapia - about 2 months
A very nice feature of zstd is that it is seekable. So you could map that to HTTP Range requests and go crazy about it.
By @java-man - about 2 months
Does it mean ECH works only with the Cloudflare since their example ECH contains unencrypted outer layer client hello?
By @uSoldering - about 2 months
What is the overlap of people who are reading a blogpost about Cloudflare standards and people who need a metaphor to understand what compression is? You have 7 paragraphs of highly technical information then just in case, you need to explain how compression works? Just tell your reader you think they're a moron and save yourself the keystrokes.
By @jiggawatts - about 2 months
After examining how scammers and phishers host their sites, I’ve realised that “private” for Cloudflare means protecting the privacy of criminals.

ECH makes it hard to block known scam sites at the network layer, for example.

By @aaomidi - about 2 months
ECH is going to be huge for people in regressive countries. For example Iran.
By @daveau - about 2 months
re: ECH

let the cat and mice game between deep packet inspection (DPI) vendors and the rest of the encrypted internet continue. it’ll be amusing to see what they come up with (inaccurate guessing game ai/ml “statistical analysis” is about all they’ve got left, especially against the large umbrella that is cloudflare).

game on, grab your popcorn, it will be fun to watch.

By @barbazoo - about 2 months
> New standards for a faster and more private Internet

> Zstandard

I get "faster" but how does it make the internet "more private". The word "private" only shows up exactly once on that page, in the title.

By @nialse - about 2 months
Let me just stress that the effect of Zstandard on individual end-user latency is a rounding error. No user will ever go: “That was a quick loading web site. Must be Zstandard!”. The effect is solely Cloudflare having to spend x% less bandwidth to deliver the content, saving on their network and server resources.