I made this in response to a comment I saw here asking for it, since people are sharing a lot of experiments like 3 GB browser-side Gemma demos. The idea is that you can serve something temporarily just as long as there is interest in it, and once everyone leaves and closes that tab it disappears. This is good for one-off experiments, videos or files, browser-side Linux VM's in wasm, large model demonstrations, anything cool that you made and want to share temporarily. View source to see how easy it is to use.
>can someone make a cdn for it or some sort u uberfast downloader? just throw some claude credits against it ty!
Okay, I did so. I realize that in your later followup comment you might want something different (like for Chrome itself to cache these downloads or something) but for now I made what you asked for, here you go:
It's an ultrafast temporary CDN for one-off experiments like this. Should be lightning fast. By including the script, you can include any file this CDN serves.
I love this idea. Unfortunately, it says "Unsupported browser/GPU" for me. This is Desktop Chrome version 147 (page says it requires 134+) and I have a 1060 card with 6 GB of RAM on this specific device, so it should fit. I have more than 4 GB of free RAM as well.
Would you be okay with it using your upload at the same time, then a p2p model would work. (This is potentially a good match for p2p because edge connections are very fast, they don't have to go across the whole Internet). You could be downloading from uploaders in your region. Let me know if you would be okay with uploading at the same time, then this model works and I can build it for you for people to use this way.
It's a good project that makes sense. I recommend adding a contractual layer as well, since it's free and makes sense. Operators could legally sign that they will not look into the inference layer. After all, the operators already have a financial relationship with this provider, so it makes sense to add a contract to it and keep operators from looking into other people's data that way, too. I wish this project a lot of success.
I spent several days assembling this small encyclopedia of some core content from Biology and Health Sciences, Physical Sciences, and Technology. Gemma 4 e:4b wrote each entry, each one about a paragraph. Unlike a large encyclopedia that it's easy to get lost in, its compact size makes it easy to skim through in one sitting and find something interesting. It's distributed under cc0 (like public domain) so you can redistribute it or use it however you like, it doesn't come with any restrictions like Wikipedia (which requires share-alike.) The complete encyclopedia is 1.67 MB, smaller than the size of most web pages.
You can read it for fun or curiosity, or use it to judge the state of Gemma and its knowledge of these concepts.
It's highly coherent (see my other comment for an example of its text output) and yes, it's useful. I am starting to use Gemma 4:e4b as my daily driver for simple commands it definitely knows, things that are too simple to use ChatGPT for. It is also able to code through moderately difficult coding tasks. If you want to see it in action, I posted a video about it here[1] (the 10 GB one is at the 2 minute mark and the 20 GB one says hello at 5 minutes 45 seconds into the video.) You can see its speed and output on simple consumer grade hardware, in this case a Mac Mini M4 with 24 GB of RAM.
For those who would like an example of its output, I'm currently working through creating a small, free (cc0, public domain) encyclopedia (just a couple of thousand entries) of core concepts in Biology and Health Sciences, Physical Sciences, and Technology. Each entry is being entirely written by Gemma 4:e4b (the 10 GB model.) I believe that this may be slightly larger than the size of the model that runs locally on phones, so perhaps this model is slightly better, but the output is similar. Here is an example entry:
I've now published the encyclopedia.[1] I wrote the goals on that page, which are educational. Or you can use it to judge the state of Gemma 4 and its knowledge of these areas.
reply