Hacker Newsnew | past | comments | ask | show | jobs | submit | VHRanger's commentslogin

The S3 API doesn't work like normal filesystem APIs.

Part of it is that it follows the object storage model, and part of it is just to lock people into AWS once they start working with it.


I'm 100% aware of how S3 works. I was questioning why the S3 API is needed when the service is using local storage.

Sometimes API compatibility is an important detail.

I've worked at a few places where single-node K8s "clusters" were frequently used just because they wanted the same API everywhere.


Apart from all these other products that implement s3? MinIO, Ceph (RGW), Garage, SeaweedFS, Zenko CloudServer, OpenIO, LakeFS, Versity, Storj, Riak CS, JuiceFS, Rustfs, s3proxy.

Add Tigris to the list as well please.

We maintain a page that shows our compatibility with S3 API. It's at https://www.tigrisdata.com/docs/api/s3/. The test runner is open source at https://github.com/tigrisdata-community/s3-api-compat-tests


Riak CS been dead for over a decade which makes me question the rest. Some of these also do not have the same behaviors when it comes to paths (MinIO is one of those IIRC).

Also, none of them implement full S3 API and features.


There's a difference between S3 API spec and what Amazon does with S3 - for isntance, the new CAS capabilities with Amazon are not part of the spec.

Ceph certainly implements the full API spec, though it may lag behind some changes. It's mostly a question of engineering time available to the projects to keep up with changes.


> There's a difference between S3 API spec and what Amazon does with S3 - for isntance, the new CAS capabilities with Amazon are not part of the spec.

Sure, but those are S3 APIs and features that provided by AWS. We not talking about S3 spec, we're talking about s3 product.


What does RadosGW miss?

The API has sort of become a standard. There are many providers providing S3 API-compatible storage.

What kind of vendor lock-in do you even talk about. Their API is public knowledge, AWS publishes the spec, there are multiple open source reference client implementations available on GitHub, there are multiple alternatives supporting the protocol, you can find writings from AWS people as high in hierarchy as Werner Vogels about internals. Maybe you could say that some s3 features with no alternative implementation in alternative products are a lock-in. I would consider it a „competitive advantage”. YMMV.

> part of it is just to lock people into AWS once they start working with it.

This is some next-level conspiracy theory stuff. What exactly would the alternative have been in 2006? S3 is one of the most commonly implemented object storage APIs around, so if the goal is lock-in, they're really bad at it.


> What exactly would the alternative have been in 2006?

Well, WebDAV (Document Authoring and Versioning) had been around for 8 years when AWS decided they needed a custom API. And what service provider wasn't trying to lock you into a service by providing a custom API (especially pre-GPT) when one existed already? Assuming they made the choice for a business benefit doesn't require anything close to a conspiracy theory.

And it worked as a moat until other companies and open source projects started cloning the API. See also: Microsoft.


WebDAV is kinda bad, and back then it was a big deal that corporate proxies wouldn't forward custom HTTP methods. You could barely trust PUT to work, let alone PROPFIND.

WebDAV is ass tho. I don't remember a single positive experience with anything using it.

And still need redundant backend giving it as API


When I was in school, we had a SkunkDAV setup that department secretaries were supposed to use to update websites... supporting that was no fun at all. I'm not sure why it was so painful (was 25 years ago) but it left a bad taste in my mouth.

That's not surprising; Opus & Sonnet have been regressing on many non-coding tasks since about the 4.1 release in our testing

There's presumably engagement on those two.

It's better to have a smaller core of highly engaged people than a mass of disengaged eyeballs glazing over.


"...and we win by putting our time, skills, and members’ support where they will have the most impact. Right now, that means Bluesky, Mastodon, LinkedIn, Instagram, TikTok, Facebook, YouTube"

So pretty much all major sites except X. They are saying LinkedIn is more important to reach people than X, really?


Does it have to be either/or?

Volunteer your time to do a dual strategy with content that fits both. Comms takes time, the EFF is adapting its comm strategy.

Surely copy-pasting a short text and possibly a link is not actual work that takes time.

All they would need to do is set up some cross-posting pipeline and the work would be pretty much zero.

They could even drive people to click on mastodon/bsky links this way if they wanted people to go to the decentralized web.

This take is not valid.


Pushing messages out to multiple platforms is a solved problem. Parent said

> It's better to have a smaller core of highly engaged people than a mass of disengaged eyeballs glazing over.

which to me, it's better to spew a message out into the ether with the chance that someone might happen upon it rather than close things off entirely.


Retreating into smaller and smaller echo chambers where they get their way?

They're also still posting on LinkedIn, Instagram, TikTok, Facebook, and YouTube (in addition to BlueSky and Mastodon). It's silly to suggest that anything outside of X is an echo chamber, or that one must communicate on a platform dominated by white supremacists to expose your ideas to a diverse audience.

Pytorch is such a maddening mess of half implemented research features in a state of Heisen-deprecation, Jax becomes more appealing to me by the day.


Remember when we had the term "spyware" for a class of malware?

I remember


If rust is not in the HN title and fire emojis in the readme, it doesn't come from the Rust region of France.

It's just sparkling memory safe high performance software


Yeah I'm another pop os user.

Cosmic works great for a laptop. But it's a PITA for a desktop. It doesn't deal with multi monitor setups well. There's a recent new bug where the system hardlocks on monitor power state changes, which is unacceptable.

So: great for single screen laptop, not good for desktop or server


Youre aware that the rest of the planet have stricter gun laws and the American problems are fairly unique?

This is even after controlling for things that exacerbate crime like high economic inequality.

For instance, Brazil [1] (a much poorer and more unequal country than the USA) has lower murder rate than a lot of cities now than the USA. The murder rate of Rio seems to be about on the level of Houston (17/100k), or about a third of Detroit (47).

But Rio clearly has __a lot more crime__ than Houston. It's palpable when you're in either city. Even with the Favelas and heavily armed gangs, the murder rate is comparatively low because *normal people dont have guns at nearly the same rate*.

And it shouldn't take a leap of faith to figure out that higher gun ownership leads to more deaths. Guns are the one tool we have intentionally made to cause death.

1. I'm aware that Brazil has a higher murder rate, but comparing cities is a better pick. The northeast of Brazil is in another league than anywhere in the USA in economic conditions; it's not comparable. The only city I can think of with USA levels of economic development would be Florianopolis (murder rate 7/100k) or maybe Balneario Camboriu, or some parts of Sao Paulo like Vila Olimpia.


[flagged]


Ah, some egregious misuse of statistics!

Murder is a byproduct of crime. Crime is, largely, downstream of economic conditions with some obvious caveats.

New Hampshire has the 2nd lowest crime rate of the USA states. You could make the same argument for, say, Switzerland (high gun ownership but no crime/murder). But no one would be surprised if you had high gun ownership in Monaco.

Similarly for the ethnic argument you're trying to make: Majority black neighbourhoods in the USA tend to be poor. They also tend to be near more affluent places. Unlike poor white neighbourhoods, which are on average more rural in the USA.

Being poor, and being next to rich people, and being excluded from legal increases of becoming rich, will increase crime.

This should be obvious. Brazil has famously Favelas right next to wealthy areas and has a persistent crime problem for example.

---

In short, it's really incredible how far some Americans will go to deny the obvious truth: *gun prevalence increases deadly crime*.

Sure, some cultural factors will increase crime/violence on the margin. But the reason y'all have a bunch of shootings is that you have a bunch of guns to do shootings with. That simple.


I don't think it's good to hold a misunderstand of the statistics against someone when (as in this case) they're so easy to read in a certain way.

> the reason y'all have a bunch of shootings is that you have a bunch of guns to do shootings with

Yet by your own admission poverty and inequality appear to account for the bulk of the effect.

Actually I think you'll find that plenty of Americans will acknowledge the link you point out. Just not in a politically charged exchange where the other party appears to have an ideological axe to grind. Where they'll likely disagree is the extent or significance of it. In many cases they will object that rights should never be curtailed for the purpose of lowering petty crime (I tend to agree).

I think it's also worth mentioning the statistic that legal gun owners (which is a wildly low bar in the US) have a lower rate of violent offense than the police.


Sure poverty explains crime, and murder is the ultimate crime.

That said, my point was that a place like Rio, where you feel alertness at a physiological level by the constant lack of security, still has a murder rate around Houston, a vastly richer and safer city.

And Brazil really is a good comparison in my opinion: the economic inequality is actually worse than in the USA, and they both have the slave holding history leading to concentrated poverty areas with high ethnic segregation

I don't personally think that the upsides of the US gun laws are worth anything near the downsides being paid.

Regarding the police, American police is notoriously prone to violence compared to other developed countries.


Ah it seems you finally understand the point. Blaming the skin pigment is as silly as blaming the gun.

Murder rates in US have very little to do with gun law, and they have very little to do with skin color, even though they're heavily correlated to the latter and weakly correlated to the former.


Of course within the USA the state levels laws will do little. There's free movement between states!

Compare the USA to Canada, where you can't bring a gun easily. You'll see Canadian murder rates being very low. Even controlling for similar factors at the city or neighborhood level.

Of course I'm blaming the gun: it's pretty hard to kill someone with other weapons. Stabbings are often survived, even.


If you just want to pick an American neighbor and make a crude comparison based on that, I could just as easily point out Mexico, which has stricter gun laws than the USA and Canada and fewer guns per capita than both USA and Canada. And yet a higher murder rate than both. And I cannot 'easily' (disputable, but lets accept on face these semantics for the purpose of controlled national border) take a gun to or from Mexico.

I assert again it is not the gun laws even if you want to do a national level view. Even a national analysis of gun laws in the three major countries of North America do not yield the conclusion you assert.

You are cherry picking to try and find causality while damning a comment where I merely pointed out a correlation between black people and murder rates. This is hypocrisy.

When you started to look at underlying causes at crime, you were so very close to getting there, but for some reason disengaged from that and went back to our flawed basis that would suggest it's the black pigment or it's the guns causing it.


Mexico has much lower economic development and higher crime.

Canada has similar levels of economic development.

It's really not that complicated: controlling for general crime levels, guns drastically increase murder rates.


A map over poor people would likely look the same.


Which shows how ridiculous it is to assign that as the cause, doesn't it? It's almost as if pointing to a lot of guns or black people in one spot doesn't show that's why murders are happening, only allows you to tie statistical correlation.


GDDR7x doesn't come in dimm factor?

In general soldered ram seems to get much higher bandwidth than removeable ram. See ryzen AI Max vs 9950x max ram throughputfor example


Strix Halo uses a 256bit memory interface, the normal desktop processors only have a 128bit interface, that's the biggest difference in bandwidth. For more bandwidth you need to go to a Threadripper.

Strix Halo seems to use LPDDR with 8000 MT/s, which is a bit faster than the usual 5600 MT/s-6400 MT/s "normal" DDR5-DIMMs (Albeit (expensive) faster ones seem to exist), so there's a slight edge towards soldered memory (not sure about LPCAMM2 and similar tech).

GDDR7 is a different league, a 5070 Ti also has a 256bit memory interface, but has 896GB/s bandwidth, compared to strix halo with 256GB/s


It's really hard to push DDR5 past 6000MT/s on 4+ DIMMs it seems.

I had to get everything top spec to fit 4 channels of 6000MT/s on my 9950x (asus proArt motherboard and the top tier trident neo RAM sticks) -- otherwise it's reportedly unstable.


9950X is dual channel, running 4 DIMMs runs them interleaved, with two DIMMs sharing one physical connection, impacting signal integrity severely. AFAIK this has gotten worse with DDR5 to the point that it's generally recommended to avoid 4 DIMMs unless you really can't get enough RAM otherwise. For maximum bandwidth you need to avoid interleaving.

Strix Halo simply has more memory controllers. Threadrippers are also quad channel, and should be able to run 4 DIMMs at rated speeds, but the cheapest Zen 5 Threadripper seems to be almost double the price of a 9950X3D.


And I presume that doubled price is before you look at the workstation class motherboards, which also tend to be much more expensive.

Thanks for the info on the hardware quirks, useful to know!

We seem to be arriving at a cambrian explosion of viable hardware these days between ARM and x86, soldered vs DIMM, etc.

It's refreshing coming from 20 years of x86 being all that matters.


No.

All GDDR memory is intended only for being soldered around a GPU chip, on the same PCB. This is how they achieve a memory throughput that is 4 to 8 times higher than the DDR memories used in DIMMs or SODIMMs.


We are talking here about slower ram to augment.


paperless-ngx?


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: