UUIDs make great primary keys in some applications. If you generated 100 trillion UUID4s, there’s about a 1 in a billion chance of finding a duplicate. Thats usually good enough for my databases.
The issue here was that they used a single UUID instead of generating a new one for each record.
There are countless issues here. They didn’t do exception handling, they used a string to store their UUIDs (even if this was a DB constraint, you use sqlalchemy.Uuid and let the ORM and DB handle the translation), and as the person you’re replying to stressed, they’re using non-monotonic UUIDs. Also if you have a unique user_id and you’re never exposing your primary keys, you don’t need to get fancy, just let the ORM handle it with auto-incrementing, for most use cases. And so many other tragic things about this one tiny blog post.
tl;dr if you’re going to copy code you don’t understand, copy it from the docs, not from everything in the kitchen thrown into a blender.
can’t wait for the Clever Idea to offload costly string indices to an external source composed of redis box and some shitfuck app doing tf-idf after a Extensive Research into how to make string lookups be faster
This sounds like a case of premature optimization to me. We have plenty of databases using strings as Ids and they’re all more than fast enough for any of our purposes. And that’s with considerable volume going through.
I’ve never seen bad performance from string ids be an issue.
“what are you talking about? a hammer removes bolts just fine. i personally don’t have an issue with the tiny bit of extra elbow grease to wedge the claw around the bolt-head and twist; if anything, it’s saving me effort from having to use a wrench.”
I was reading it as an endorsement for autoincrementing int primary keys and a condemnation of uuids in general which is a genuine stance I’ve known people to take. Is that not it?
edit: this was far too harsh of a reply in retrospect, apologies. the question is answered below, but i’ll echo it: a “monotonic UUID” is one that numerically increases as new UUIDs are generated. this has an advantage when writing new UUIDs to indexed database columns, since most database index structures are more efficient when inserting at the end than at a random point (non-monotonic UUID’s).
I’ve more of a math background than cs so monotonic is a word I know well but it apparently means something slightly different to me. Monotonicity isn’t mentioned anywhere in that link.
Everything after this is so pointlessly condescending and confusing. Even if someone knows what monotonic ids are it doesn’t automatically mean they’re going to have any clue about what that means with regards to index performance. In the spirit of not being an asshole, I’ll write it out here based on my research since everyone else just seems interested in putting others down rather than being helpful.
“Monotonic” implies something that is always increasing (or decreasing). You’ll never get a result that’s lower than one you’ve gotten before (or higher if you’re dealing with monotonically decreasing stuff).
Random UUIDs are not monotonic because they’re random.
Even time based UUIDs are not monotonic because of the format. Rather than being store high, medium, low, they’re stored low, medium, high. Think of it like storing numbers like “1 20 300” for 321. 322 would be “2 20 300”. To make it worse, the end of them is “random” (a MAC address). So, not monotonic at all because MAC addresses can change. (See here for proposed new formats, where they mention this as a problem https://www.ietf.org/archive/id/draft-peabody-dispatch-new-uuid-format-04.html)
Monotonic primary keys are useful because they’re more easily inserted into an index because you’re always inserting into one specific part of the index rather.
putting my 2¢ forward: this is a forum for making fun of overconfident techbros. i work in tech, and it is maddening to watch a massively overvalued industry buy into yet another hype bubble, kept inflated by seemingly endless amounts of money from investors and VCs. and as a result it’s rather cathartic to watch (and sneer at) said industry’s golden goose shit itself to death over and over again due to entirely foreseeable consequences of the technology they’re blindly putting billions of dollars into. this isn’t r/programming, this is Mystery Science Theater 3000.
i do not care if someone does or does not understand the nuances of database administration, schema design, indexing and performance, and different candidates for the types of primary keys. hell, i barely know just enough SQL to shoot myself in the foot, which is why i don’t try to write my own databases, in the hypothetical situation where i try to engineer a startup that “extracts web data at scale with multimodal codegen”, whatever that means.
if someone doesn’t understand, and they come in expressing confusion or asking for clarification? that’s perfectly fine – hell, if anything, i’d welcome bringing people up to speed so they can join in the laughter.
but do not come in here clueless and confidently (in)correct the people doing the sneering and expect to walk away without a couple rotten tomatoes chucked at you. if you want to do that, reddit and hacker news are thataway.
agreed. we’ve veered a bit too close to slashdot’s tone on this one.
with that said, I’m also acutely aware of the tactics that programming.dev reply guys use to generate these kinds of responses. to our guests: it’s best to take your questions about database best practices literally anywhere else but here.
with that said, I’m also acutely aware of the tactics that programming.dev reply guys
I wasn’t actually aware of this, and will be taking note of it in future. for my part I tried to make my reply “uhh go look at $x and learn” post without, y’know, overtly making things into a not-meant-for-here debate setup, but that didn’t seem to have worked out entirely well :)
Just to be clear, if a person is wrong about best practices then it’s not a big deal.
In context of spicy autocomplete as coding assistance, it better output immaculate, robust code every fucking time or we should be clowning on it with zero remorse.
when you do not yet have (1) customers, (B) unit tests, (ג) developers who can write their own code, or (IV) exception handling, the term-of-art that comes to mind for doing anything besides auto-incrementing primary keys is YAGNI. (Especially because nobody who is making thoughtful, careful database tuning decisions is using chat-gippity to convert their models. And more to the point, they aren’t using SQLAlchemy of all things to make large, distributed applications that need UUID primary keys.)
Oh for sure, the article folks are inept and absolutely not the people I was talking about. I’m just talking about stuff more like Discord or Steam that are huge distributed systems that don’t use centralized databases.
Edit: that don’t use centralized databases. I blame the ADHD.
Whoops, I flubbed that message hard and didn’t catch it at the time: Meant to say “don’t use centralized databases.” They definitely use databases lmao. No idea how I screwed that message up so hard. I blame ADHD for not proofreading.
Just so we’re on the same page, let me be more specific. I’m saying the individuals in the article were making terrible decisions. Lots of them.
I am also saying that UUIDs are good primary keys for very specific purposes: Large, distributed systems that handle large amounts of small data, powered by databases like Cassandra that are designed to handle millions of record insertions per hour across several hundred nodes, to the point where inserts are very likely to happen at the exact same time on two different replicas of the same schema.
Hope that makes more sense than my previous flub. lol
i think the original comment that this thread is in reply to is avoiding non-monotonic UUIDs. i don’t think anyone is contesting that autoincrementing ints create headaches when trying to distribute the database
See, reason being is they use aethernet - that’s the only way you get to get scale it like this. Without that, communication and storage would just be impossible!
UUIDs make great primary keys in some applications. If you generated 100 trillion UUID4s, there’s about a 1 in a billion chance of finding a duplicate. Thats usually good enough for my databases.
The issue here was that they used a single UUID instead of generating a new one for each record.
There are countless issues here. They didn’t do exception handling, they used a string to store their UUIDs (even if this was a DB constraint, you use
sqlalchemy.Uuidand let the ORM and DB handle the translation), and as the person you’re replying to stressed, they’re using non-monotonic UUIDs. Also if you have a uniqueuser_idand you’re never exposing your primary keys, you don’t need to get fancy, just let the ORM handle it with auto-incrementing, for most use cases. And so many other tragic things about this one tiny blog post.tl;dr if you’re going to copy code you don’t understand, copy it from the docs, not from everything in the kitchen thrown into a blender.
they also stored this thing as a fucking string. looking up strings is costly.
naw bro we’ve got indexes bro it’ll be fine bro
can’t wait for the Clever Idea to offload costly string indices to an external source composed of redis box and some shitfuck app doing tf-idf after a Extensive Research into how to make string lookups be faster
This sounds like a case of premature optimization to me. We have plenty of databases using strings as Ids and they’re all more than fast enough for any of our purposes. And that’s with considerable volume going through.
I’ve never seen bad performance from string ids be an issue.
so we’re calling “not doing pointless unnecessary work” premature optimization now? cool cool
Making me learn how to do things the right way is premature optimization
Removed by mod
ok shut up now
“what are you talking about? a hammer removes bolts just fine. i personally don’t have an issue with the tiny bit of extra elbow grease to wedge the claw around the bolt-head and twist; if anything, it’s saving me effort from having to use a wrench.”
I really should reread that sometime
Also some Mickens
Removed by mod
why is it always programming dot dev?
You haven’t seen shit then, simple as that.
You’re missing the entire point of the post you replied to
I was reading it as an endorsement for autoincrementing int primary keys and a condemnation of uuids in general which is a genuine stance I’ve known people to take. Is that not it?
indeed, that is not it
hint: don’t try to “read in” any extra meanings. just read the actual statement that was posted.
second hint: throw “monotonic UUIDs” into your search engine of choice
Would they not have monotonic uuids after altering the code in the article to use a function or lambda as they suggested?
you might know what “monotonic” means if you had googled it, which would also give you the answer to your questionedit: this was far too harsh of a reply in retrospect, apologies. the question is answered below, but i’ll echo it: a “monotonic UUID” is one that numerically increases as new UUIDs are generated. this has an advantage when writing new UUIDs to indexed database columns, since most database index structures are more efficient when inserting at the end than at a random point (non-monotonic UUID’s).
I’ve more of a math background than cs so monotonic is a word I know well but it apparently means something slightly different to me. Monotonicity isn’t mentioned anywhere in that link.
okay, for some reason, I feel the need to help.
The given link defines the function that creates a UUID:
In mathematics, can you generate a monotonic function by generating random numbers?
just stop digging, sheesh
deleted by creator
Everything after this is so pointlessly condescending and confusing. Even if someone knows what monotonic ids are it doesn’t automatically mean they’re going to have any clue about what that means with regards to index performance. In the spirit of not being an asshole, I’ll write it out here based on my research since everyone else just seems interested in putting others down rather than being helpful.
putting my 2¢ forward: this is a forum for making fun of overconfident techbros. i work in tech, and it is maddening to watch a massively overvalued industry buy into yet another hype bubble, kept inflated by seemingly endless amounts of money from investors and VCs. and as a result it’s rather cathartic to watch (and sneer at) said industry’s golden goose shit itself to death over and over again due to entirely foreseeable consequences of the technology they’re blindly putting billions of dollars into. this isn’t r/programming, this is Mystery Science Theater 3000.
i do not care if someone does or does not understand the nuances of database administration, schema design, indexing and performance, and different candidates for the types of primary keys. hell, i barely know just enough SQL to shoot myself in the foot, which is why i don’t try to write my own databases, in the hypothetical situation where i try to engineer a startup that “extracts web data at scale with multimodal codegen”, whatever that means.
if someone doesn’t understand, and they come in expressing confusion or asking for clarification? that’s perfectly fine – hell, if anything, i’d welcome bringing people up to speed so they can join in the laughter.
but do not come in here clueless and confidently (in)correct the people doing the sneering and expect to walk away without a couple rotten tomatoes chucked at you. if you want to do that, reddit and hacker news are thataway.
Yeah, I’m all for dunking on promplets, but just being wrong about best practice isn’t a big deal. The reaction here is excessively harsh.
agreed. we’ve veered a bit too close to slashdot’s tone on this one.
with that said, I’m also acutely aware of the tactics that programming.dev reply guys use to generate these kinds of responses. to our guests: it’s best to take your questions about database best practices literally anywhere else but here.
I wasn’t actually aware of this, and will be taking note of it in future. for my part I tried to make my reply “uhh go look at $x and learn” post without, y’know, overtly making things into a not-meant-for-here debate setup, but that didn’t seem to have worked out entirely well :)
Just to be clear, if a person is wrong about best practices then it’s not a big deal.
In context of spicy autocomplete as coding assistance, it better output immaculate, robust code every fucking time or we should be clowning on it with zero remorse.
Wait a second…to err is to be human. Programmers err sometimes. ChatGPT shits itself all the time…😟. Yud et al. were right
Read the sidebar. This is literally not the place.
The fuck is a side bar? My app doesn’t have that. Be more specific, please.
If your “app” cannot show basic information about the forum to which you are posting, your “app” is bad.
no, programming.dev, let’s fucking not
They’re good for large, distributed applications for sure. Better than incrementing integers for those kinds of applications at the very least.
For the folks in the article though? lol they were making no good decisions
when you do not yet have (1) customers, (B) unit tests, (ג) developers who can write their own code, or (IV) exception handling, the term-of-art that comes to mind for doing anything besides auto-incrementing primary keys is YAGNI. (Especially because nobody who is making thoughtful, careful database tuning decisions is using chat-gippity to convert their models. And more to the point, they aren’t using SQLAlchemy of all things to make large, distributed applications that need UUID primary keys.)
Oh for sure, the article folks are inept and absolutely not the people I was talking about. I’m just talking about stuff more like Discord or Steam that are huge distributed systems that don’t use centralized databases.
Edit: that don’t use centralized databases. I blame the ADHD.
Edit 2: I am agreeing with this person
huh???
Whoops, I flubbed that message hard and didn’t catch it at the time: Meant to say “don’t use centralized databases.” They definitely use databases lmao. No idea how I screwed that message up so hard. I blame ADHD for not proofreading.
Just so we’re on the same page, let me be more specific. I’m saying the individuals in the article were making terrible decisions. Lots of them.
I am also saying that UUIDs are good primary keys for very specific purposes: Large, distributed systems that handle large amounts of small data, powered by databases like Cassandra that are designed to handle millions of record insertions per hour across several hundred nodes, to the point where inserts are very likely to happen at the exact same time on two different replicas of the same schema.
Hope that makes more sense than my previous flub. lol
okay that’s a little more sensible lol
i think the original comment that this thread is in reply to is avoiding non-monotonic UUIDs. i don’t think anyone is contesting that autoincrementing ints create headaches when trying to distribute the database
See, reason being is they use aethernet - that’s the only way you get to get scale it like this. Without that, communication and storage would just be impossible!
I accidentally a word in the original comment, it was supposed to say they don’t use *centralized databases. Instead it said I’m a moron lmao.
Bit of a whoopsie, that :)
And I just saw what that poster’s domain is, fuck me