-
Ether symbol, Greek Xi (
ĪāĪ¾
), should probably be changed from Greek to Common script so itās available in all names. There should probably be a rule file which lets us re-script a character (most likely change would be X ā Common.) -
Does anyone have any opinions on Regional Indicators? Should we only allow valid regional flags (pairs of Regional Indicators)
-
To reduce the character space, we could force rare scripts (Unicode Excluded) to be pure labels (single script). For example, we could restrict hieroglyphics to āpureā labels. Potentially, pure labels can also include emoji?
- Latin/Greek/Cyrillic ā canāt mix with eachother + whole-script confusables
- Excluded scripts ā must be pure?
- Everything else can mix (for now)
-
I also think these whole-script confusable rules are too strict:
-
One more update on these 2 disabled emoji: I donāt expect the text-presentation default rendering for and to change (theyāll be uncolored
!!
and!?
forever) so I think the best UX is to map ā and ā . -
What about characters that arenāt supported natively on Mac/Win/Nix? Should that be part of the consideration? For example,
26E4 (ā¤) PENTAGRAM
doesnāt work on Mac.
-
Is that because you think it should be treated as more of a currency symbol? I guess thatās alright
-
Only valid regional character combinations makes sense, itās similar to how only valid RGI emoji combinations are allowed
-
Yes that sounds good for that table of excluded scripts. But I think emojis should still be allowed to mix with other characters
-
I think the whole-script confusable stuff might be too much yeah. I think just mixed-script, so that Latin/Greek/Cyrillic arenāt mixed together.
-
Makes sense
-
I donāt think characters should be excluded just because a particular platform doesnāt display them, unless there are other good reasons
- Invalid Flag Sequences / Single Regionals Disallowed
- All excluded scripts cannot mix:
except with emoji:
- Ether symbol is now common script:
- Pentagram and other characters that donāt work on Mac are restored:
Excited to see the new threat started and everything consolidated!
As we continue to move forward with proposals regarding normalization is my understanding correct that even if this first round of updates gets pushed through, that the ENS team only wants to roll out the normalization standards once and not have to revisit the topic for another update?
I ask because Iām hoping that itās not too late to sort out some other characters and use cases before that window closes (within reason of course).
two characters specifically that I think should be allowed are & and + in the middle of words. official brands (who can sometimes be very sensitive about accurate notation of their names) will be looking for this, such as johnson&johnson, black+decker, A&M Records, arm&hammer, AT&T, Kraft Sports + Entertainment. ect.
outside of brand names specifically, these symbols are used pretty commonly as joiners (more so the & than the +) and could be applied in many two word combinations.
Unless there is some kind of practical syntax issues with including these in the middle of words, (which if there is please speak up) is it easily possible to include these two characters in the normalization update?
I think revisiting is inevitable. Right now Iād like us to settle on a reasonable starting point, erring on the side of being too restrictive, since itās easier to make the rules less restrictive over time than it is to add new restrictions.
I donāt think these can ever be part of a valid name, as theyāre valid characters in URLs (+
replaces a space in paths and query strings, and &
separates query parameters).
Thoughts on disallowing skin tone and hair modifiers as singular emoji?
Stats: 6701 names with modifiers (98% valid), 18 pure modifier names, 109 names contain a singular modifiers.
There is ambiguity around trailing skin-color with ZWJ sequences that contain modifiable characters.
-
There exist dedicated ZWJ sequences with skin-color styling:
-
The following ZWJ sequence is followed by a skin-color modifier, however it presents like a single emoji, with one golden human and one skin-colored human.
According to the spec, this should present like:
Disallowing singular modifiers would prevent this problem.
A separate decision would be to whitelist these mixed modifier ZWJ sequences (I say no.)
I would lean towards adhering to the spec and disallowing the singular modifiers.
The following was provided to me by zombiehacker who canāt post on the forums yet but wanted to comment about the modifier issue:
Today we are discussing RGI emojis, which stands for Recommended for General interchange. What is and isnāt recommended for general use has changed greatly throughout the existence of humanity and the internet, so what is recommended today may not be in the future.
With that said, while I fully understand this proposal from a programmers perspective, I have 28 years of experience programming, I get the thought process.
The 109 pre-existing non-RGI emojis, were coined as mistake emojis by another holder of these non-rgi emojis. Mistakes and errors have been the most valuable items throughout human history.
The red cheeks Pikachu Pokemon card has sold for $10,000, why? Because it was a mistake and is supposed to have yellow cheeks, which sells for $1000.
https://news.tcgprice.com/10-most-valuable-pokemon-error-cards/
The 1922 penny without the D mark are worth $500, a penny is worth $500, why? A mistake, an error, or simply put not conforming with recommended general interchange of currency. 15 pennies out of 1 billion in 1945 were struck wrong when being made, making them sale up to 1 million dollars. If we remove mistakes, we are removing what it is that humans love, the imperfections of life.One of the rarest Dungeon and Dragon characters is the colossal red dragon worth $649. Just think, if we removed a character from D&D or pokemon and made all previous characters and or cards not even look the same retroactively, the players would not be happy. https://www.thegamer.com/dungeons-and-dragons-miniatures-worth/
What weāre dealing with here is bigger than an RGI or non-RGI issue, we are dealing with finances, the human mind, collectibles, and rarity. Only 109 of these mistakes currently exist. Does this mean every mistake is worth more than the original? No, it doesnāt, humans are unique in what they put value to.How do we stop this going forward?
Those that are already minted, these 109 should be put into an allow-list of supported non-RGIās because they already have been minted and already exist. I donāt want to dive into the topic of censorship, but breaking something for being different, would demonstrate that you have the ability to censor words or phrases, dictators, or any ruler, or province doesnāt like.
Going forward anything that does not comply with the RGI sequence should be blocked before minted, anyone who tries to cheat and bypass the system, those should also be voided. What exists should always exist.
-
I have disabled singular skin modifiers:
-
I left singular hair modifiers () enabled as they function slightly differently and donāt seem to collapse/merge into existing sequences (as it requires an additional ZWJ).
-
For reference, all disabled emoji can be found here along with their fate (mapped, invalid).
-
Iāve added many more characters to the disallowed list although still more work is needed. Most of these changes are for extremely rare/never used characters that are legal in IDNA.
-
I marked many more symbols as isolates to prevent abuse.
-
I want to add the limited-use scripts to the set of scripts that canāt mix.
-
I think we should relax some more Greek characters to Common script:
- Latin
Āµ
is mapped to GreekĪ¼
by IDNA -
Ļ
(Greek-only) is very common - Maybe:
Ļ
(Greek-only) - For example,
Ļ
shouldnāt be mapped because there are Latin/Greek/Cyrillic variants.
- Latin
-
If we wanted tilde (
7E (~) TILDE
), I think itās possible use223C (ā¼) TILDE OPERATOR
and we could provide a convenience mapping like apostrophe, otherwise all the tilde-likes should be disallowed.
I think non-RGI emoji sequences should continue to be disallowed. Some of those could be RGI in the future, and can be added later, like when we do an update for a new Unicode version or something. The arguments about misprinted coins or cards donāt make sense at all to me, that is a completely different circumstance. Any name that was minted will continue to exist and the owner will still own it, that cannot change. The only thing being tweaked here is whether the name has valid metadata or not. We already know that there are going to be plenty of names that were valid on the website in the past which are now invalid, and I believe TNL is working on some plan to issue refunds for those.
===
- Adding limited-use scripts to unmixable makes sense
- Ļ is fine at least, not sure about others
- That sounds fine to me about the tilde operator, so youād also make all the other tilde-likes map to 223C as well?
I use ~ a lot in my work, but I feel itās a confusable for - for a lot of people when they see it visually
Just my opinion
Iām still also not sure about the bullets, I know one is a circle and one is square, but they kinda can be confused as an Arabic 0 in my view, you also have the middle dots being valid just now
Also is the apostrophe ā (u+2019) not a confusable for ׳ (u+05f3)
~ and ā¢ are not confusables.
All of the apostrophe confusables should be mapped to ā (U+2019).
If you map all apostrophe confusables to U+2019, then you are excluding Hebrew words
In my view, this is not right
Braille isnāt going through just now, but in the future will it??
Braille is made up from round dots in various combinations, yep confusable for braille
Iām not bothered if Braille never comes to ENS, Iām still trying to fully work out how it would work, but the decision has to be made now, if bullets are allowed then the door on braille in the future has already been closed in my view
Your opinion on confusables is skewed.
Ever since the underscore debate your opinons have been subpar.
No. Geresh is Hebrew. However, Iām not sure how to handle the RTL languages. I havenāt been able to get much feedback regarding CheckBidi or if a label could be mixed direction (mixed direction names are really weird to manipulate.) Hebrew could easily be script restricted (which makes direction irrelevant) ā Iām just not sure if thatās acceptable.
I think we should revisit the non-RGI whitelisted emoji. I now think itās a mistake to whitelist any non-RGI emoji.
Reference: UTS-51: Emoji Sets
- Note: this suggests skin color modifiers should be allowed as singular, but doesnāt account for rendering/platform differences which cause the modifier to get absorbed into other characters.
- Note: this also suggests that
Emoji
which arenātBasic_Emoji
arenāt RGI. This only includes digits (+FE0F) and single regionals, which are both disallowed.
I didnāt realize any non-RGI were whitelisted, but yeah I agree that only RGI emojis should be allowed. If any become RGI in the future, then they can be added in future updates, such as when we update for a new Unicode version.
Hebrew and Arabic both read numbers left to right, so there are mixed names possible always. It breaks brains, and many programs. Check out the El Al logo. It reads the same RTL and LTR. Cool use case to ponder.
Where are we now with hyphen rules? Itās hard to follow with all the versions. Is it still only leading ones? They are getting more attention these days in the speculation world.
This goes really deep into a lot a lot of things. I concur with zombiehacker. If there is a way to roll out in stages of languages after consulting with multiple academics in each one it would be good. Thereās a lot of crazy stuff with various languages, and the ENS should support them all. Language unification is one of the worst things that could happen to humanity, and the DNS took us quite a ways to that point. Decentralization is really based on every language and culture having a proportionally equally voice.
Hyphens are anywhere except **--
(position 2,3 if the label is ASCII.). Reasonable hyphen-like characters are mapped to hyphen. Remaining dash-like characters are disallowed.
I have focused on Latin/Common scripts, punctuation, emoji, and symbol-like characters. Excluded/limited-use scripts have been restricted. The ASCII confusables scripts (Greek/Cyrillic) canāt mix or use whole-script confusables. Combining marks are restricted to one. Many marks are disabled.
So to clarify, would -0-.eth be invalid, but -00-.eth would be?
I forgot about the leading underscores, is that still just leading?
After thinking about this for some weeks, I really would think everything through with the mappings/groupings. I can think of weird things, like in Dutch ij is one letter, and their keyboard has it as one letter, but everyone Dutch doesnāt want a Dutch keyboard because everyone speaks English. I remember learning Dutch for a year after I lost my phone in Amsterdam in a taxi. I replaced it with the same one, except the Windows CE version it was in was locked to Dutch language. It was a lot of money, so I just learned the Dutch UI instead of buying another phone. My Dutch friends laughed a lot. Microsoft didnāt get that localizing for Dutch meant putting things in English.
The context of that long story matters because even in that localization there wasnāt ij as a letter in the primary keyboard, it was an alternate still, so I always just typed the two letters. This kind of scenario where you can spell things both ways can be infuriating when mapping languages to specific keysets, or making word lists.
I write in Spanish often (poorly), but I never use accents or the Ʊ because I have an English keyboard. In fact, the English speaking city where I crew up had a street name in Spanish with an Ʊ, and 30 years on, now itās replaced with just an n, and everyone says the street name wrong. Kind of like how everyone says Crimea wrong today in English (Hint: it never rhymed with crime before the 2000s). A simple gap in history, and new history was made. I hope the same thing doesnāt happen to more obscure languages just because someone not familiar with the language makes a booboo. Iām not going to take any political stance here, but I do think perception has shifted based on the pronouncing of Crimea, and writing things as Karabakh instead of Artsakh. Almost nobody means harm doing it, but yet ignorance got in there and massaged history for the eyes of outsiders.
Ć and Å are both valid letters in English. Just because English changed to omit these letters most of the time does not make them less valid. Itās similar to church Russian or old Russian. Ij in Dutch has kind of one the way of Ć and Å, but in our lifetime. Itās why it was already relegated on the keyboard circa 2006. Should Å map to oe? Are they the same?
I know how to pronounce them, but I have no idea how to even argue for what to do if there were a mapping of just English letters. Who decides the English alphabet? Is it all of the English words that ever existed? Is it just what is currently taught in schools? What about dialects of English that have weird digraphs?
Both are valid but 00--.eth
is invalid because it has --
at 2,3.
Yes. Allowed(__ab.eth
) and Disallowed(a_b.eth
)
Thereās a lot of digraph/ligatures in Latin (50+ lowercase). In general, I think theyāre all bad for ENS. Iāve kept a few literal ones ij/ļ¬/ļ¬/
ā¦ (which are both mapped to their component letters by IDNA) and Ʀ
(which stays as one) but I disallowed rest. ļ¬
/ļ¬/ź”/ź³/
ā¦ seem bad (mapped or valid.)
Iām about to deploy an update with script-based combining-mark whitelists. This enables stuff like āwith dot aboveā on specific Latin characters w/o enabling it on characters like āiā (which is pure insanity.) This also allows whitelisting multiple-CMs at the character-level (since the general rule allows at most one).
For your example, tilde is only allowed over a, e, n, and o. Tilde variations like middle, double-middle, vertical, below, overlay, etc. are all disabled.
For Greek/Cyrillic/Common, Iāve used the exemplars, for Latin, Iāve picked a subset of exemplars at my own discretion. For example, Iām pretty sure we donāt need all these variations: Ä aį· aį·
but these are great: Ʃ Ʊ Ƨ
.
From the Isolated characters Iāve collected, they all turned out to be Common-script, so Iāve now retired the Isolated concept (characters that should never get CMs) as I get that for free with this approach.