? ? ? Pending

User tests: Successful: Unsuccessful:

avatar Fedik
Fedik
2 Aug 2021

Pull Request for Issue #35014 .

Summary of Changes

I have changed transliterator_transliterate rule to support umlauts.
And transliterator provided by translator team now have a bigger priority.

Testing Instructions

Make sure your server have php-intl installed.

Create and article with alias äüö-and-ґїію-完 成-اليوم
(For test you can use English backend)

Actual result BEFORE applying this Pull Request

Umlauts transliterated incorrectly auo-and-giiu-wan-cheng-alywm

Expected result AFTER applying this Pull Request

You should get aeueoe-and-giiu-wan-cheng-alywm

Documentation Changes Required

nope

Votes

# of Users Experiencing Issue
1/1
Average Importance Score
5.00

avatar Fedik Fedik - open - 2 Aug 2021
avatar Fedik Fedik - change - 2 Aug 2021
Status New Pending
avatar joomla-cms-bot joomla-cms-bot - change - 2 Aug 2021
Category Libraries
avatar Fedik
Fedik - comment - 2 Aug 2021

@Kostelano please check if it work with uk and ru
@7at1blow please test with de

avatar Kostelano Kostelano - test_item - 2 Aug 2021 - Tested successfully
avatar Kostelano
Kostelano - comment - 2 Aug 2021

I have tested this item successfully on 283958a

Everything works well.

Ukrainian did not check - there is no localization package for J4, but the principle is identical - I think everything is fine there as well.

In Russian:

á,Á,α,ά,ą,Ą,ä,Ä,ā,а ---> a-a-a-a-a-a-a-a-a-a,
тест с долларом $ ---> test-s-dollarom-usd,
конь в пальто и буква Š ---> kon-v-palto-i-bukva-s.

Everything is according to the function in file localise.php.

UPD
If I remove the transliteration formula from the Russian language, the phrase äüö is transliterated into auo. OK.


This comment was created with the J!Tracker Application at issues.joomla.org/tracker/joomla-cms/35029.
avatar richard67
richard67 - comment - 2 Aug 2021

Would be good to have a test in Greece, too, just to be safe. Anyone Greece around?

avatar 7at1blow
7at1blow - comment - 2 Aug 2021

I've changed the code in that libraries/src/Language.php but ä ü ö will still become a u o in the alias.
I hope that I've changed the code correctly, will check that again.
Or do I have to change something else in the Backend, eg the configuration?

avatar Fedik
Fedik - comment - 2 Aug 2021

hmhm

I've changed the code in that libraries/src/Language.php but ä ü ö will still become a u o in the alias.

Try copy whole file to be sure https://raw.githubusercontent.com/joomla/joomla-cms/283958a7dc4fd063e20a13d51e807555fe95e035/libraries/src/Language/Language.php

avatar Fedik Fedik - change - 2 Aug 2021
The description was changed
Labels Added: ? ?
avatar 7at1blow
7at1blow - comment - 2 Aug 2021

I did not knew yet that there is the possibiltity to get a new whole file - am still Newbie here and in these concerns.
So, I've copied it ... but same same. Still a u o instead of ae ue oe.

Later I will check it again what I've done.
I guess that I don't have nothing to change also in the backend, do I?

avatar RickR2H RickR2H - test_item - 2 Aug 2021 - Tested successfully
avatar RickR2H
RickR2H - comment - 2 Aug 2021

I have tested this item successfully on 283958a

Patch works! Testen on menu items and articles. Also tested with different languages (Chinese, German, Dutch)


This comment was created with the J!Tracker Application at issues.joomla.org/tracker/joomla-cms/35029.

avatar richard67 richard67 - alter_testresult - 2 Aug 2021 - Kostelano: Tested successfully
avatar richard67 richard67 - alter_testresult - 2 Aug 2021 - RickR2H: Tested successfully
avatar richard67
richard67 - comment - 2 Aug 2021

I've restored the two test results in the issue tracker since the commit which invalidated them was only a grammar fix in a code comment.

avatar richard67 richard67 - change - 2 Aug 2021
Status Pending Ready to Commit
avatar richard67
richard67 - comment - 2 Aug 2021

RTC


This comment was created with the J!Tracker Application at issues.joomla.org/tracker/joomla-cms/35029.

avatar richard67
richard67 - comment - 2 Aug 2021

BTW I’ve tested too, in German.

avatar richard67
richard67 - comment - 2 Aug 2021

I've changed the code in that libraries/src/Language.php but ä ü ö will still become a u o in the alias.

@7at1blow Sure you are placing the file at the right place? It should be libraries/src/Language/Language.php and not libraries/src/Language.php like you wrote.

avatar Fedik
Fedik - comment - 2 Aug 2021

So, I've copied it ... but same same. Still a u o instead of ae ue oe.

hmhm strange,
can you please try print print_r(transliterator_list_ids()); and check whether de-ASCII exists in the output?

I guess that I don't have nothing to change also in the backend, do I?

just disable "unicode slugs"

avatar 7at1blow
7at1blow - comment - 2 Aug 2021

I've tried it again (copied the whole file/code), get still the same uncorrect result:
2021-08-02 Umlaute im Titel-Alias

avatar richard67
richard67 - comment - 2 Aug 2021

@7at1blow If you go to administrator/index.php?option=com_installer&view=warnings, do you see any warnings?

avatar 7at1blow
7at1blow - comment - 2 Aug 2021

@richard67
Thank you for your hint. Result: No warnings.

@Fedik
a) I just enabled "unicode slugs", saved, tried again the alias and then disabled "unicode slugs" again. Still the same problem.

b) Sorry, I don't understand what that means: to try to print print_r(transliterator_list_ids()); and ...
Could you please explain to me where I should do what?

avatar richard67
richard67 - comment - 2 Aug 2021

@7at1blow Next question: You are using 4.0 RC 5. Has that been a new installation or has it been a 3.10 or a previous 4.0 Beta or RC version updated to RC 5? I'm asking in order to find out what the differences could be in our sites which make it work for us but not for you.

avatar 7at1blow
7at1blow - comment - 2 Aug 2021

@richard67 Oh, good idea!
It is a 4.0.0-rc5 and it was not a new installation. It has been a 4.0 Beta in the beginning. (I don't know if/how I can see anywhere with which beta version I've done the installation - but I can see: The oldest folders of that installation have the date from 07. Jan 2021.)

avatar richard67
richard67 - comment - 2 Aug 2021

@7at1blow That could have been Beta 6. Have you updated then only one time to RC 5, or have you updated in steps? And have you always used the Joomla update component, not just unzipped the files? I need as many details as possible so I can try to reproduce it here when I have time.

avatar brianteeman
brianteeman - comment - 2 Aug 2021

@7at1blow what is the default content language?

avatar Fedik
Fedik - comment - 2 Aug 2021

Sorry, I don't understand what that means: to try to print print_r(transliterator_list_ids());

In to index.php of your template add this, somewhere at top:

echo '<pre>';
print_r(transliterator_list_ids());
echo '</pre>';
exit;

and post the result here.

there should be something like:

Array
(
    [0] => ASCII-Latin
    [1] => Accents-Any
    [2] => Amharic-Latin/BGN
    [3] => Any-Accents
....
....
avatar richard67
richard67 - comment - 2 Aug 2021

@7at1blow Meanwhile I think the update history is not relevant here. But maybe the PHP version and so the version of the transliterator library? Please do as advised by @fedir .

avatar 7at1blow
7at1blow - comment - 2 Aug 2021

@richard67 I've updated in steps, always straight after a new release has been published - means, I did every single step.
And I've used only the Joomla update component, I've never used a zip way.
Thank you very much!

@brianteeman Default Language is German for both, Admin & Site.
2021-08-02 Default Language Site
2021-08-02 Default Language Administrator

avatar 7at1blow
7at1blow - comment - 2 Aug 2021

@Fedik
Thank you for your explaination! I will do this now ...

avatar brianteeman
brianteeman - comment - 2 Aug 2021

@7at1blow Do you have German as a content language and if you have more than one content language enabled are you saving the article as language any or language german

image

avatar 7at1blow
7at1blow - comment - 2 Aug 2021

@Fedik
That's the result (I think you've intended the whole list):

[0] => ASCII-Latin
[1] => Accents-Any
[2] => Amharic-Latin/BGN
[3] => Any-Accents
[4] => Any-Publishing
[5] => Arab-Latn
[6] => Arabic-Latin
[7] => Arabic-Latin/BGN
[8] => Armenian-Latin
[9] => Armenian-Latin/BGN
[10] => Armn-Latn
[11] => Azerbaijani-Latin/BGN
[12] => Belarusian-Latin/BGN
[13] => Beng-Deva
[14] => Beng-Gujr
[15] => Beng-Guru
[16] => Beng-Knda
[17] => Beng-Latn
[18] => Beng-Mlym
[19] => Beng-Orya
[20] => Beng-Taml
[21] => Beng-Telu
[22] => Bengali-Devanagari
[23] => Bengali-Gujarati
[24] => Bengali-Gurmukhi
[25] => Bengali-Kannada
[26] => Bengali-Latin
[27] => Bengali-Malayalam
[28] => Bengali-Oriya
[29] => Bengali-Tamil
[30] => Bengali-Telugu
[31] => Bopo-Latn
[32] => Bopomofo-Latin
[33] => Bulgarian-Latin/BGN
[34] => Cyrillic-Latin
[35] => Cyrl-Latn
[36] => Deva-Beng
[37] => Deva-Gujr
[38] => Deva-Guru
[39] => Deva-Knda
[40] => Deva-Latn
[41] => Deva-Mlym
[42] => Deva-Orya
[43] => Deva-Taml
[44] => Deva-Telu
[45] => Devanagari-Bengali
[46] => Devanagari-Gujarati
[47] => Devanagari-Gurmukhi
[48] => Devanagari-Kannada
[49] => Devanagari-Latin
[50] => Devanagari-Malayalam
[51] => Devanagari-Oriya
[52] => Devanagari-Tamil
[53] => Devanagari-Telugu
[54] => Digit-Tone
[55] => Fullwidth-Halfwidth
[56] => Geor-Latn
[57] => Georgian-Latin
[58] => Georgian-Latin/BGN
[59] => Greek-Latin
[60] => Greek-Latin/BGN
[61] => Greek-Latin/UNGEGN
[62] => Grek-Latn
[63] => Grek-Latn/UNGEGN
[64] => Gujarati-Bengali
[65] => Gujarati-Devanagari
[66] => Gujarati-Gurmukhi
[67] => Gujarati-Kannada
[68] => Gujarati-Latin
[69] => Gujarati-Malayalam
[70] => Gujarati-Oriya
[71] => Gujarati-Tamil
[72] => Gujarati-Telugu
[73] => Gujr-Beng
[74] => Gujr-Deva
[75] => Gujr-Guru
[76] => Gujr-Knda
[77] => Gujr-Latn
[78] => Gujr-Mlym
[79] => Gujr-Orya
[80] => Gujr-Taml
[81] => Gujr-Telu
[82] => Gurmukhi-Bengali
[83] => Gurmukhi-Devanagari
[84] => Gurmukhi-Gujarati
[85] => Gurmukhi-Kannada
[86] => Gurmukhi-Latin
[87] => Gurmukhi-Malayalam
[88] => Gurmukhi-Oriya
[89] => Gurmukhi-Tamil
[90] => Gurmukhi-Telugu
[91] => Guru-Beng
[92] => Guru-Deva
[93] => Guru-Gujr
[94] => Guru-Knda
[95] => Guru-Latn
[96] => Guru-Mlym
[97] => Guru-Orya
[98] => Guru-Taml
[99] => Guru-Telu
[100] => Halfwidth-Fullwidth
[101] => Han-Latin
[102] => Han-Latin/Names
[103] => Hang-Latn
[104] => Hangul-Latin
[105] => Hani-Latn
[106] => Hans-Hant
[107] => Hant-Hans
[108] => Hebr-Latn
[109] => Hebrew-Latin
[110] => Hebrew-Latin/BGN
[111] => Hira-Kana
[112] => Hira-Latn
[113] => Hiragana-Katakana
[114] => Hiragana-Latin
[115] => IPA-XSampa
[116] => Jamo-Latin
[117] => Jamo-Latn
[118] => Kana-Hira
[119] => Kana-Latn
[120] => Kannada-Bengali
[121] => Kannada-Devanagari
[122] => Kannada-Gujarati
[123] => Kannada-Gurmukhi
[124] => Kannada-Latin
[125] => Kannada-Malayalam
[126] => Kannada-Oriya
[127] => Kannada-Tamil
[128] => Kannada-Telugu
[129] => Katakana-Hiragana
[130] => Katakana-Latin
[131] => Katakana-Latin/BGN
[132] => Kazakh-Latin/BGN
[133] => Kirghiz-Latin/BGN
[134] => Knda-Beng
[135] => Knda-Deva
[136] => Knda-Gujr
[137] => Knda-Guru
[138] => Knda-Latn
[139] => Knda-Mlym
[140] => Knda-Orya
[141] => Knda-Taml
[142] => Knda-Telu
[143] => Korean-Latin/BGN
[144] => Latin-ASCII
[145] => Latin-Arabic
[146] => Latin-Armenian
[147] => Latin-Bengali
[148] => Latin-Bopomofo
[149] => Latin-Cyrillic
[150] => Latin-Devanagari
[151] => Latin-Georgian
[152] => Latin-Greek
[153] => Latin-Greek/UNGEGN
[154] => Latin-Gujarati
[155] => Latin-Gurmukhi
[156] => Latin-Hangul
[157] => Latin-Hebrew
[158] => Latin-Hiragana
[159] => Latin-Jamo
[160] => Latin-Kannada
[161] => Latin-Katakana
[162] => Latin-Malayalam
[163] => Latin-NumericPinyin
[164] => Latin-Oriya
[165] => Latin-Russian/BGN
[166] => Latin-Syriac
[167] => Latin-Tamil
[168] => Latin-Telugu
[169] => Latin-Thaana
[170] => Latin-Thai
[171] => Latn-Arab
[172] => Latn-Armn
[173] => Latn-Beng
[174] => Latn-Bopo
[175] => Latn-Cyrl
[176] => Latn-Deva
[177] => Latn-Geor
[178] => Latn-Grek
[179] => Latn-Grek/UNGEGN
[180] => Latn-Gujr
[181] => Latn-Guru
[182] => Latn-Hang
[183] => Latn-Hebr
[184] => Latn-Hira
[185] => Latn-Jamo
[186] => Latn-Kana
[187] => Latn-Knda
[188] => Latn-Mlym
[189] => Latn-Orya
[190] => Latn-Syrc
[191] => Latn-Taml
[192] => Latn-Telu
[193] => Latn-Thaa
[194] => Latn-Thai
[195] => Macedonian-Latin/BGN
[196] => Malayalam-Bengali
[197] => Malayalam-Devanagari
[198] => Malayalam-Gujarati
[199] => Malayalam-Gurmukhi
[200] => Malayalam-Kannada
[201] => Malayalam-Latin
[202] => Malayalam-Oriya
[203] => Malayalam-Tamil
[204] => Malayalam-Telugu
[205] => Maldivian-Latin/BGN
[206] => Mlym-Beng
[207] => Mlym-Deva
[208] => Mlym-Gujr
[209] => Mlym-Guru
[210] => Mlym-Knda
[211] => Mlym-Latn
[212] => Mlym-Orya
[213] => Mlym-Taml
[214] => Mlym-Telu
[215] => Mongolian-Latin/BGN
[216] => NumericPinyin-Latin
[217] => NumericPinyin-Pinyin
[218] => Oriya-Bengali
[219] => Oriya-Devanagari
[220] => Oriya-Gujarati
[221] => Oriya-Gurmukhi
[222] => Oriya-Kannada
[223] => Oriya-Latin
[224] => Oriya-Malayalam
[225] => Oriya-Tamil
[226] => Oriya-Telugu
[227] => Orya-Beng
[228] => Orya-Deva
[229] => Orya-Gujr
[230] => Orya-Guru
[231] => Orya-Knda
[232] => Orya-Latn
[233] => Orya-Mlym
[234] => Orya-Taml
[235] => Orya-Telu
[236] => Pashto-Latin/BGN
[237] => Persian-Latin/BGN
[238] => Pinyin-NumericPinyin
[239] => Publishing-Any
[240] => Russian-Latin/BGN
[241] => Serbian-Latin/BGN
[242] => Simplified-Traditional
[243] => Syrc-Latn
[244] => Syriac-Latin
[245] => Tamil-Bengali
[246] => Tamil-Devanagari
[247] => Tamil-Gujarati
[248] => Tamil-Gurmukhi
[249] => Tamil-Kannada
[250] => Tamil-Latin
[251] => Tamil-Malayalam
[252] => Tamil-Oriya
[253] => Tamil-Telugu
[254] => Taml-Beng
[255] => Taml-Deva
[256] => Taml-Gujr
[257] => Taml-Guru
[258] => Taml-Knda
[259] => Taml-Latn
[260] => Taml-Mlym
[261] => Taml-Orya
[262] => Taml-Telu
[263] => Telu-Beng
[264] => Telu-Deva
[265] => Telu-Gujr
[266] => Telu-Guru
[267] => Telu-Knda
[268] => Telu-Latn
[269] => Telu-Mlym
[270] => Telu-Orya
[271] => Telu-Taml
[272] => Telugu-Bengali
[273] => Telugu-Devanagari
[274] => Telugu-Gujarati
[275] => Telugu-Gurmukhi
[276] => Telugu-Kannada
[277] => Telugu-Latin
[278] => Telugu-Malayalam
[279] => Telugu-Oriya
[280] => Telugu-Tamil
[281] => Thaa-Latn
[282] => Thaana-Latin
[283] => Thai-Latin
[284] => Thai-Latn
[285] => Tone-Digit
[286] => Traditional-Simplified
[287] => Turkmen-Latin/BGN
[288] => Ukrainian-Latin/BGN
[289] => Uzbek-Latin/BGN
[290] => XSampa-IPA
[291] => am-am_FONIPA
[292] => am-am_Latn/BGN
[293] => am-ar
[294] => am-fa
[295] => am_FONIPA-am
[296] => ar-ar_Latn/BGN
[297] => az-Lower
[298] => az-Title
[299] => az-Upper
[300] => az_Cyrl-az/BGN
[301] => be-be_Latn/BGN
[302] => bg-bg_Latn/BGN
[303] => ch-am
[304] => ch-ar
[305] => ch-ch_FONIPA
[306] => ch-fa
[307] => cs-am
[308] => cs-ar
[309] => cs-cs_FONIPA
[310] => cs-fa
[311] => cs-ja
[312] => cs-ko
[313] => cs_FONIPA-ja
[314] => cs_FONIPA-ko
[315] => dsb-dsb_FONIPA
[316] => dv-dv_Latn/BGN
[317] => el-Lower
[318] => el-Title
[319] => el-Upper
[320] => el-el_Latn/BGN
[321] => eo-am
[322] => eo-ar
[323] => eo-eo_FONIPA
[324] => eo-fa
[325] => es-am
[326] => es-ar
[327] => es-es_FONIPA
[328] => es-fa
[329] => es-ja
[330] => es-zh
[331] => es_419-am
[332] => es_419-ar
[333] => es_419-fa
[334] => es_419-ja
[335] => es_419-zh
[336] => es_FONIPA-am
[337] => es_FONIPA-es_419_FONIPA
[338] => es_FONIPA-ja
[339] => es_FONIPA-zh
[340] => fa-fa_Latn/BGN
[341] => he-he_Latn/BGN
[342] => hy-am
[343] => hy-ar
[344] => hy-fa
[345] => hy-hy_FONIPA
[346] => hy-hy_Latn/BGN
[347] => hy_AREVMDA-am
[348] => hy_AREVMDA-ar
[349] => hy_AREVMDA-fa
[350] => hy_AREVMDA-hy_AREVMDA_FONIPA
[351] => ia-am
[352] => ia-ar
[353] => ia-fa
[354] => ia-ia_FONIPA
[355] => it-am
[356] => it-ja
[357] => ja_Hrkt-ja_Latn/BGN
[358] => ja_Latn-ko
[359] => ja_Latn-ru
[360] => ka-ka_Latn/BGN
[361] => kk-am
[362] => kk-ar
[363] => kk-fa
[364] => kk-kk_FONIPA
[365] => kk-kk_Latn/BGN
[366] => ko-ko_Latn/BGN
[367] => ky-am
[368] => ky-ar
[369] => ky-fa
[370] => ky-ky_FONIPA
[371] => ky-ky_Latn/BGN
[372] => la-la_FONIPA
[373] => lt-Lower
[374] => lt-Title
[375] => lt-Upper
[376] => mk-mk_Latn/BGN
[377] => mn-mn_Latn/BGN
[378] => mn-mn_Latn/MNS
[379] => my-am
[380] => my-ar
[381] => my-fa
[382] => my-my_FONIPA
[383] => nl-Title
[384] => pl-am
[385] => pl-ar
[386] => pl-fa
[387] => pl-ja
[388] => pl-pl_FONIPA
[389] => pl_FONIPA-ja
[390] => ps-ps_Latn/BGN
[391] => rm_SURSILV-am
[392] => rm_SURSILV-ar
[393] => rm_SURSILV-fa
[394] => rm_SURSILV-rm_FONIPA_SURSILV
[395] => ro-am
[396] => ro-ar
[397] => ro-fa
[398] => ro-ja
[399] => ro-ro_FONIPA
[400] => ro_FONIPA-ja
[401] => ru-ja
[402] => ru-ru_Latn/BGN
[403] => ru-zh
[404] => ru_Latn-ru/BGN
[405] => sat-am
[406] => sat-ar
[407] => sat-fa
[408] => sat_Olck-sat_FONIPA
[409] => si-am
[410] => si-ar
[411] => si-fa
[412] => si-si_FONIPA
[413] => si-si_Latn
[414] => sk-am
[415] => sk-ar
[416] => sk-fa
[417] => sk-ja
[418] => sk-sk_FONIPA
[419] => sk_FONIPA-ja
[420] => sr-sr_Latn/BGN
[421] => tk_Cyrl-tk/BGN
[422] => tlh-am
[423] => tlh-ar
[424] => tlh-fa
[425] => tlh-tlh_FONIPA
[426] => tr-Lower
[427] => tr-Title
[428] => tr-Upper
[429] => uk-uk_Latn/BGN
[430] => und_FONIPA-ar
[431] => und_FONIPA-fa
[432] => und_FONIPA-und_FONXSAMP
[433] => und_FONXSAMP-und_FONIPA
[434] => uz_Cyrl-uz/BGN
[435] => uz_Cyrl-uz_Latn
[436] => uz_Latn-uz_Cyrl
[437] => xh-am
[438] => xh-ar
[439] => xh-fa
[440] => xh-xh_FONIPA
[441] => yo-yo_BJ
[442] => zh_Latn_PINYIN-ru
[443] => zu-am
[444] => zu-ar
[445] => zu-fa
[446] => zu-zu_FONIPA
[447] => Any-Null
[448] => Any-Lower
[449] => Any-Upper
[450] => Any-Title
[451] => Any-Name
[452] => Name-Any
[453] => Any-Remove
[454] => Any-Hex/Unicode
[455] => Any-Hex/Java
[456] => Any-Hex/C
[457] => Any-Hex/XML
[458] => Any-Hex/XML10
[459] => Any-Hex/Perl
[460] => Any-Hex
[461] => Hex-Any/Unicode
[462] => Hex-Any/Java
[463] => Hex-Any/C
[464] => Hex-Any/XML
[465] => Hex-Any/XML10
[466] => Hex-Any/Perl
[467] => Hex-Any
[468] => Any-NFC
[469] => Any-NFKC
[470] => Any-NFD
[471] => Any-NFKD
[472] => Any-FCD
[473] => Any-FCC
[474] => Any-am
[475] => Any-ar
[476] => Any-rm_FONIPA_SURSILV
[477] => Any-fa
[478] => Any-Latn
[479] => Any-dv_Latn/BGN
[480] => Any-ro_FONIPA
[481] => Any-dsb_FONIPA
[482] => Any-ru_Latn/BGN
[483] => Any-zh
[484] => Any-Latin
[485] => Any-el_Latn/BGN
[486] => Any-eo_FONIPA
[487] => Any-si_FONIPA
[488] => Any-si_Latn
[489] => Any-es_FONIPA
[490] => Any-sk_FONIPA
[491] => Any-und_FONIPA
[492] => Any-und_FONXSAMP
[493] => Any-az/BGN
[494] => Any-Gujr
[495] => Any-Knda
[496] => Any-Telu
[497] => Any-Taml
[498] => Any-Guru
[499] => Any-Deva
[500] => Any-Beng
[501] => Any-Orya
[502] => Any-Syriac
[503] => Any-Greek
[504] => Any-Greek/UNGEGN
[505] => Any-Gurmukhi
[506] => Any-Cyrillic
[507] => Any-Hangul
[508] => Any-Telugu
[509] => Any-Bopomofo
[510] => Any-Bengali
[511] => Any-Katakana
[512] => Any-Arabic
[513] => Any-Thai
[514] => Any-Gujarati
[515] => Any-Malayalam
[516] => Any-Hiragana
[517] => Any-Armenian
[518] => Any-Thaana
[519] => Any-Georgian
[520] => Any-Oriya
[521] => Any-Devanagari
[522] => Any-Hebrew
[523] => Any-Kannada
[524] => Any-Tamil
[525] => Any-fa_Latn/BGN
[526] => Any-Mlym
[527] => Any-Hant
[528] => Any-Hans
[529] => Any-uz_Cyrl
[530] => Any-uk_Latn/BGN
[531] => Any-he_Latn/BGN
[532] => Any-hy_AREVMDA_FONIPA
[533] => Any-hy_FONIPA
[534] => Any-hy_Latn/BGN
[535] => Any-ia_FONIPA
[536] => Any-uz/BGN
[537] => Any-uz_Latn
[538] => Any-xh_FONIPA
[539] => Any-ka_Latn/BGN
[540] => Any-kk_Latn/BGN
[541] => Any-kk_FONIPA
[542] => Any-yo_BJ
[543] => Any-ky_Latn/BGN
[544] => Any-ky_FONIPA
[545] => Any-la_FONIPA
[546] => Any-zu_FONIPA
[547] => Any-ru
[548] => Any-Geor
[549] => Any-Cyrl
[550] => Any-Hebr
[551] => Any-Thaa
[552] => Any-Grek
[553] => Any-Grek/UNGEGN
[554] => Any-Hang
[555] => Any-Syrc
[556] => Any-Armn
[557] => Any-Hira
[558] => Any-Kana
[559] => Any-Bopo
[560] => Any-Arab
[561] => Any-mn_Latn/BGN
[562] => Any-mn_Latn/MNS
[563] => Any-my_FONIPA
[564] => Any-sr_Latn/BGN
[565] => Any-sat_FONIPA
[566] => Any-am_Latn/BGN
[567] => Any-am_FONIPA
[568] => Any-ar_Latn/BGN
[569] => Any-mk_Latn/BGN
[570] => Any-be_Latn/BGN
[571] => Any-bg_Latn/BGN
[572] => Any-es_419_FONIPA
[573] => Any-pl_FONIPA
[574] => Any-ps_Latn/BGN
[575] => Any-tk/BGN
[576] => Any-ch_FONIPA
[577] => Any-cs_FONIPA
avatar 7at1blow
7at1blow - comment - 2 Aug 2021

Probably it's important to mention:
It's a multi-language site (it has got the "Multilingual Status"). In the frontend I can switch between English and German.

avatar richard67
richard67 - comment - 2 Aug 2021

@7at1blow I've did the same thing here and in my result I have more transliterators in the array as you have.
One of these is "de-ASCII" which is missing in your result.

@Fedik Does this help us somehow?

avatar 7at1blow
7at1blow - comment - 2 Aug 2021

@brianteeman
I have two content languages: English and German, see screenshot.
I'm saving the german articles as "german language" and the english ones as "english language".
2021-08-02 Content Languages

avatar Fedik
Fedik - comment - 2 Aug 2021

hm, de-ASCII is missing that the reason. Not sure what we can do here.

Where do you run your site, local or hosting, windows or unix?
Can you please attach the joomla system information:
/administrator/index.php?option=com_admin&view=sysinfo click "download as text"

avatar Fedik
Fedik - comment - 2 Aug 2021

@richard67 please remove RTC for now

avatar richard67 richard67 - change - 2 Aug 2021
Status Ready to Commit Pending
avatar richard67
richard67 - comment - 2 Aug 2021

Back to pending


This comment was created with the J!Tracker Application at issues.joomla.org/tracker/joomla-cms/35029.

avatar 7at1blow
7at1blow - comment - 2 Aug 2021

@Fedik
It's hosting (but not public) and Apache.
I don't know why, but I can't add the txt-file here ...

avatar 7at1blow
7at1blow - comment - 2 Aug 2021

2021-08-02 message add the txt file

avatar 7at1blow
7at1blow - comment - 2 Aug 2021

I've done a screenshot of the systeminfo. But I think it won't be enough information (the txt file has got a lot more).
2021-08-02 systeminfo

avatar Fedik
Fedik - comment - 2 Aug 2021

I've done a screenshot of the systeminfo.

There INTL section (not big), please make screenshot of it

avatar 7at1blow
7at1blow - comment - 2 Aug 2021

So, if there is a special content of the systeminfo.txt important tell me. Then I will search for it in the txt file and will write it down here.

avatar 7at1blow
7at1blow - comment - 2 Aug 2021

@Fedik
This is what I could find about INTL in the systeminfo.txt:

  • intl: true max_input_vars: 4000
  • Internationalization support: enabled ICU version: 57.1 ICU Data version: 57.1 ICU Unicode version: 8.0
  • intl.default_locale
  • Local Value: no value Master Value: no value
  • intl.error_level
  • Local Value: 0 Master Value: 0
  • intl.use_exceptions
  • Local Value: Off Master Value: Off

I hope this is what you meant.

avatar Fedik
Fedik - comment - 2 Aug 2021

yes, that it, thank you

avatar Fedik
Fedik - comment - 3 Aug 2021

okay so, transliterators comes from ICU installed in OS https://github.com/unicode-org/icu/tree/main/icu4c/source/data/translit
not from PHP.

@7at1blow you have very outdated version "ICU Data version: 57.1" that does not have de-ASCII. Mine is 66, and latest is 69.

I think we have to run our Transliterate::utf8_latin_to_ascii on front of iconv(). I will update PR later.

avatar Fedik
Fedik - comment - 3 Aug 2021

I have updated PR, please test again.

9070496 3 Aug 2021 avatar Fedik typo
avatar 7at1blow
7at1blow - comment - 3 Aug 2021

@Fedik
Morning. And thank you for your message and new work.

1.) I have updated PR, please test again.
Just to be sure I understood you correctly: The new code for the Language.php is found at the same link you mentioned here yesterday? Means: https://raw.githubusercontent.com/joomla/joomla-cms/283958a7dc4fd063e20a13d51e807555fe95e035/libraries/src/Language/Language.php . I'm asking, because I couldn't find any difference there in comparison to the code of yesterday.

2.a) transliterators comes from ICU installed in OS
Do I understand you correctly: It has (also) to do with an old file de_ASCII.txt in my W8.1? I've searched for this file in my W8.1 but couldn't find a file like that. And I've also searched for information about how to update the ICU Data version, but couldn't find anything helpful.

2.b) Then I've got the idea to open my J4.0.0-rc5 site (with the Language.php from yesterday) using a browser in another OS (very fresh installed Linux Mint via VMPlayer in my W8.1). There I've got the same result: ä ö ü became still a o u. So, I assume that it couldn't have something to do with the OS of the PC on which I use the browser to open my J4.0.0-rc5 site. But maybe I totally misunderstood you in this case and you've meant something else with "OS".

avatar Fedik
Fedik - comment - 3 Aug 2021

The new code for the Language.php is found at the same link you mentioned here yesterday?

File will be new https://raw.githubusercontent.com/joomla/joomla-cms/907049657f36755de28cdfdef465aed5b3d78fa9/libraries/src/Language/Language.php

Do I understand you correctly: It has (also) to do with an old file de_ASCII.txt in my W8.1?

Nope, not your OS, but server OS, where your site is located.
This can be updated only by server support team (if they not lazy).
But it doesn't matter anymore, latest changes should be good even if ICU is old.

avatar 7at1blow
7at1blow - comment - 3 Aug 2021

Yepp!!! That works brilliant! Thank you, Fedik, and you all very much for your understanding and persevering help!

avatar richard67
richard67 - comment - 3 Aug 2021

@7at1blow Could you mark your test result in the issue tracker so it's counted? Just go to https://issues.joomla.org/tracker/joomla-cms/35029 , then use the "Test this" button at the top left corner, then chose the right test result and submit. Thanks in advance.

avatar 7at1blow
7at1blow - comment - 3 Aug 2021

I am very happy to do that! And thank you, Richard, for your precise explanation. (I would not have known it yet, what to do to support this).

avatar 7at1blow 7at1blow - test_item - 3 Aug 2021 - Tested successfully
avatar 7at1blow
7at1blow - comment - 3 Aug 2021

I have tested this item successfully on 9070496

Thanks a lot for the help and this improvement in result!


This comment was created with the J!Tracker Application at issues.joomla.org/tracker/joomla-cms/35029.

avatar Kostelano Kostelano - test_item - 3 Aug 2021 - Tested successfully
avatar Kostelano
Kostelano - comment - 3 Aug 2021

I have tested this item successfully on 9070496


This comment was created with the J!Tracker Application at issues.joomla.org/tracker/joomla-cms/35029.

avatar richard67 richard67 - test_item - 3 Aug 2021 - Tested successfully
avatar richard67
richard67 - comment - 3 Aug 2021

I have tested this item successfully on 9070496

Tested with German.


This comment was created with the J!Tracker Application at issues.joomla.org/tracker/joomla-cms/35029.

avatar richard67 richard67 - change - 3 Aug 2021
Status Pending Ready to Commit
avatar richard67
richard67 - comment - 3 Aug 2021

RTC


This comment was created with the J!Tracker Application at issues.joomla.org/tracker/joomla-cms/35029.

avatar wilsonge wilsonge - change - 4 Aug 2021
Status Ready to Commit Fixed in Code Base
Closed_Date 0000-00-00 00:00:00 2021-08-04 21:48:36
Closed_By wilsonge
Labels Added: ?
avatar wilsonge wilsonge - close - 4 Aug 2021
avatar wilsonge wilsonge - merge - 4 Aug 2021
avatar wilsonge
wilsonge - comment - 4 Aug 2021

Thanks!

Add a Comment

Login with GitHub to post a comment