Wikimedia Meta-Wiki

Research:Multilingual Readability Research/supported wikis mbert

< Research:Multilingual Readability Research

The mBERT model supports 104 languages.

Matching the languages with the list of existing Wikipedias (using the table from the canonical data), we can identify which language versions of Wikipedia are supported by the model. Some caveats:

  • This requires some manual matching. For example, for fywiki mBERT denotes the language as "West Frisian" whereas the canonical table denotes it as "Western Frisian".
  • There is some ambiguity in terms of the support for Chinese language Wikipedias. mBERT states that it supports traditional and simplified Chinese. Currently, we only include zhwiki (Chinese Wikipedia). There are other language versions of Wikipedia which contain the word "Chinese": Min Nan Chinese (zh-min-nan), Wu Chinese (wuuwiki), Min Dong Chinese (cdowiki), Hakka Chinese (hakwiki), Gan Chinese (ganwiki), Classical Chinese (zh-classical). We need to revisit this to figure out if those Wikipedia languages are supported by the model.

List of Wikipedias

edit

see also here: https://gitlab.wikimedia.org/repos/research/readability/-/blob/main/compute_readability/mbert_scorer/mbert_wikis.txt

  1. afwiki
  2. anwiki
  3. arwiki
  4. astwiki
  5. azbwiki
  6. azwiki
  7. barwiki
  8. bawiki
  9. bewiki
  10. bgwiki
  11. bnwiki
  12. bpywiki
  13. brwiki
  14. bswiki
  15. cawiki
  16. cebwiki
  17. cewiki
  18. cswiki
  19. cvwiki
  20. cywiki
  21. dawiki
  22. dewiki
  23. elwiki
  24. enwiki
  25. eswiki
  26. etwiki
  27. euwiki
  28. fawiki
  29. fiwiki
  30. frwiki
  31. fywiki
  32. gawiki
  33. glwiki
  34. guwiki
  35. hewiki
  36. hiwiki
  37. hrwiki
  38. htwiki
  39. huwiki
  40. hywiki
  41. idwiki
  42. iowiki
  43. iswiki
  44. itwiki
  45. jawiki
  46. jvwiki
  47. kawiki
  48. kkwiki
  49. knwiki
  50. kowiki
  51. kywiki
  52. lawiki
  53. lbwiki
  54. lmowiki
  55. ltwiki
  56. lvwiki
  57. mgwiki
  58. minwiki
  59. mkwiki
  60. mlwiki
  61. mnwiki
  62. mrwiki
  63. mswiki
  64. mywiki
  65. nds_nlwiki
  66. newiki
  67. newwiki
  68. nlwiki
  69. nnwiki
  70. nowiki
  71. ocwiki
  72. pawiki
  73. plwiki
  74. pmswiki
  75. pnbwiki
  76. ptwiki
  77. rowiki
  78. ruwiki
  79. scnwiki
  80. scowiki
  81. shwiki
  82. skwiki
  83. slwiki
  84. sqwiki
  85. srwiki
  86. suwiki
  87. svwiki
  88. swwiki
  89. tawiki
  90. tewiki
  91. tgwiki
  92. thwiki
  93. tlwiki
  94. trwiki
  95. ttwiki
  96. ukwiki
  97. urwiki
  98. uzwiki
  99. viwiki
  100. vowiki
  101. warwiki
  102. yowiki
  103. zhwiki
  104. simplewiki
Retrieved from "https://meta.wikimedia.org/w/index.php?title=Research:Multilingual_Readability_Research/supported_wikis_mbert&oldid=25231408"