1 # Regular expressions for tests that are known to fail
3 # Patterns will be automatically enclosed with '^' and '$'.
4 # Matching tests get the label "inverted"
5 # or (if also matching a pattern in "suspendedTests") "suspended".
6 # They get also the test-property 'WILL_FAIL', i.e.
7 # they are reported as failing if the export works without error.
8 # https://cmake.org/cmake/help/v3.0/prop_test/WILL_FAIL.html
10 # ======================================================================
12 # LyX bugs and problems with the sample documents that require attention
13 # ======================================================================
14 # * minor issues to explore and properly sort,
16 # * LyX bugs to report at trac (move pattern to section "lyxbugs" once done).
18 # Error in Japanese document if LyX-logo is preceded by foreign language
19 export/export/latex/ja_wrong_auto_encoding_(dvi|pdf(|3)).*
21 # Missing characters with Unicode fonts
22 # (the "hidden" replacement with FreeSerif does not help and results in bad
23 # typography for mathematical content):
24 # For details see the file "systemfonts-Math-missingchars.lyx"
25 export/doc/(|de/|es/|fr/)Math.*systemF
26 export/export/latex/systemfonts-Math-missingchars.*systemF
28 # missing character: There is no ^^A in font [lmroman12-regular]
29 # and all the line down to ^^Z and beyond...
30 # XeTeX artifact? works with LuaTeX, explore:
31 export/doc/(|de/|es/|fr/)EmbeddedObjects_pdf4_systemF
33 # Changes in TeX Live 2014 (see git blame for info) fixed
34 # IEEEtran-CompSoc_pdf4_systemF but not others.
35 # TODO Investigate if others can be fixed?
36 # * IEEEtran-Journal_pdf4_systemF compiles here (GM)
37 # * All IEEEtran-TransMag.* exports fail here:
38 # missing commands \IEEEtitleabstractindextext, \IEEEdisplaynontitleabstractindextext
39 # -> adapt template and style (GM)
40 export/templates/IEEEtran-(Journal|TransMag)_pdf4_systemF
42 # Example for lib/scripts/listerrors
43 # Requires noweb. Seems to be restricted to plain "latex".
44 # Find out why and whether the script could be improved.
45 export/examples/listerrors_(pdf[245]).*
47 # iconv fails, if a nomenclature inset contains an uncodable character
48 export/export/latex/iconv-error-nomenclature_pdf2
50 # `acmart` document class:
51 # (see also lyxbugs below and ignoredTests)
52 # issues with listsof, reported to the maintainer
53 # https://www.mail-archive.com/search?l=mid&q=of84gj%24l6b%241%40blaine.gmane.org
54 # LyX gives the following terminal message:
56 # TextClass.cpp (1385): The layout does not provide a list command for
57 # the float `sidebar'. LyX will not be able to produce a float list.
59 # which makes "check_load" and "lyx2lyx" fail (lyx2lyx for < 2.3 is ignored).
60 check_load/templates/acmart
61 export/templates/acmart_lyx23
63 # Failing LyX2LyX conversions for old versions:
65 # "beamer" lyx2lyx fails sometimes for versions < 2.1
66 # Back-conversion results in some layouts without name ("\begin_layout \n")
67 # which trigger a warning message leading to test failure.
68 export/examples/(|de/|fr/|ja/)beamer_lyx(16|20)
69 export/templates/.*beamer-conference-ornate-20min_lyx(16|20)
70 export/examples/beamerlyxexample1_lyx(16|20)
72 # modernCV fails for versions < 2.1
73 # * reversed order of \end_layout and \end_inset results in corrupt LyX file
74 # * reversed order of command arguments results in incompilable LaTeX
75 export/examples/(|es/)modernCV_lyx(16|20)
77 # Farsi font encoding LAE should be added also to custom font encoding
78 # (similar to the Greek font encoding LGR).
79 export/export/latex/fa-OT1_pdf2
81 # No "system font" (fontspec) setup for multiple scripts (CJK+Latin+Greek)
82 # -> Missing character (Greek letter omikron with tonos),
83 # suboptimal character spacing in non-Japanese text parts.
84 export/examples/ja/multilingual_.*_systemF
86 # CJK for multilingual documents:
88 # input-encoding "utf8" should work for documents using a CJK language:
89 export/export/latex/CJK/.*-en-de-el-ru_utf8_pdf2
91 # but not so easy if the main language does not require CJK:
92 export/export/latex/CJK/en-de-el-ru-.*_utf8_pdf2
94 # "language default" legacy encodings fail (missing fonts)
95 export/export/latex/CJK/ko_default_pdf2
96 export/export/latex/CJK/zh_CN_default_pdf2
99 # input encoding tests
100 # --------------------
101 # Please test and correct!
103 # Failing for unknown reason
105 export/export/latex/unicodesymbols/001-4-latin_cp1255_pdf2
106 export/export/latex/unicodesymbols/001-4-latin_cp862_pdf2
107 export/export/latex/unicodesymbols/008-greek-and-coptic-with-textalpha_cp862_pdf2
108 export/export/latex/unicodesymbols/008-greek-and-coptic_cp862_pdf2
109 export/export/latex/unicodesymbols/070-72-general-punctuation-sub-super-currency_cp1255_pdf2
110 export/export/latex/unicodesymbols/070-72-general-punctuation-sub-super-currency_cp862_pdf2
111 export/export/latex/unicodesymbols/070-72-general-punctuation-sub-super-currency_iso8859-8_pdf2
112 export/export/latex/unicodesymbols/074-76-letterlike-numberforms-arrows_cp862_pdf2
114 export/export/latex/unicodesymbols/001-4-latin_cp1256_pdf2
115 export/export/latex/unicodesymbols/001-4-latin_iso8859-6_pdf2
116 export/export/latex/unicodesymbols/005-7-ipa-modifiers-combining_cp1256_pdf2
117 export/export/latex/unicodesymbols/008-greek-and-coptic-with-textalpha_cp1256_pdf2
118 export/export/latex/unicodesymbols/008-greek-and-coptic_cp1256_pdf2
119 export/export/latex/unicodesymbols/069-greek-extended-textalpha_cp1256_pdf2
120 export/export/latex/unicodesymbols/069-greek-extended_cp1256_pdf2
121 export/export/latex/unicodesymbols/070-72-general-punctuation-sub-super-currency_cp1256_pdf2
122 export/export/latex/unicodesymbols/074-76-letterlike-numberforms-arrows_cp1256_pdf2
125 # with 8-bit encodings: missing "\usepackage[<encoding(s)>]{inputenc}"
126 # leads to # ! Undefined control sequence.
129 # if there is a non-CJK language in the document.
130 export/export/latex/unicodesymbols/.*_euc-cn_pdf2
131 export/export/latex/unicodesymbols/.*_gbk_pdf2
132 export/export/latex/unicodesymbols/.*_jis_pdf2
133 export/export/latex/unicodesymbols/.*_euc-kr_pdf2
134 export/export/latex/unicodesymbols/.*_euc-tw_pdf2
135 export/export/latex/unicodesymbols/.*_euc-jp_pdf2
138 export/export/latex/unicodesymbols/.*_euc-jp-platex_pdf2
139 export/export/latex/unicodesymbols/.*_jis-platex_pdf2
140 export/export/latex/unicodesymbols/.*_shift-jis-platex_pdf2
141 export/export/latex/unicodesymbols/.*_utf8-platex_pdf2
144 # If we want to try to get it to work with pdfTeX:
145 # - set all non-Arab text parts to a different language (e.g. English)
146 # - define alternatives for hyperref (e.g. with textorpdfstring)
147 # for correct handling of hyperref.
148 # see discussion here:
149 # https://www.mail-archive.com/search?l=mid&q=20161114035123.s5lt4ib4x4obtptp%40steph
150 export/doc/ar/(Intro|Shortcuts|Tutorial|UserGuide)_pdf4_texF
151 # This simple example doc is meant to test Arabic export of pdf2
152 export/export/latex/arabic_simple_(dvi3|pdf5)_(texF|systemF)
153 export/export/latex/arabic_simple_pdf4_texF
154 # See note about "Missing ␣" in file "ignoreLatexErrorsTests".
155 export/doc/ar/UserGuide_lyx(22|23)
157 # Polyglossia + LuaTeX does not support Farsi yet. See:
158 # https://github.com/reutenauer/polyglossia/commit/ccb0e9e2c6411170ad779b05ff5076f1193cc323
159 # Why does farsi fail with Babel?
160 export/examples/fa/splash_(dvi|pdf).*
162 # nonstandard tests failing for unknown reason:
163 export/examples/aa_sample_(dvi3|pdf[45])_.*
164 export/templates/obsolete/ACM-siggraph_pdf5_(texF|systemF)
165 export/templates/IUCr-article_pdf4_systemF
166 export/templates/RJournal_(dvi3|pdf[45])_systemF
167 export/templates/aa_(dvi3|pdf[45])_.*
168 export/templates/kluwer_.*_systemF
171 # back-conversion fails for rotated float inset in a list
172 export/export/lyx2lyx/lyx_2_3_test_lyx(16|20|21|22)
175 # ================================================
177 # LyX bugs with a Trac number.
178 # ================================================
180 #6463 font encoding changes and combining accents
181 # problem remains for Cyrillic in a non-Cyrillic-using language
182 export/export/latex/cyrillic-accent-ascii_pdf2
184 #9871 LyX sends invalid Unicode to iconv when converting to ASCII
185 # most probably due to BabelPreamble code (language specific headings for
186 # theorems, problems , ... are written in the language's default encoding
187 # if they contain non-ASCII characters)
188 # Error 84 returned from iconv when converting from UCS-4LE to ascii:
189 # Invalid or incomplete multibyte or wide character
190 export/doc/(es|fr)/Additional_pdf4_texF
191 export/doc/(de|es|fr)/EmbeddedObjects_pdf4_texF
192 export/doc/es/Customization_pdf4_texF
193 # see also the discussion at:
194 # https://www.mail-archive.com/search?l=mid&q=20170228190738.cgs3tl3ny2bxiegk%40steph
195 export/examples/es/linguistics_pdf4_texF
196 export/export/latex/bug9871-slovak-ascii-preambleencoding_pdf2
198 #10355 xmllint detects failures
199 export/doc/attic/eu_UserGuide_xhtml
200 export/doc/(es|ja)/UserGuide_xhtml
201 export/examples/spreadsheet_xhtml
202 export/export/WrongDfnTagHandling_xhtml
204 #10371 Compilation error if longest label marker in labeling style
205 # contains underscores etc.
206 export/export/latex/LongestLabelWithUnderscore.*
208 #11454 luainputenc must be loaded after textcomp
209 export/export/latex/luainputenc-utf8_pdf5_texF
210 # (The version with Unicode fonts fails because some symbols are missing
211 # in LatinModern as well as DejaVu. This shows that there are use cases
212 # for traditional 8-bit fonts.)
213 export/export/latex/luainputenc-utf8_pdf5_systemF
215 #11455 "Unable to process argument!" with multiple 1.6.x roundtrips
216 export/templates/IEEEtran-Journal_lyx16
219 # ==============================================================
221 # Export failures due to "raw" LaTeX use in ERT or preamble code
222 # ==============================================================
224 # "Wontfix" if demonstrating correct use and OK in the default output format.
226 # Non-ASCII in ERT, fails with inputenc==ASCII (e.g. XeTeX with tex-fonts)
227 # Could not find LaTeX command for character 'í' (code point 0xed)
228 export/doc/(de|es)/Additional_pdf4_texF
231 # ================================================
233 # Export fails due to LaTeX limitations,
234 # ================================================
236 # e.g. non-ASCII in verbatim or listings, incompatible packages, ...
237 # "Wontfix" if documents demonstrate correct use in the default output format.
239 # Non-ASCII char in verbatim environment.
240 # Fails with ASCII (and hence also with XeTeX).
241 export/doc/(|de/|es/|fr/)UserGuide_pdf4_texF
243 # Hebrew docs do not currently work with LuaTeX (will be fixed in TeXLive-16)
244 # TODO: set working system fonts in the lyx sources
245 export/.*/he/.*(dvi3|pdf5).*
247 # ... nor with XeTeX and 8-bit TeX fonts (due to missing ASCII replacements)
248 export/.*/he/.*pdf4_texF
250 # Babel-Russian uses UTF-8 for auto-strings if it detects Xe/LuaTeX.
251 # This fails unless the inputencoding is set to utf-8, too.
252 export/doc/ru/(Intro|Tutorial)_(dvi3|pdf[45])_texF
253 export/examples/ru/(example_lyxified|splash)_(dvi3|pdf[45])_texF
255 # Babel-Spanish uses UTF-8 for auto-strings if it detects Xe/LuaTeX.
256 # This leads to wrong output (see unreliableTests) and fails in some cases
257 # unless the inputencoding is set to utf-8, too.
258 # ! Undefined control sequence.
259 # <argument> ...art {link}{\Hy@tocdestname }{\nonumberline Ã
\8d
260 # ndice alfabético}\hyper...
261 export/doc/es/(UserGuide|Math|EmbeddedObjects)_(dvi3|pdf5)_texF
263 # Gives the following error:
264 # # ! Package hpstatement Error: H or P statement "H251"
265 # # (hpstatement) is not defined.
266 # seems to be polyglossia-related (dvi3 worked with babel)
267 export/examples/H-P-statements_.*_systemF
269 # These files use packages that are not compatible with the newest LuaTeX. We
270 # could potentially fix these by loading the luatex85 package early in the
271 # LyX-generated preamble, but it seems it's better to wait until the packages
272 # fix the root issue themselves.
274 .*(|fr/)xy(pic|figure).*pdf5.*
276 # Problem with Check and Slovak Babel support.
277 # (reported per mail to Petr Tesa\v{r}\'ik, 2016-09-06)
278 # All exports using babel fail.
279 # Without the Czech or Slovak text it compiles
280 # No problem with inserted German (or other foreign language) text
281 # No problem if the table is Slovak, too
282 export/export/latex/TableErrorIfSlovakTextInserted_(dvi|pdf[23]?|.*_texF)
284 # Polyglossia + LuaTeX issue
285 # Reported upstream here:
286 # https://github.com/reutenauer/polyglossia/issues/163
287 # These tests were broken at 3374b854
288 # See discussion here:
289 # https://www.mail-archive.com/search?l=mid&q=1478004223.2367.5.camel%40lyx.org
290 export/doc/(sk|nb)/Intro_(dvi3|pdf5)_systemF
292 # fontspec errors with `slides` class:
293 # LaTeX error: "kernel/command-already-defined"
294 # Lines 2684 ... 2690 in fontspec-xetex.sty
295 # Lines 2608 ... 2614 in fontspec-luatex.sty
296 export/templates/slides_.*_systemF
298 # Beamer: conflicts with some combinations of packages/settings/languages
299 export/templates/ja_beamer-conference-ornate-20min_(pdf2|pdf[45]).*
300 export/templates/es_beamer-conference-ornate-20min_pdf4_texF
302 # Arabic only works with XeTeX + system fonts (pdf4_systemF)
303 export/examples/ar/splash_(dvi.*|pdf|pdf[^4].*)
304 export/examples/ar/splash_pdf4_texF
306 # CJKutf8 does not work with XeTeX and LuaTeX (and 8-bit fonts)
307 export/examples/ja/multilingual_.*_texF
310 # ================================================
311 Sublabel: externalissues
312 # Export fails due to non-LaTeX external tool,
313 # ================================================
315 # e.g. a bug or missing feature in ps2pdf
317 # ps2pdf gives the following and exits with error:
318 # Error: /invalidfileaccess in --file--
319 # ps2pdf succeeds if the -dNOSAFER flag is used. For discussion, see:
320 # https://www.mail-archive.com/search?l=mid&q=1506851183.3130.15.camel%40lyx.org
321 export/examples/ja/lilypond_pdf
324 # ======================================================================
326 # Documents in the attic, kept for reference and format conversion test.
327 # However, many problems here are "wontfix".
328 # ======================================================================
330 # Fails because of missing .png graphic files.
331 # They were replaced by .svgz, but, as this file is in the attic, we do not
332 # convert to new lyx format. Plain latex and xetex create output (ignoring
333 # missing files) while (pdf|lua)latex exits with != 0
334 #export/doc/attic/eu_UserGuide_pdf[25].*
336 # Files in the attic with non-default output
337 # (i.e. could be ERT, package incompatiblity, ...)
338 export/doc/attic/it_(UserGuide_dvi3|UserGuide_pdf4)_systemF
339 export/doc/attic/sk_UserGuide_pdf4_texF
340 export/doc/attic/id_UserGuide_.*systemF