X-Git-Url: https://git.lyx.org/gitweb/?a=blobdiff_plain;ds=sidebyside;f=development%2Fautotests%2FunreliableTests;h=ba48d8e146ea72a620ab142df4d08b6950489db4;hb=b1b8071168c75ce577d4f16418d5aa1741f7d1bb;hp=ef68ca913b73cb6067e9575be321eca3ba8cbc8e;hpb=95ba824283d5b8058622a363be821ae73d9f055f;p=lyx.git diff --git a/development/autotests/unreliableTests b/development/autotests/unreliableTests index ef68ca913b..ba48d8e146 100644 --- a/development/autotests/unreliableTests +++ b/development/autotests/unreliableTests @@ -10,100 +10,210 @@ Sublabel: nonstandard -# =================== +##################### # Documents with additional requirements, # e.g. a class or package file not in TeXLive. -# TODO: rename to "extra"? +# TODO: rename to "extra" or "exotic"? -export/templates/IUCr-article_(dvi|pdf).* -# does not work with pdflatex, lualatex (PDF) or XeTeX (postscript specials?). -export/templates/(ja|es)_beamer-conference-ornate-20min_(pdf2|pdf[45]).* -export/templates/kluwer_.*_systemF -export/templates/ectaart_(dvi3|pdf5).* +# aa.cls (not in TeXLive). +export/examples/Articles/Astronomy_%26_Astrophysics.* +export/templates/Articles/Astronomy_%26_Astrophysics.* -# 1.) missing farsi package with lfeenc.def -# 2.) LuaTeX does not support Farsi yet. See: -# https://github.com/reutenauer/polyglossia/commit/ccb0e9e2c6411170ad779b05ff5076f1193cc323 -export/examples/fa/splash_(dvi|pdf|pdf[23]|(dvi3|pdf4|pdf5)_(texF|systemF)) +# AEA.cls (see https://wiki.lyx.org/Examples/AEA) +export/templates/Articles/American_Economic_Association_(AEA).* -# requires knitr, requires rjournal.sty (not in TeXLive) +# copernicus.cls (not in TeXLive) +# see https://publications.copernicus.org/for_authors/manuscript_preparation.html +export/templates/Articles/Copernicus_Publications_Manuscript_Preparation_.* + +# ectaart.cls +# see https://wiki.lyx.org/Examples/Econometrica +export/templates/Articles/Econometrica.* + +# iucr.cls (not in TeXLive) +export/templates/Articles/International_Union_of_Crystallography.* + +# ws-ijmpc.cls, w-ijmpd.cls +# see https://wiki.lyx.org/Examples/IJMP +export/templates/Articles/Int._Journal_of_Modern_Physics_C.* +export/templates/Articles/Int._Journal_of_Modern_Physics_D.* + +# iopart.cls, iopams.sty, setstack.sty +# see https://wiki.lyx.org/Layouts/Iopart +export/templates/Articles/Institute_of_Physics_.* + +# jasatex.cls +# see https://wiki.lyx.org/Layouts/JASATeX +export/templates/Articles/Journal_of_the_Acoustical_Society_of_America.* + +# jss.cls +export/templates/Articles/Journal_of_Statistical_Software_.* + +# LilyPond-book version 2.13 or newer. +export/examples/Modules/LilyPond_Book.* + +# maa-monthly.sty (not in TeXLive) +# http://www.maa.org/sites/default/files/pdf/pubs/maa-monthly.sty +export/templates/Articles/Mathematical_Monthly.* + +# knitr, RJournal.sty (not in TeXLive) # incompatible with fontspec? -export/templates/RJournal_(dvi3|pdf[45])_systemF +export/templates/Articles/RJournal_.* + +# R (http://www.r-project.org) +# R package knitr (http://yihui.name/knitr) +export/examples/Modules/Sweave.* +export/examples/Modules/Rnw.*knitr.* + +# obsolete versions of documentclass or style files +export/templates/Obsolete/.* + +# svjour3.cls, svglov2.clo +# see https://wiki.lyx.org/Examples/Springer +export/templates/Articles/Springers_Global_Journal_Template.* + +# svmono.cls +templates/examples/Books/Springer_Monographs.* +# svmult.cls +templates/examples/Books/Springer_Contributed_Books.* + +# TeXLive does not set up Hebrew 8-bit TeX fonts +# (Workaround: the external package culmus-latex) +export/export/latex/unicodesymbols/012-31-hebrew_he-thai_pdf2 +export/.*/he/.*((dvi|pdf.?)|_texF) -# Requires aa.cls (not in TeXLive). -# Fails with XeTeX/LuaTeX -# Reported upstream (https://www.mail-archive.com/lyx-devel@lists.lyx.org/msg184435.html) -# Is there a new version fixing the problem? -export/examples/aa_sample_(dvi3|pdf[45])_.* -export/templates/aa_(dvi3|pdf[45])_.* -# Requires iucr.cls (not in TeXLive) -# Is there a new version fixing the problem? -# Does LuaTeX produce sensible results? -export/templates/IUCr-article_pdf4_systemF +Sublabel: needauth +################## +# Tests that require authorisation to call external programs. +export/examples/External_Material/Gnuplot.* +export/examples/Graphics_and_Insets/Minted_File_Listing.* +export/examples/Graphics_and_Insets/Minted_Listings.* -# Requires acmsiggraph.cls (not in TeXLive) -# see http://wiki.lyx.org/Examples/AcmSiggraph -export/templates/ACM-siggraph_(dvi|pdf).* Sublabel: erratic +################# # Tests depending on local configuration, or the phase of the moon. -# for unknonwn reasons, seminar fails at some places: -export/examples/(|fr/)seminar_.* - -# Export fails the first time but works the second time. (Why?) -export/doc/es/Customization_pdf4_texF +# Manual export fails the first time but works the second time. (Why?) +export/doc/es/(Customization|Intro)_pdf4_texF Sublabel: varying_versions -# ======================== -# Test depending on TeX distribution, package versions or OS +########################## +# Test depending on e.g. OS or version of a non-TeX-Live dependency. +# Note that a full, up-to-date TeX Live installation is required so this +# sublabel is about versions of other dependencies. + +# Encoding cp858 only supported by some iconv variants +# Gnu iconv only supports it, if configured with "--enable-extra-encodings" +# (see https://www.gnu.org/software/libiconv/) +export/export/latex/cp858_pdf2 + +# Seminar export with LaTeX fails in latest TeXLive: +export/examples/(|fr/)seminar_(dvi|pdf).* + +# since TL18, Babel-Ukrainean uses UTF-8 if it detects Xe/LuaTeX (for "\date"). +# * garbled output with LuaTeX + TeX fonts (since TL18) +# * missing chars with XeTeX + TeX fonts (see invertedTests) +export/export/latex/uk-babel-date-missing-chars-with-ascii_.*_texF +export/(doc|examples)/uk/(Intro|Welcome)_.*_texF + +# new problem with TL18 (see invertedTests) +export/export/latex/luainputenc-utf8_pdf5_texF + +# aastex: hard-coded version in class name: +# 2018-05-12 aastex6.cls -> aastex62.cls +export/examples/Articles/American_Astronomical_Society_.* +export/templates/Articles/American_Astronomical_Society_.* + +# `acmart` calls "libertine" as default font. +# With TeXLive < 18, this clashes with LyX setting up 8-bit TeX fonts +# PDF (luatex) and PDF (xetex) (compilation error or wrong fonts). +# See also #9744 allow parallel configuration of TeX and non-TeX fonts. +export/templates/Articles/Association_for_Computing_Machinery_pdf[45]_texF -# document class aastex.cls replaced by aastex6.cls (v.1 2016/02/16) -# in CTAN and TeXLive in march 2016 -# Template and sample use the new version via aastex6.layout (cf. #10027) -# -> fail if aastex6.cls is missing (TeXLive15 original) -export/templates/aastex_(dvi|pdf).* -export/examples/aas_sample_(dvi|pdf).* +# since TeXLive18, 8-bit LaTeX defaults to utf-8 Sublabel: wrong_output -# ==================== +###################### # Export does not fail but the resulting document has errors. # # These tests are actually not "unreliable" (different result for different # runs) but *invalid* (not measuring what they should measure). -# seminar.sty uses Postscript specials -# -> wrong output with pdflatex/LuaTeX and DVI (missing landscape slides). -export/examples/(|fr/)seminar_pdf[25].* -export/examples/(|fr/)seminar_dvi.* - -# Babel-Spanish uses Babel's "strings" feature to define -# separate auto-strings using UTF-8 literals. -# Babel uses the "unicode" strings if it detects XeTeX or LuaTeX. -# This is wrong for Xe/Lua with 8-bit TeX-fonts. -# set inputenc to utf8? +# seminar.sty uses Postscript specials or PGF resulting in problems with slide +# size and orientation depending on the output format and viewing application. +# For details see Troubleshooting and the Appendix in examples/seminar.lyx. +export/examples/(|fr/)Presentations/Seminar_(dvi|pdf).* + +# Babel-Spanish uses UTF-8 encoded strings if it detects Xe/LuaTeX. +# With "language default" (=="latin9"), Babel strings come out wrong +# when compiling with Xe/LuaTeX and TeX-fonts. +# - The problem is generic to all Spanish documents but only manifests itself +# if Babel strings with non-ASCII chars are actually used +# (the ToC heading, e.g., becomes "ÃŊndice" instead of "Índice"). +# - In some cases, export fails +# (see invertedTests, some more tests fail with TeXLive versions < 18). +# Should we set inputenc to utf8 in the documents to work around the problem? # (Changing the default in lib/languages requires more tests for utf8 first.) -export/examples/es/linguistics_pdf4_texF -export/doc/es/.*_(pdf[45]|dvi3)_texF +export/examples/es/.*_(pdf5|dvi3)_texF +export/doc/es/.*_(pdf5|dvi3)_texF + +# since TL18, Babel-Ukrainean uses UTF-8 if it detects Xe/LuaTeX (for "\date"). +# * garbled output with LuaTeX + TeX fonts (since TL18) +# (date and chapter headings) +# * missing chars with XeTeX + TeX fonts (see invertedTests) +export/export/latex/uk-babel-date-missing-chars-with-ascii_.*_texF +export/(doc|examples)/uk/(Intro|Welcome)_.*_texF + + +# LyX issues +# ********** + +#6197: „amssymb” with Polish babel: name clash \lll ("<<<" vs. "ł") +# Wrong output with pdflatex +# missing character with XeTeX/LuaTeX and Babel (-> invertedTests) +export/export/latex/6197-polish-amssymb_(dvi|pdf).? # Non-ASCII char in verbatim environment is dropped (with a warning when # doing this interactively) with ASCII (and hence also with XeTeX). export/doc/(|de/|es/|fr/)EmbeddedObjects_pdf4_texF -# inputencoding="utf8-plain" with 8-bit TeX: non-ASCII characters are passed -# as two 8-bit characters leading to garbage in the output -export/export/utf8-plain-with-tex-fonts_(dvi|pdf.?) - # The following document mixes inTitle layouts and leads to # likely unintended output. See #10347 -export/mixing_inTitle_layouts.lyx +export/export/mixing_inTitle_layouts_(pdf|dvi).* # Characters with accents are not output # Reported to LuaTeX mailing list here: # https://www.mail-archive.com/search?l=mid&q=20160831134006.4fewxothddqfeyw4%40steph # (not expecting much attention because DVI is not given high priority) export/doc/es/Customization_dvi3_systemF -export/examples/(|es/)(europe|modern)CV_dvi3_systemF +export/examples/(|es/)Curricula_Vitae/Europe_CV_dvi3_.*F + +# `acmart` requires PDFlatex: +# * Missing page number in DVI, Postscript, and PDF (ps2pdf) +# * "PDF (ps2pdf)" fails (problem with Postscript) in TeXLive < 2018 +# "Postscript" not tested by ctest autotests +export/templates/Articles/Association_for_Computing_Machinery_dvi.* +export/templates/Articles/Association_for_Computing_Machinery_pdf + +# lyx2lyx back-conversion of "Date" info-inset writes +# the name of the day in English instead of Japanese. +export/examples/ja/Multilingual_Typesetting_.*_lyx.* + +# No localization of auto-strings with Chinese language under 8-bit TeX +# (ctex font issue with texlive-lang-chinese (from Debian) under pdflatex) +# and only partial localization with non-tex-fonts: +export/export/latex/CJK/zh_CN-toc.* +export/doc/zh_CN/(Intro|Tutorial)_(dvi|pdf).? + +# Missing Chinese characters in the DVI (LuaTex) +export/doc/zh_CN/(Intro|Tutorial)_dvi3_systemF + +# CJK languages don't change/reset the "language" (which is problematic for +# documents in a language that uses a non-standard font encoding) +# In a Greek document, Latin letters in a text part set to "Chinese" +# come out as Greek letters: +export/export/latex/CJK/el-zh_CN_utf8-cjk.*