cmhughes / latexindent.pl

Perl script to add indentation (leading horizontal space) to LaTeX files. It can modify line breaks before, during and after code blocks; it can perform text wrapping and paragraph line break removal. It can also perform string-based and regex-based substitutions/replacements. The script is customisable through its YAML interface.
GNU General Public License v3.0
864 stars 84 forks source link

Unknown error "���" #528

Closed trarer closed 4 months ago

trarer commented 5 months ago

Please provide the following when posting an issue:

original .tex code

如彭奇和瓦特曼的公共事业所证实的那样有一个胡子雪雪白的上帝超越时间超越空间确确 实实存在他在神圣的冷漠神圣的疯狂神圣的喑哑的高处深深地爱着我们除了少数的例外不知什 么原因但时间将会揭示他像神圣的密兰达一样和人们一起忍受着痛苦这班人不知什么原因但时 间将会揭示生活在痛苦中生活在烈火中这烈火这火焰如果继续燃烧毫无疑问将使穹苍着火也就 是说将地狱炸上天去天是那么蓝那么澄澈那么平静这种平静尽管时断时续总比没有好得多但是 别这么快还要进一步考虑到泰斯丢和丘那德的人体测定学院的未完成的研究结果早已断定毫无 疑问换句话说除了依附着人类的疑问之外别无其他疑问根据泰斯丢和丘那德的未完成的劳动的 结果早已作出如下的论断但是别这么快不知什么原因根据彭奇和瓦特曼的公共事业的结果已毫 无疑问地断定鉴于波波夫和贝尔契不知什么原因未完成的劳动以及泰斯丢和丘那德的未完成的 劳动已经就业已被许多人所否认的论点作出论断认为泰斯丢和丘那德所假设的人认为实际存在 的人认为人类总而言之统而言之尽管有进步的营养学和通大便药却在衰弱萎缩衰弱萎缩而且与 此同时尤其是不知什么原因尽管体育运动在各方面都有很大进展如网球足球田径车赛游泳飞行 划船骑马滑翔溜冰各式各样的网球各种各样致人死命的飞行运动各式各样的秋天夏天冬天冬天 网球各种各样的曲棍球盘尼西林和代用品总之我接下去讲与此同时不知什么原因要萎缩要减少 尽管有网球我接下去讲飞行滑翔九穴和十八穴的高尔夫球各种各样的网球总之不知什么原因在 番克汉贝克汉福尔汉克莱普汉换句话说与此同时尤其是不知什么原因但时间将会揭示要减少减 少我接下去讲福尔汉克莱普汉总之自从塞缪尔·约翰逊去世以后到现在每个人的全部损失共计每 人一吋四唡只是大概约略粗粗计算到小数点分量很足保持整数赤裸裸的光穿着袜子在康纳马拉 总之不知什么原因不管怎样无论如何事实俱在尤其是考虑到更加远为严肃的看来更加严肃的鉴 于斯丹威格和彼特曼的徒劳看来更加严肃的鉴于鉴于鉴于斯丹威格和彼特曼徒劳在平原在山地 在海洋在烈火沸腾的河里天空是一样的随后是大地换句话说天空随后是大地在一片寒冷一片漆 黑中天空大地石头的住所在一片寒冷中哎哟哟在我们的主诞生六百年左右天空大地海洋大地石 头的住所汪洋中一片寒冷中在海上在陆地在空中我接下去讲不知什么原因尽管有网球事实俱在 但时间将会揭示我接下去讲哎哟哟总之一句话石头的住所谁能怀疑我接下去讲但是别这么快我 接下去讲头颅要萎缩衰弱减少与此同时尤其是不知什么原因尽管有网球胡子火焰球队石头那么 蓝那么平静哎哟哟头颅头颅头颅头颅在康纳马拉尽管有网球未完成的徒然的劳动更加严肃的石 头的住所总之我接下去讲哎哟哟徒劳的未完成的头颅头颅在康纳马拉尽管有网球头颅哎哟石头.

yaml settings

Please paste your YAML settings (if any) here

actual/given output

如彭奇和瓦特曼的公共事业所证实的那样有一个胡子雪雪白的上帝超越时间超越空间确确 实实存在他在神圣的冷漠神圣的疯狂神圣的喑哑的高处深深地爱着我们除了少数的例外不知什 么原因但时间将会揭示他像神圣的密兰达一样和人们一起忍受着痛苦这班人不知什么原因但时 间将会揭示生活在痛苦中生活在烈火中这烈火这火焰如果继续燃烧毫无疑问将使穹苍着火也就 是说将地狱炸上天去天是那么蓝那么澄澈那么平静这种平静尽管时断时续总比没有好得多但是 别这么快还要进一步考虑到泰斯丢和丘那德的人体测定学院的未完成的研究结果早已断定毫无 疑问换句话说除了依附着人类的疑问之外别无其他疑问根据泰斯丢和丘那德的未完成的劳动的 结果早已作出如下的论断但是别这么快不知什么原因根据彭奇和瓦特曼的公共事业的结果已毫 无疑问地断定鉴于波波夫和贝尔契不知什么原因未完成的劳动以及泰斯丢和丘那德的未完成的 劳动已经就业已被许多人所否认的论点作出论断认为泰斯丢和丘那德所假设的人认为实际存在 的人认为人类总而言之统而言之尽管有进步的营养学和通大便药却在衰弱萎缩衰弱萎缩而且与 此同时尤其是不知什么原因尽管体育运动在各方面都有很大进展如网球足球田径车赛游泳飞行 划船骑马滑翔溜冰各式各样的网球各种各样致人死命的飞行运动各式各样的秋天夏天冬天冬天 网球各种各样的曲棍球盘尼西林和代用品总之我接下去讲与此同时不知什么原因要萎缩要减少 尽管有网球我接下去讲飞行滑翔九穴和十八穴的高尔夫球各种各样的网球总之不知什么原因在 番克汉贝克汉福尔汉克莱普汉换句话说与此同时尤其是不知什么原因但时间将会揭示要减少减 少我接下去讲福尔汉克莱普汉总之自从塞缪尔·约翰逊去世以后到现在每个人的全部损失共计每 人一吋四唡只是大概约略粗粗计算到小数点分量很足保持整数赤裸裸的光穿着袜子在康纳马拉 总之不知什么原因不管怎样无论如何事实俱在尤其是考虑到更加远为严肃的看来更加严肃的鉴 于斯丹威格和彼特曼的徒劳看来更加严肃的鉴于鉴于鉴于斯丹威格和彼特曼徒劳在平原在山地 在海洋在烈火沸腾的河里天空是一样的随后是大地换句话说天空随后是大地在一片寒冷一片漆 黑中天空大地石头的住所在一片寒冷中哎哟哟在我们的主诞生六百年左右天空大地海洋大地石 头的住所汪洋中一片寒冷中在海上在陆地在空中我接下去讲不知什么原因尽管有网球事实俱在 但时间将会揭示我接下去讲哎哟哟总之一句话石头的住所谁能怀疑我接下去讲但是别这么快我 接下去讲头颅要萎缩衰弱减少与此同时尤其是不知什么原因尽管有网球胡子���焰球队石头那么 蓝那么平静哎哟哟头颅头颅头颅头颅在康纳马拉尽管有网球未完成的徒然的劳动更加严肃的石 头的住所总之我接下去讲哎哟哟徒劳的未完成的头颅头颅在康纳马拉尽管有网球头颅哎哟石头

desired or expected output

no "���"

anything else

Please put any comments or anything else here :)

cmhughes commented 5 months ago

Which version are you using?and which operating system?

On Thu, 21 Mar 2024, 00:46 trarer, @.***> wrote:

Please provide the following when posting an issue: original .tex code

如彭奇和瓦特曼的公共事业所证实的那样有一个胡子雪雪白的上帝超越时间超越空间确确 实实存在他在神圣的冷漠神圣的疯狂神圣的喑哑的高处深深地爱着我们除了少数的例外不知什 么原因但时间将会揭示他像神圣的密兰达一样和人们一起忍受着痛苦这班人不知什么原因但时 间将会揭示生活在痛苦中生活在烈火中这烈火这火焰如果继续燃烧毫无疑问将使穹苍着火也就 是说将地狱炸上天去天是那么蓝那么澄澈那么平静这种平静尽管时断时续总比没有好得多但是 别这么快还要进一步考虑到泰斯丢和丘那德的人体测定学院的未完成的研究结果早已断定毫无 疑问换句话说除了依附着人类的疑问之外别无其他疑问根据泰斯丢和丘那德的未完成的劳动的 结果早已作出如下的论断但是别这么快不知什么原因根据彭奇和瓦特曼的公共事业的结果已毫 无疑问地断定鉴于波波夫和贝尔契不知什么原因未完成的劳动以及泰斯丢和丘那德的未完成的 劳动已经就业已被许多人所否认的论点作出论断认为泰斯丢和丘那德所假设的人认为实际存在 的人认为人类总而言之统而言之尽管有进步的营养学和通大便药却在衰弱萎缩衰弱萎缩而且与 此同时尤其是不知什么原因尽管体育运动在各方面都有很大进展如网球足球田径车赛游泳飞行 划船骑马滑翔溜冰各式各样的网球各种各样致人死命的飞行运动各式各样的秋天夏天冬天冬天 网球各种各样的曲棍球盘尼西林和代用品总之我接下去讲与此同时不知什么原因要萎缩要减少 尽管有网球我接下去讲飞行滑翔九穴和十八穴的高尔夫球各种各样的网球总之不知什么原因在 番克汉贝克汉福尔汉克莱普汉换句话说与此同时尤其是不知什么原因但时间将会揭示要减少减 少我接下去讲福尔汉克莱普汉总之自从塞缪尔·约翰逊去世以后到现在每个人的全部损失共计每 人一吋四唡只是大概约略粗粗计算到小数点分量很足保持整数赤裸裸的光穿着袜子在康纳马拉 总之不知什么原因不管怎样无论如何事实俱在尤其是考虑到更加远为严肃的看来更加严肃的鉴 于斯丹威格和彼特曼的徒劳看来更加严肃的鉴于鉴于鉴于斯丹威格和彼特曼徒劳在平原在山地 在海洋在烈火沸腾的河里天空是一样的随后是大地换句话说天空随后是大地在一片寒冷一片漆 黑中天空大地石头的住所在一片寒冷中哎哟哟在我们的主诞生六百年左右天空大地海洋大地石 头的住所汪洋中一片寒冷中在海上在陆地在空中我接下去讲不知什么原因尽管有网球事实俱在 但时间将会揭示我接下去讲哎哟哟总之一句话石头的住所谁能怀疑我接下去讲但是别这么快我 接下去讲头颅要萎缩衰弱减少与此同时尤其是不知什么原因尽管有网球胡子火焰球队石头那么 蓝那么平静哎哟哟头颅头颅头颅头颅在康纳马拉尽管有网球未完成的徒然的劳动更加严肃的石 头的住所总之我接下去讲哎哟哟徒劳的未完成的头颅头颅在康纳马拉尽管有网球头颅哎哟石头. yaml settings

Please paste your YAML settings (if any) here actual/given output

如彭奇和瓦特曼的公共事业所证实的那样有一个胡子雪雪白的上帝超越时间超越空间确确 实实存在他在神圣的冷漠神圣的疯狂神圣的喑哑的高处深深地爱着我们除了少数的例外不知什 么原因但时间将会揭示他像神圣的密兰达一样和人们一起忍受着痛苦这班人不知什么原因但时 间将会揭示生活在痛苦中生活在烈火中这烈火这火焰如果继续燃烧毫无疑问将使穹苍着火也就 是说将地狱炸上天去天是那么蓝那么澄澈那么平静这种平静尽管时断时续总比没有好得多但是 别这么快还要进一步考虑到泰斯丢和丘那德的人体测定学院的未完成的研究结果早已断定毫无 疑问换句话说除了依附着人类的疑问之外别无其他疑问根据泰斯丢和丘那德的未完成的劳动的 结果早已作出如下的论断但是别这么快不知什么原因根据彭奇和瓦特曼的公共事业的结果已毫 无疑问地断定鉴于波波夫和贝尔契不知什么原因未完成的劳动以及泰斯丢和丘那德的未完成的 劳动已经就业已被许多人所否认的论点作出论断认为泰斯丢和丘那德所假设的人认为实际存在 的人认为人类总而言之统而言之尽管有进步的营养学和通大便药却在衰弱萎缩衰弱萎缩而且与 此同时尤其是不知什么原因尽管体育运动在各方面都有很大进展如网球足球田径车赛游泳飞行 划船骑马滑翔溜冰各式各样的网球各种各样致人死命的飞行运动各式各样的秋天夏天冬天冬天 网球各种各样的曲棍球盘尼西林和代用品总之我接下去讲与此同时不知什么原因要萎缩要减少 尽管有网球我接下去讲飞行滑翔九穴和十八穴的高尔夫球各种各样的网球总之不知什么原因在 番克汉贝克汉福尔汉克莱普汉换句话说与此同时尤其是不知什么原因但时间将会揭示要减少减 少我接下去讲福尔汉克莱普汉总之自从塞缪尔·约翰逊去世以后到现在每个人的全部损失共计每 人一吋四唡只是大概约略粗粗计算到小数点分量很足保持整数赤裸裸的光穿着袜子在康纳马拉 总之不知什么原因不管怎样无论如何事实俱在尤其是考虑到更加远为严肃的看来更加严肃的鉴 于斯丹威格和彼特曼的徒劳看来更加严肃的鉴于鉴于鉴于斯丹威格和彼特曼徒劳在平原在山地 在海洋在烈火沸腾的河里天空是一样的随后是大地换句话说天空随后是大地在一片寒冷一片漆 黑中天空大地石头的住所在一片寒冷中哎哟哟在我们的主诞生六百年左右天空大地海洋大地石 头的住所汪洋中一片寒冷中在海上在陆地在空中我接下去讲不知什么原因尽管有网球事实俱在 但时间将会揭示我接下去讲哎哟哟总之一句话石头的住所谁能怀疑我接下去讲但是别这么快我 接下去讲头颅要萎缩衰弱减少与此同时尤其是不知什么原因尽管有网球胡子���焰球队石头那么 蓝那么平静哎哟哟头颅头颅头颅头颅在康纳马拉尽管有网球未完成的徒然的劳动更加严肃的石 头的住所总之我接下去讲哎哟哟徒劳的未完成的头颅头颅在康纳马拉尽管有网球头颅哎哟石头 desired or expected output

no "���" anything else

Please put any comments or anything else here :)

— Reply to this email directly, view it on GitHub https://github.com/cmhughes/latexindent.pl/issues/528, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAQ7CYFQJDRFCBA2WTJKQVDYZIUUXAVCNFSM6AAAAABFAPWQ62VHI2DSMVQWIX3LMV43ASLTON2WKOZSGE4TQOBVGY2TCNI . You are receiving this because you are subscribed to this thread.Message ID: @.***>

Mikachu2333 commented 5 months ago

Same Problem.

Which version are you using?and which operating system?

Win10, 22H2, 19045.4170, Texlive2024,latexindent(70666), XeLaTeX*3 to complie for pdf file.

The issue appears randomly, possibly in the main text or comments, but it must have appeared in CJK, no found in English.

Since it appears randomly, I cannot even provide an MWE for reference... I suspect it is context sensitive because the same word is normal in one sentence and may be replaced in another sentence. Currently, the replaced characters include: “二,训” and many other characters, etc..


Here is a MWE, although I tried my best, I couldn't let the following code present the original error, and now the error occurs in another place.

% !TeX encoding = UTF-8
% !TEX TS-program = xelatex
\documentclass[a4paper,twoside,onecolumn,12pt]{ctexrep}
\usepackage{enumerate,ulem,indentfirst}

\begin{document}
\section[住宿注意事项]{住宿注意事项}
\begin{enumerate}
    \item \textbf{\uuline{宿舍以专业为单位进行随机分配宿舍楼、班内宿舍按姓氏顺序分配,与录取分数无关}}
          \label{random_allocation}
    \item 是否自带被褥等可按照个人需求决定\footnotemark
          \footnotetext{新生军训期间对于床单的颜色等具有特别要求,详见录取通知书相关说明。}
    \item 宿舍门禁系统将在开学军训期间进行人脸录入,\textbf{\uuline{切忌美颜过度,否则无法识别}}
    \item 无特殊情况\textbf{禁止自挂床帘},特殊需求请找导员开具证明
    \item 宿舍内备有烟雾传感器,\textbf{吸烟将引发报警\footnotemark}
          \footnotetext{若烟雾报警器报警,请立即联系宿舍管理人员或保卫科核实。}
    \item 床上桌等类似的东西建议到学校实际生活1个月以后再决定是否购买(大部分人都用不到,少数同学用来打游戏,\sout{然而身体在床上缩着打游戏超级难受};更少一部分同学用其学习,\sout{该现象\linebreak[3]比彩色大熊猫更加罕见})
    \item 宿舍单个插座的功率限制400W\footnotemark,\textbf{\uuline{吹风机,锅,电暖宝,电水壶,热得快等高功率电器均严}}\linebreak[3]\textbf{\uuline{禁使用},否则将引起宿舍全楼停电};宿管不定期来查,若被发现将被没收并通报批评、检讨
          \footnotetext{如果接了一个插排,插排的总功率不能超过400W,例如一个67W的手机充电器和2个175W的游戏本电脑就立马跳闸了。}
    \item 如需装修宿舍,可通过参加学校统一开展的\textbf{“宿舍装扮大赛”}\footnotemark 以对宿舍进行小幅调整
          \footnotetext{大赛禁止外来装修人员入校、禁止私改电路,详情内容见开学后下发的参赛要求。}
    \item 背阴面宿舍的阳台相当于摆设,\textbf{推荐在楼下晾晒衣物},若只靠阴干,很容易发霉发臭;向阳面无此困扰
    \item \textbf{一旦离开宿舍必须关灯关电,若插排未拔将被没收并扣分}
    \item 禁止将正在持续充电的手机、充电宝直接置于被子等密闭、空气无流通的环境中,极不推荐直接将笔记本电脑置于被子上使用,严重影响散热且有着火风险
    \item \textbf{\uuline{为保证他人睡眠,熄灯后严禁使用台灯、手电筒在宿舍内继续学习;更不要制造噪音!}}\footnotemark
          \footnotetext{很多同学难以入睡且睡眠浅,小动静或急速的明暗变化就能被惊醒,请大家务必相互尊重、相互理解。}
    \item 如遇宿舍公用物品(如门锁,门轴,玻璃窗,灯管,水龙头,下水道等)损坏,请直接报修(教程见此\uline{\ref{repair_report}})
    \item 宿舍一层有便民驿站(含针线包、打气筒、简易医药箱),即用即还
    \item 雨伞不得长时间放置于宿舍门外,避免影响正常通行
    \item \textbf{严禁在23:30以后使用洗衣机、烘干机、吹风机或洗澡。}
\end{enumerate}

\end{document}

图片

trarer commented 5 months ago

Which version are you using?and which operating system? On Thu, 21 Mar 2024, 00:46 trarer, @.> wrote: Please provide the following when posting an issue: original .tex code 如彭奇和瓦特曼的公共事业所证实的那样有一个胡子雪雪白的上帝超越时间超越空间确确 实实存在他在神圣的冷漠神圣的疯狂神圣的喑哑的高处深深地爱着我们除了少数的例外不知什 么原因但时间将会揭示他像神圣的密兰达一样和人们一起忍受着痛苦这班人不知什么原因但时 间将会揭示生活在痛苦中生活在烈火中这烈火这火焰如果继续燃烧毫无疑问将使穹苍着火也就 是说将地狱炸上天去天是那么蓝那么澄澈那么平静这种平静尽管时断时续总比没有好得多但是 别这么快还要进一步考虑到泰斯丢和丘那德的人体测定学院的未完成的研究结果早已断定毫无 疑问换句话说除了依附着人类的疑问之外别无其他疑问根据泰斯丢和丘那德的未完成的劳动的 结果早已作出如下的论断但是别这么快不知什么原因根据彭奇和瓦特曼的公共事业的结果已毫 无疑问地断定鉴于波波夫和贝尔契不知什么原因未完成的劳动以及泰斯丢和丘那德的未完成的 劳动已经就业已被许多人所否认的论点作出论断认为泰斯丢和丘那德所假设的人认为实际存在 的人认为人类总而言之统而言之尽管有进步的营养学和通大便药却在衰弱萎缩衰弱萎缩而且与 此同时尤其是不知什么原因尽管体育运动在各方面都有很大进展如网球足球田径车赛游泳飞行 划船骑马滑翔溜冰各式各样的网球各种各样致人死命的飞行运动各式各样的秋天夏天冬天冬天 网球各种各样的曲棍球盘尼西林和代用品总之我接下去讲与此同时不知什么原因要萎缩要减少 尽管有网球我接下去讲飞行滑翔九穴和十八穴的高尔夫球各种各样的网球总之不知什么原因在 番克汉贝克汉福尔汉克莱普汉换句话说与此同时尤其是不知什么原因但时间将会揭示要减少减 少我接下去讲福尔汉克莱普汉总之自从塞缪尔·约翰逊去世以后到现在每个人的全部损失共计每 人一吋四唡只是大概约略粗粗计算到小数点分量很足保持整数赤裸裸的光穿着袜子在康纳马拉 总之不知什么原因不管怎样无论如何事实俱在尤其是考虑到更加远为严肃的看来更加严肃的鉴 于斯丹威格和彼特曼的徒劳看来更加严肃的鉴于鉴于鉴于斯丹威格和彼特曼徒劳在平原在山地 在海洋在烈火沸腾的河里天空是一样的随后是大地换句话说天空随后是大地在一片寒冷一片漆 黑中天空大地石头的住所在一片寒冷中哎哟哟在我们的主诞生六百年左右天空大地海洋大地石 头的住所汪洋中一片寒冷中在海上在陆地在空中我接下去讲不知什么原因尽管有网球事实俱在 但时间将会揭示我接下去讲哎哟哟总之一句话石头的住所谁能怀疑我接下去讲但是别这么快我 接下去讲头颅要萎缩衰弱减少与此同时尤其是不知什么原因尽管有网球胡子火焰球队石头那么 蓝那么平静哎哟哟头颅头颅头颅头颅在康纳马拉尽管有网球未完成的徒然的劳动更加严肃的石 头的住所总之我接下去讲哎哟哟徒劳的未完成的头颅头颅在康纳马拉尽管有网球头颅哎哟石头. yaml settings Please paste your YAML settings (if any) here actual/given output 如彭奇和瓦特曼的公共事业所证实的那样有一个胡子雪雪白的上帝超越时间超越空间确确 实实存在他在神圣的冷漠神圣的疯狂神圣的喑哑的高处深深地爱着我们除了少数的例外不知什 么原因但时间将会揭示他像神圣的密兰达一样和人们一起忍受着痛苦这班人不知什么原因但时 间将会揭示生活在痛苦中生活在烈火中这烈火这火焰如果继续燃烧毫无疑问将使穹苍着火也就 是说将地狱炸上天去天是那么蓝那么澄澈那么平静这种平静尽管时断时续总比没有好得多但是 别这么快还要进一步考虑到泰斯丢和丘那德的人体测定学院的未完成的研究结果早已断定毫无 疑问换句话说除了依附着人类的疑问之外别无其他疑问根据泰斯丢和丘那德的未完成的劳动的 结果早已作出如下的论断但是别这么快不知什么原因根据彭奇和瓦特曼的公共事业的结果已毫 无疑问地断定鉴于波波夫和贝尔契不知什么原因未完成的劳动以及泰斯丢和丘那德的未完成的 劳动已经就业已被许多人所否认的论点作出论断认为泰斯丢和丘那德所假设的人认为实际存在 的人认为人类总而言之统而言之尽管有进步的营养学和通大便药却在衰弱萎缩衰弱萎缩而且与 此同时尤其是不知什么原因尽管体育运动在各方面都有很大进展如网球足球田径车赛游泳飞行 划船骑马滑翔溜冰各式各样的网球各种各样致人死命的飞行运动各式各样的秋天夏天冬天冬天 网球各种各样的曲棍球盘尼西林和代用品总之我接下去讲与此同时不知什么原因要萎缩要减少 尽管有网球我接下去讲飞行滑翔九穴和十八穴的高尔夫球各种各样的网球总之不知什么原因在 番克汉贝克汉福尔汉克莱普汉换句话说与此同时尤其是不知什么原因但时间将会揭示要减少减 少我接下去讲福尔汉克莱普汉总之自从塞缪尔·约翰逊去世以后到现在每个人的全部损失共计每 人一吋四唡只是大概约略粗粗计算到小数点分量很足保持整数赤裸裸的光穿着袜子在康纳马拉 总之不知什么原因不管怎样无论如何事实俱在尤其是考虑到更加远为严肃的看来更加严肃的鉴 于斯丹威格和彼特曼的徒劳看来更加严肃的鉴于鉴于鉴于斯丹威格和彼特曼徒劳在平原在山地 在海洋在烈火沸腾的河里天空是一样的随后是大地换句话说天空随后是大地在一片寒冷一片漆 黑中天空大地石头的住所在一片寒冷中哎哟哟在我们的主诞生六百年左右天空大地海洋大地石 头的住所汪洋中一片寒冷中在海上在陆地在空中我接下去讲不知什么原因尽管有网球事实俱在 但时间将会揭示我接下去讲哎哟哟总之一句话石头的住所谁能怀疑我接下去讲但是别这么快我 接下去讲头颅要萎缩衰弱减少与此同时尤其是不知什么原因尽管有网球胡子���焰球队石头那么 蓝那么平静哎哟哟头颅头颅头颅头颅在康纳马拉尽管有网球未完成的徒然的劳动更加严肃的石 头的住所总之我接下去讲哎哟哟徒劳的未完成的头颅头颅在康纳马拉尽管有网球头颅哎哟石头 desired or expected output no "���" anything else Please put any comments or anything else here :) — Reply to this email directly, view it on GitHub <#528>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAQ7CYFQJDRFCBA2WTJKQVDYZIUUXAVCNFSM6AAAAABFAPWQ62VHI2DSMVQWIX3LMV43ASLTON2WKOZSGE4TQOBVGY2TCNI . You are receiving this because you are subscribed to this thread.Message ID: @.>

macOS Sonoma 14.4 latexindent 3.23.7

cmhughes commented 5 months ago

@fengzyf can you assist me with this?

saxyx commented 5 months ago

@trarer @Mikachu2333 After saving the tex code provided by you both in UTF-8 encoding as originalA.tex and originalB.tex, I ran latexindent -s -g issue-528-1.log -o=++ originalA.tex and latexindent -s -g issue-528-2.log -o=++ originalB.tex in the cmd. The generated originalA0.tex and originalB0.tex were normal without the issues you mentioned. How do you call latexindent and what commands do you use?

Mikachu2333 commented 5 months ago

How do you call latexindent and what commands do you use?

I use latexindent as what vscode call it defaultly 图片 图片

Here is Vscode output log of latex-workshop

[22:43:01.965][Format][TeX] Start formatting with latexindent.
[22:43:01.968][Format][TeX] Formatting LaTeX. The command is D:\texlive\2024\bin\windows\latexindent.exe:["-c","d:/LanguageLearning/Latex/test/","d:/LanguageLearning/Latex/test/__latexindent_temp_main.tex","-y=defaultIndent: '    '"].
[22:43:02.531][Format][TeX] Formatted %WS1%\main.tex
[22:43:14.916][Extension] onDidSaveTextDocument triggered: file:///d:/LanguageLearning/Latex/test/main.tex
[22:43:14.979][Cacher][Watcher] "change" emitted on %WS1%\main.tex.
[22:43:14.980][Cacher] Caching %WS1%\main.tex .
[22:43:14.981][Cacher] Updated inputs of %WS1%\main.tex .
[22:43:14.982][Cacher] Parse LaTeX AST: %WS1%\main.tex .
[22:43:14.982][Build] Auto build starteddetecting the change of a file: %WS1%\main.tex .
[22:43:14.982][Event] AUTO_BUILD_INITIATED: {"type":"onFileChange","file":"d:\\LanguageLearning\\Latex\\test\\main.tex"}
[22:43:14.982][Build] The document of the active editor: file:///d:/LanguageLearning/Latex/test/main.tex
[22:43:14.983][Build] The languageId of the document: latex
[22:43:14.983][Build] Building root file: %WS1%\main.tex
[22:43:14.983][Build][Recipe] Build root file %WS1%\main.tex
[22:43:14.983][Event] FILE_CHANGED: "d:\\LanguageLearning\\Latex\\test\\main.tex"
[22:43:14.985][Build][Recipe] Preparing to run recipe: XeLaTeX *2.
[22:43:14.985][Build][Recipe] Prepared 2 tools.
[22:43:15.257][Build][Recipe] outDir: d:/LanguageLearning/Latex/test .
[22:43:15.258][Build] Recipe step 1 The command is xelatex:["-synctex=1","-interaction=nonstopmode","-file-line-error","main"].
[22:43:15.258][Build] env: undefined
[22:43:15.259][Build] root: %WS1%\main.tex
[22:43:15.259][Build] cwd: %WS1%
[22:43:15.286][Build] LaTeX build process spawned with PID 14712.
[22:43:15.288][Cacher] Parsed LaTeX AST: %WS1%\main.tex .
[22:43:15.288][File] kpsewhich cache hit on ctexrep.cls: d:/texlive/2024/texmf-dist/tex/latex/ctex/ctexrep.cls .
[22:43:15.290][Cacher] Updated elements in 1.47 ms: %WS1%\main.tex .
[22:43:15.290][Event] FILE_PARSED: "d:\\LanguageLearning\\Latex\\test\\main.tex"
[22:43:15.291][Structure] Structure force updated with 1 root sections for %WS1%\main.tex .
[22:43:15.291][Event] STRUCTURE_UPDATED
[22:43:16.718][Parser][TexLog] Logged 10 messages.
[22:43:16.719][Build] Finished a step in recipe with PID 14712.
[22:43:16.720][Build] Recipe step 2 The command is xelatex:["-synctex=1","-interaction=nonstopmode","-file-line-error","main"].
[22:43:16.720][Build] env: undefined
[22:43:16.720][Build] root: %WS1%\main.tex
[22:43:16.721][Build] cwd: %WS1%
[22:43:16.767][Build] LaTeX build process spawned with PID 20988.
[22:43:18.180][Parser][TexLog] Logged 9 messages.
[22:43:18.181][Build] Finished a step in recipe with PID 20988.
[22:43:18.182][Build] Successfully built %WS1%\main.tex .
[22:43:18.182][Event] BUILD_DONE
[22:43:18.183][Viewer] Call refreshExistingViewer: "d:\\LanguageLearning\\Latex\\test\\main.pdf" .
[22:43:18.183][Viewer] Not found PDF viewers to refresh: %WS1%\main.pdf
[22:43:18.185][Build] Auto Clean invoked.
[22:43:18.185][Cleaner] Clean temporary files command The command is latexmk:["-outdir=d:/LanguageLearning/Latex/test","-c","d:\\LanguageLearning\\Latex\\test\\main.tex"].
[22:43:18.296][Cleaner] Failed running cleaning command latexmk . Error: spawn latexmk ENOENT
[22:43:18.297]Error: spawn latexmk ENOENT
    at notFoundError (c:\Users\mikac\.vscode\extensions\james-yu.latex-workshop-9.19.1\node_modules\cross-spawn\lib\enoent.js:6:26)
    at verifyENOENT (c:\Users\mikac\.vscode\extensions\james-yu.latex-workshop-9.19.1\node_modules\cross-spawn\lib\enoent.js:40:16)
    at cp.emit (c:\Users\mikac\.vscode\extensions\james-yu.latex-workshop-9.19.1\node_modules\cross-spawn\lib\enoent.js:27:25)
    at Process.onexit (node:internal/child_process:291:12)
[22:43:18.297][STDERR] 'latexmk' �����ڲ����ⲿ���Ҳ���ǿ����еij���
���������ļ���

[22:43:18.298][Event] AUTO_CLEANED
[22:44:14.499][Event] STRUCTURE_UPDATED
saxyx commented 5 months ago

I use latexindent as what vscode call it defaultly

I'm not using Vscode so I can't test it directly. From the Vscode output log, which is equivalent to running

D:\texlive\2024\bin\windows\latexindent.exe -c=d:/LanguageLearning/Latex/test/ d:/LanguageLearning/Latex/test/__latexindent_temp_main.tex -y="defaultIndent: '    '" -o=d:/LanguageLearning/Latex/test/__latexindent_temp_main.tex

in cmd, this command produces normal results on my computer. You can test this by running this command in cmd.

Mikachu2333 commented 5 months ago

I use latexindent as what vscode call it defaultly

I'm not using Vscode so I can't test it directly. From the Vscode output log, which is equivalent to running

D:\texlive\2024\bin\windows\latexindent.exe -c=d:/LanguageLearning/Latex/test/ d:/LanguageLearning/Latex/test/__latexindent_temp_main.tex -y="defaultIndent: '    '" -o=d:/LanguageLearning/Latex/test/__latexindent_temp_main.tex

in cmd, this command produces normal results on my computer. You can test this by running this command in cmd.

Sure, and maybe I found the reason for this issues https://github.com/cmhughes/latexindent.pl/issues/529#issuecomment-2016347813 It seems that vscode (latexworkshop ext) use the latexindent.exe provided by itself instead of users's.

trarer commented 5 months ago

It seems that vscode (latexworkshop ext) use the latexindent.exe provided by itself instead of users's.

This problem seems to only occur with the latexindent standalone program on macOS and Windows. Linux uses the package provided by the distribution, and there are no CJK-related problems. Latexshop does not provide the latexindent program, but calls the system-installed program. I don't think it's a problem with vscode, because vscode on Linux doesn't have this problem. This problem only started to appear in the latest version of latexindent in the past few days.

trarer commented 5 months ago

Sure, and maybe I found the reason for this issues https://github.com/cmhughes/latexindent.pl/issues/529#issuecomment-2016347813

This issue has nothing to do with this issue.

cmhughes commented 5 months ago

Does this issue have anything to do with latexindent.pl or is it about vscode?

trarer commented 5 months ago

Does this issue have anything to do with latexindent.pl or is it about vscode?

I downloaded latexindent.exe V3.23.7 and latexindent.exe V3.23.6 at the same time on windows. When vscode calls V3.23.6, everything is normal. When calling V3.23.7, the above issue will occur. macOS also has this issue. Arch Linux uses the latexindent program provided by the distribution, and there has been no problem so far. I can currently only use ssh to call Arch Linux's vscode to work. I use the command line to call latexindent on macOS, and there seems to be no problem. Anyway, the issue with latexindent on vscode is related to the latest update. I took a look at the update documentation for V3.23.7, and the addition of this small feature does affect the work of other tools.

cmhughes commented 5 months ago

@fengzyf any input on this?

fengzyf commented 5 months ago

I downloaded vscode, installed the Latex workshop plugin, and changed the part of the settings provided by Mikachu2333 where Latex workshop uses latexindent to:

"latex-workshop.latexindent.args": [
    "-c",
    "%DIR%",
    "%TMPFILE%",
    "-y=defaultIndent: '%INDENT%'",
    "-o=+PP"
],
"latex-workshop.latexindent.path": "D:\\texlive\\2024\\bin\\windows\\latexindent.exe",

When formatting originalB.tex, it produced the expected result without encountering the issues mentioned by Mikachu2333.

However, when formatting originalA.tex, I encountered the problem reported by trarer, where incorrect characters “���” appeared. After opening the output file __latexindent_temp_originalAPP.tex that Latex workshop did not delete, the characters at the corresponding position were correct. Therefore, the issue encountered by trarer was caused by Latex workshop.

See the uploaded video for details.

https://github.com/cmhughes/latexindent.pl/assets/154897680/59bd9e61-1a26-414c-94de-ea410b56d025

trarer commented 5 months ago

Therefore, the issue encountered by trarer was caused by Latex workshop.

But how to explain that it is normal for vscode to call V3.23.6? It is also normal to call V3.23.7 from the command line, just like __latexindent_temp_originalAPP.tex. Maybe this isn't a bug, maybe it's a compatibility issue. It could be that the upstream program changed something that caused the downstream program to generate an error.

fengzyf commented 5 months ago

You are right. Formatting files in LaTeX Workshop is achieved by calling latexindent and capturing the standard output.

It could be that the upstream program changed something that caused the downstream program to generate an error.

@cmhughes Uncomment the code below, make the code take effect, and the problem will be resolved.

https://github.com/cmhughes/latexindent.pl/blob/16c9bd621742a70377cdba10385bfd9fd384240f/LatexIndent/Document.pm#L23

Here is the exe file I repackaged after modifying Document.pm. latexindent-repackaged.zip

cmhughes commented 5 months ago

So does this need fixing?

On Sun, 24 Mar 2024, 07:19 fengzyf, @.***> wrote:

It could be that the upstream program changed something that caused the downstream program to generate an error.

You are right. Formatting files in LaTeX Workshop is achieved by calling latexindent and capturing the standard output. Uncomment the code below, make the code take effect, and the problem will be resolved.

https://github.com/cmhughes/latexindent.pl/blob/16c9bd621742a70377cdba10385bfd9fd384240f/LatexIndent/Document.pm#L23

— Reply to this email directly, view it on GitHub https://github.com/cmhughes/latexindent.pl/issues/528#issuecomment-2016719152, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAQ7CYDKZ5GKFYIXF5V2ZVLYZZ47LAVCNFSM6AAAAABFAPWQ62VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMJWG4YTSMJVGI . You are receiving this because you commented.Message ID: @.***>

fengzyf commented 5 months ago

Yes, of course.

cmhughes commented 5 months ago

@fengzyf can you fix it please?

cmhughes commented 4 months ago

resolved at https://github.com/cmhughes/latexindent.pl/pull/530 to be released soon, please leave open until released.

cmhughes commented 4 months ago

resolved at https://github.com/cmhughes/latexindent.pl/releases/tag/V3.23.8

thanks for reporting, thanks to @Mikachu2333 for fixing :)