New lexers:

• Janet (#2557)
• Lean 4 (#2618, #2626)
• Luau (#2605)
• Mojo (#2691, #2515)
• org-mode (#2628, #2636)
• Promela (#2620)
• Soong / Android.bp (#2659)
• Tact (#2571)
• Typst (#2596)

Updated lexers:

• Awk: recognize ternary operator (#2687)
• Bash: add openrc alias (#2599, #2371)
• Coq: add keywords, lex more vernacular command arguments, produce
  fewer tokens on heading comments (#2678)
• DNS zone files: Fix comment parsing (#2595)
• Hy: Support unicode literals (#1126)
• Inform6: Update to Inform 6.42 (#2644)
• lean: Fix name handling (#2614)
• Logtalk: add uninstantiation keyword and recognize
  escape sequences (#2619)
• Macaulay2: Update to 1.23 (#2655)
• Python: fix highlighting of soft keywords before None/True/False
• reStructuredText: use Token.Comment for comments instead of
  Comment.Preproc (#2598)
• Rust: highlight :, :: and -> as Punctuation
  and whitespace as Whitespace, instead of Text
  in both cases (#2631)
• Spice: Add keywords (#2621)
• SQL Explain: allow negative numbers (#2610)
• Swift: Support multiline strings (#2681)
• ThingsDB: add constants and new functions; support template
  strings (#2624)
• UL4: support nested <?doc?> and <?note?> tags (#2597)
• VHDL: support multi-line comments of VHDL-2008 (#2622)
• Wikitext: Remove kk-* in variant_langs (#2647)
• Xtend: Add val and var (#2602)

New styles:

• Coffee (#2609)

Make background colors in the image formatter work with Pillow 10.0 (#2623)

Require Python 3.8. As a result, the importlib-metadata package
is no longer needed for fast plugin discovery on Python 3.7.
The plugins extra (used as, e.g., pip install pygments[plugins])
is kept for backwards compatibility but now has no effect. (#2601)

Require the url attribute for lexers inside Pygments, add
it to many lexers (#2588)

Replace Pyflakes linter with Ruff (#2592)

Add macOS CI (#2594)

Built-in lexers now declare the version of Pygments in which they were
added in a required version_added lexer attribute, instead of a
.. versionadded:: directive in the docstring (#2589, #2634)

The url attribute is now required for built-in lexers and
has been added to all existing lexers (#2588)

The RTF formatter supports line number and line highlighting now (#1217, #2654)

Add \sa0 keyword in the RTF formatter (#1111, #2607)

Register pycon as an alias for the Python console lexer (#2697)

Add MIME-Type for DesktopLexer (#2613)

Fix native style to meet WCAG AA guidelines (#2600)

Fix typo in documentation (#2672)

Use format strings consistently (#2661)

Add __class_getitem__ to Formatter to improve typing support (#2665)

Updated lexers:

• TOML: Fix bug making lexing of single-quoted strings too eager

New lexers:

• JSX (#2524, #709)
• Kusto (#2552)
• ldaprc (#2532)
• LDIF (#2489)
• PRQL (#2507, #2523, #2559)
• Visual Prolog and Visual Prolog Grammar (#2480)
• Vyper (#2531, #2579)

Updated lexers:

• Cypher: fix comment matching, add missing keywords (#2504)
• Fortran: add elseif keyword (#2528)
• Lean: make it available as lean3, in preparation for a possible switch to lean highlighting as Lean 4 (#2546)
• JSON: add MIME types and file extensions for several line-delimited JSON formats (#2490)
• Nix: many improvements (#2551, #1800)
• OCaml: Add and keyword, remove value from keywords (#2521)
• Python: add starlark and bazel aliases (#2517, #2516)
• Snowball: Treat len like size (#2508)
• Spice: add panic keyword and -> operator (#2510)
• squid.conf: fix catastrophic backtracking (#2583)
• TOML: rewritten, with many fixes (#2576)
• Turtle: support blank nodes (#2581)
• Wikitext: fix erroneous highlighting of LanguageConverter markup
  (#2493), add missing variant languages (#2494)
• CMake: support [=[ bracketed arguments ]=] (#2549)

Fix ctags support and tests (#2487)

Include Lexer.add_filter in the documentation (#2519)

Add a Lean3Lexer alias (#2546)

The pygments.styles module contains a new STYLES variable with a dictionary of built-in styles. The old STYLE_MAP variable, which uses a different format, is kept for backwards compatibility.

On Windows, add a new installation extra (windows-terminal) which pulls in dependencies for colored console output. See :doc:cmdline for more details. (#2505)

Support more file types in autopygmentize script (#2513)

Change color of numbers in rrt style (#2526)

Fix error when trying to look up plugin formatters by file extension of the output format (#2563)

Use Hatchling as a build backend instead of setuptools.
This change is transparent to most users. Distribution packagers who build without build isolation need to add hatchling as a build
dependency and remove setuptools. People downloading source distributions and wheels from PyPI directly should note that they now have pygments in their file names instead of Pygments. (#2573)

Improve the test framework to also check for lost tokens when processing the snippets and example files (#2582.)

Improve the Dracula style definition to make it easier to maintain (#2575)

New lexers:

• ASN.1 (#2462)
• Blueprint (#2434)
• BQN (#2472)
• DNS zone files (#2464)
• GraphQL (#2428)
• Linux desktop files (following the specification of the Freedesktop group, formerly known as XDG) (#2470)
• NVIDIA PTX (#2432)
• OpenSCAD (#2449)
• systemd (#2470)
• TLS presentation language (#2455)
• Verifpal (#2430)
• YARA (#2453)

Updated lexers:

• ASC: Add application/pem-certificate-chain mimetype (#2471)
• C/C++: Refine keyword lists (#2421, #2422)
• Carbon: Fix long processing times on invalid input, fix number lexing (#2454, #2456)
• Elpi: Handle quotations (#2419)
• Go: Support additional built-ins (#2481)
• HTTP: Support empty headers (#2461), support more general methods (#2460), also recognize responses in analyse_text implementation (#2460), and highlight URL encoded data (#2465, #1620)
• Igor Pro: Update to Igor Pro 9 (#2482)
• lean: Recognize expressions nested within attributes (#1817)
• Macaulay2: Update builtins (#2457)
• Markdown: Allow extra characters after language name
  in code blocks (#2437)
• NestedText: Update to version 3 (#2459)
• scdoc: Improve language guessing implementation (#2402)
• Spice: Update to latest version (#2476)
• Transact SQL: Add Pre-sorted Group keyword (#2417)
• Uxntal: Update for current runes (#2424)
• Wikitext: Fix templates in wiki links; fix a language converter false positive; add bold italic markup (#2447)

Add Generic.EmphStrong token for bold italic markup (#2444)

Add Lightbulb style (#2474)

Improve contrast in Monokai style (#2448)

Add documentation how to create terminal code highlighting commands (#2131, #2425)

Add support for loading TrueType fonts to the ImageFormatter (#1960)

Updated lexers:

• Java properties: Fix catastrophic backtracking (#2356, #2404)

Fix Python console traceback lexing being too strict
and sometimes reordering output (#2407, #2410, #2412)

Added lexers:

• Carbon (#2362, #2365, #2366, #2367, #2368, #2369, #2370)
• Dax (#2335, #2345)
• MediaWiki Wikitext (#2373, #827)
• PostgreSQL Explain (#2398)
• WGSL (WebGPU Shading Language) (#2386)
• X++ (#2339)

Updated lexers:

• AMDGPU: Add support for scratch_ instructions, the attr*.* argument,
  as well as the off modifier (#2327).

• APDL: Miscellaneous improvements (#2314)

• bash/tcsh:

  • Move break to keywords (#2377)
  • Improve bash math expansion lexing (#2255, #2353)

• Chapel: Support attributes (#2376)

• CMake: Implement bracket style comments (#2338, #2354)

• CSS: Improve lexing of numbers inside function calls (#2382, #2383)

• diff: Support normal diff syntax, as opposed to unified diff syntax (#2321)

• GLSL, HLSL:

  • Support line continuations in preprocessor code (#2350)
  • Improve preprocessor directive handling (#2357)

• LilyPond: minor update of builtins

• PHP: support attributes (#2055, #2347, #2360), fix anonymous classes without
  parameters (#2359), improve lexing of variable variable syntax (#2358)

• Python:

  • Add missing builtins (#2334)
  • Fix inconsistent lexing of None (#2406)

• Rebol/Red: Don't require script headers (#2348, #2349)

• Spice: Update keywords (#2336)

• SQL+Jinja (analyse_text method): Fix catastrophic backtracking (#2355)

• Terraform: Add hcl alias (#2375)

Declare support for Python 3.11 and drop support for Python 3.6 (#2324).

Update native style to improve contrast (#2325).

Update `github-dark`` style to match latest Primer style (#2401)

Revert a change that made guessing lexers based on file names slower
on Python 3.10 and older (#2328).

Fix some places where a locale-dependent encoding could unintentionally
be used instead of UTF-8 (#2326).

Fix Python traceback handling (#2226, #2329).

Groff formatter: sort color definitions for reproducibility (#2343)

Move project metadata to pyproject.toml, remove setup.py
and setup.cfg (#2342)

The top-level Makefile has been removed. Instead, all shortcuts
for developing are now defined and run through tox. The doc folder
still contains a Makefile as an alternative to tox -e doc.

Added lexers:

• Arturo (#2259)
• GAP session (#2211)
• Fift (#2249)
• func (#2232)
• Jsonnet (#2239)
• Minecraft schema (#2276)
• MIPS (#2228)
• Phix (#2222)
• Portugol (#2300)
• TL-b (#2247)
• World of Warcraft TOC format (#2244, #2245)
• Wren (#2271)

Updated lexers:

• Abap: Update keywords (#2281)

• Alloy: Update for Alloy 6 (#1963)

• C family (C, C++ and many others):

  • Fix an issue where a chunk would be wrongly recognized as a function definition due to braces in comments (#2210)
  • Improve parantheses handling for function definitions (#2207, #2208)

• C#: Fix number and operator recognition (#2256, #2257)

• CSound: Updated builtins (#2268)

• F#: Add .fsx file extension (#2282)

• gas (GNU assembler): recognize braces as punctuation (#2230)

• HTTP: Add CONNECT keyword (#2242)

• Inform 6: Fix lexing of properties and doubles (#2214)

• INI: Allow comments that are not their own line (#2217, #2161)

• Java properties: Fix issue with whitespace-delimited keys, support comments starting with ! and escapes, no longer support undocumented ; and // comments (#2241)

• LilyPond: Improve heuristics, add \maxima duration (#2283)

• LLVM: Add opaque pointer type (#2269)

• Macaulay2: Update keywords (#2305)

• Minecraft-related lexers (SNB and Minecraft function) moved to pygments.lexers.minecraft (#2276)

• Nim: General improvements (#1970)

• Nix: Fix single quotes inside indented strings (#2289)

• Objective J: Fix catastrophic backtracking (#2225)

• NASM: Add support for SSE/AVX/AVX-512 registers as well as 'rel' and 'abs' address operators (#2212)

• Powershell:

  • Add local: keyword (#2254)
  • Allow continuations without markers (#2262, #2263)

• Solidity: Add boolean operators (#2292)

• Spice: Add enum keyword and fix a bug regarding binary, hexadecimal and octal number tokens (#2227)

• YAML: Accept colons in key names (#2277)

Fix make mapfiles when Pygments is not installed in editable mode (#2223)

Support more filetypes and compression types in autopygmentize (#2219)

Merge consecutive tokens in Autohotkey, Clay (#2248)

Add .nasm as a recognized file type for NASM (#2280)

Add *Spec.hs as a recognized file type for HSpec (#2308)

Add *.pyi (for typing stub files) as a recognized file type for Python (#2331)

The HTML lexer no longer emits empty spans for whitespace (#2304)

Fix IRCFormatter inserting linenumbers incorrectly (#2270)

Added lexers:

• COMAL-80 (#2180)
• JMESPath (#2174, #2175, #2179, #2182)
• Sql+Jinja (#2148)

Updated lexers:

• Ada: support Ada 2022 (#2121); disable recognition of namespaces because it disturbs lexing of aspects (#2125)
• Agda: allow straight quotes in module names (#2163)
• C family (C, C++ and many others): allow comments between elements of function headers, e.g. between the arguments and the opening brace for the body (#1891)
• C++: Resolve several cases of Error tokens (#2207, #2208)
• Coq: add some common keywords, improve recognition of Set and qualified identifiers (#2158)
• F*: Allow C-style comments anywhere in a line
• Fortran: fix catastrophic backtracking with backslashes in strings (#2194)
• Go: add support for generics (#2167)
• Inform: update for version 6.40 (#2190)
• Isabelle: recognize cartouches (#2089)
• Java: support multiline strings aka. text blocks (#2132)
• Kotlin: add value modifier (#2142)
• LilyPond: add some missing builtins
• Macaulay2: update builtins (#2139)
• Matlab session: fix traceback when a line continuation ellipsis appears in the output (#2166)
• .NET: add aliases for LibreOffice Basic, OpenOfficeBasic and
  StarOffice Basic (#2170)
• Nim: use Name.Builtin instead of Keyword.Type (#2136)
• PHP: fix \"$var\" inside strings (#2105)
• Python: only recognize \N, \u and \U escape sequences in string literals, but not in bytes literals where they are not supported (#2204)
• Tcl: support ${name} variables (#2145)
• Terraform: accept leading whitespace for << heredoc delimiters (#2162)
• Teraterm: Various improvements (#2165)
• Spice: add support for the recently added features including more builtin functions and bin, oct, hex number formats (#2206)

Added styles:

• GitHub dark (#2192)
• StarOffice (#2168)
• Nord (nord and nord-darker; #2189, #1799, #1678)

Pygments now tries to use the importlib.metadata module to discover plugins instead of the slower pkg_resources (#2155). In particular, this largely speeds up the pygmentize script when the lexer is not specified.

importlib.metadata is only available in the Python standard library since Python 3.8. For older versions, there exists an importlib_metadata backport on PyPI. For this reason, Pygments now defines a packaging extra plugins, which adds a requirement on importlib_metadata if the Python version is older than 3.8. Thus, in order to install Pygments with optimal plugin support even for old Python versions, you should do:

pip install pygments[plugins]

Pygments still falls back on pkg_resources if neither importlib.metadata nor importlib_metadata is found, but it will be slower.

Silently ignore BrokenPipeError in the command-line interface (#2193).

The HtmlFormatter now uses the linespans attribute for anchorlinenos if the lineanchors attribute is unset (#2026).

The highlight, lex and format functions no longer wrongly report "argument must be a lexer/formatter instance, not a class" in some cases where this is not the actual problem (#2123).

Fix warnings in doc build (#2124).

The codetagify filter now recognizes FIXME tags by default (#2150).

The pygmentize command now recognizes if the COLORTERM environment variable is set to a value indicating that true-color support is available. In that case, it uses the TerminalTrueColorFormatter by default (#2160)

Remove redundant caches for filename patterns (#2153)

Use new non-deprecated Pillow API for text bounding box in ImageFormatter
(#2198)

Remove default_style (#930, #2183)

Stop treating DeprecationWarnings as errors in the unit tests (#2196)