2021-06-20 03:20:56 +00:00
# Terminals
Notcurses attempts to provide an abstraction layer over the highly varied
world of terminals. First and foremost, Notcurses needs to know the terminal
on which it is running, so that has an accurate understanding of its
capabilities.
It is of course possible that Notcurses is not connected to an actual
terminal (e.g. when running daemonized). In such a case, many escapes
will not be emitted, and no querying is performed.
Notcurses determines terminal capabilities via a combination of (more-or-less)
standardized queries sent to the terminal, the `TERM` environment variable
used by `terminfo(5)` , and the `COLORTERM` environment variable.
## Queries
At startup, the Linux console is identified via `ioctl(2)` s specific it.
Otherwise, if it is determined that the process is connected to a terminal
(see `isatty(3)` ), Notcurses writes a series of queries to it. Several are
related to terminal identification:
2021-07-31 10:54:00 +00:00
* Send Tertiary Device Attributes (`CSI = c`)
2021-06-20 03:20:56 +00:00
* Identifies VTE and foot
2021-07-31 10:54:00 +00:00
* Send Secondary Device Attributes (`CSI > c`)
* Identifies Alacritty's version number
2021-06-20 03:20:56 +00:00
* `XTVERSION` (`CSI > 0 q`)
* Identifies XTerm, WezTerm, and Contour
* `XTGETTCAP` for the `TN` key (`DCS + q 544e ST`)
* Identifies Kitty and MLterm
* Send Primary Device Attributes (`CSI c`)
2021-07-31 10:54:00 +00:00
No terminals requiring special handling identify themselves via Primary Device
Attributes, but we send this because all known terminals respond to it with
*something*, preventing us from hanging, waiting for input (**if a terminal does
*not* reply in a recognizable way to Primary Device Attributes,
`notcurses_init()` will hang**).
2021-06-20 03:20:56 +00:00
Even if the terminal responds unambiguously to one of these queries, Notcurses
must have code to recognize the response, and bind it to some terminal
definition. Assuming the terminal to be thus identified, Notcurses enables or
disables certain capabilities based on built-in knowledge.
2021-07-31 10:54:00 +00:00
Terminal.App exports `TERM_PROGRAM=Apple_Terminal` .
2021-06-20 03:20:56 +00:00
## The `COLORTERM` environment variable
24-bit RGB for glyphs and cell backgrounds is fairly widely implemented. In
the Terminfo database, this is indicated via the `rgb` capability. It is
not uncommon for this capability to not be expressed, despite support being
present. Defining the `COLORTERM` environment variable with the value `24bit`
will instruct Notcurses to issue RGB sequences regardless.
## Terminfo and `TERM`
Even if the terminal is unambiguously determined via query, many capabilities
are acquired from the `terminfo(5)` database, keyed by the `TERM` environment
variable. It is critical that the `TERM` environment variable be correct for
your shell, and that the terminfo database entry keyed by this variable be
up-to-date.
2020-07-08 05:13:58 +00:00
The following have been established on a Debian Unstable workstation.
2021-01-16 23:10:32 +00:00
`ccc` is the Terminfo can-change-colors capability. "Blocks" refers to whether
the terminal provides its own implementation of block-drawing characters, or
relies on the font. Patches to correct/complete this table are very welcome!
2020-07-08 05:13:58 +00:00
2021-03-10 01:07:39 +00:00
| Terminal | Pixel `TIOCGWINSZ` | `ccc` | Blocks | Recommended environment | Notes |
| --------------- | ------------------ | ----- | ------ | ----------------------- | ----- |
2021-07-06 08:29:25 +00:00
| [Alacritty ](https://github.com/alacritty/alacritty ) | ✅ | ✅ |❌ |`TERM=alacritty` `COLORTERM=24bit` | [Sixel support WIP ](https://github.com/ayosec/alacritty/tree/graphics ) |
2021-11-25 23:58:37 +00:00
| [cool-retro-term ](https://github.com/Swordfish90/cool-retro-term ) | ❌ | ❌ |✅ | `TERM=xterm-256color` `COLORTERM=24bit` | Accepts RGB. No `initc` despite claiming to be XTerm. |
2021-10-28 19:44:30 +00:00
| [Contour ](https://github.com/christianparpart/contour ) | ✅ | ✅ |✅ |`TERM=contour` | Sixel support. |
2021-05-26 05:17:43 +00:00
| [ETerm ](https://github.com/mej/Eterm ) | | | | `TERM=Eterm` | Doesn't reply to Send Device Attributes |
2021-07-06 08:29:25 +00:00
| [FBterm ](https://github.com/zhangyuanwei/fbterm ) | ❌ | ? |? |`TERM=fbterm` | 256 colors, no RGB color. |
2021-03-29 01:32:08 +00:00
| [foot ](https://codeberg.org/dnkl/foot ) | ✅ | ✅ |✅ |`TERM=foot` | Sixel support. |
2021-07-06 08:29:25 +00:00
| [Gnome Terminal ](https://gitlab.gnome.org/GNOME/gnome-terminal ) |❌ | ❌ |✅ |`TERM=gnome` `COLORTERM=24bit` | `ccc` support *is* available when run with `vte-256color` . |
2021-03-14 09:48:15 +00:00
| [Guake ](https://github.com/Guake/guake ) | | ? |? | | |
2021-10-20 07:49:09 +00:00
| [iTerm2 ](https://github.com/gnachman/iTerm2 ) | ✅ | ✅ |✅ |`TERM=iterm2` | |
2021-07-16 19:12:29 +00:00
| [Kitty ](https://github.com/kovidgoyal/kitty ) | ✅ | ✅ |✅ |`TERM=xterm-kitty` | See below. |
2021-08-11 00:21:29 +00:00
| [kmscon ](https://github.com/dvdhrm/kmscon ) | | ❌ | ❌ |`TERM=xterm-256color` | No RGB color AFAICT, nor any distinct terminfo entry. No actual `ccc` implementation. Sets `COLORTERM=kmscon` .|
2021-07-06 08:29:25 +00:00
| [Konsole ](https://invent.kde.org/utilities/konsole ) | ❌ | ❌ |? |`TERM=konsole-direct` | |
2021-03-02 06:55:52 +00:00
| Linux console | ❌ | ✅ |see [below ](#the-linux-console ) |`TERM=linux` `COLORTERM=24bit` | 8 (512 glyph fonts) or 16 (256 glyph fonts) colors max, but RGB values are downsampled to a 256-index palette. See below. |
2021-10-31 14:38:30 +00:00
| [mintty ](https://github.com/mintty/mintty ) | ✅ | ✅ | ? | `TERM=mintty-direct` | Windows, both old-skool and ConPTY |
2021-07-16 19:25:40 +00:00
| [mlterm ](https://github.com/arakiken/mlterm ) | ✅ | ❌ |? |`TERM=mlterm-256color` | Do not set `COLORTERM` . `mlterm-direct` gives strange results. |
| [PuTTY ](https://www.chiark.greenend.org.uk/~sgtatham/putty/latest.html ) | | ❌ |❌ |`TERM=putty-256color` `COLORTERM=24bit` | |
2021-10-31 14:38:30 +00:00
| [refterm ](https://github.com/cmuratori/refterm.git ) | ? | ? | ? | ? | Windows, ConPTY only |
2021-07-16 19:25:40 +00:00
| rxvt | ✅ | ? |? | | Seems unmaintained; many forks exist. |
| [Sakura ](https://github.com/dabisu/sakura ) | ✅ | ✅ |? |`TERM=vte-256color` `COLORTERM=24bit` | VTE-derived, no terminfo entry. |
| [GNU Screen ](https://www.gnu.org/software/screen/ ) | ✅ | ❌ |n/a |`TERM=screen.OLDTERM` | Must be compiled with `--enable-256color` . `TERM` should typically be `screen.` suffixed by the appropriate `TERM` value for the true connected terminal, e.g. `screen.vte-256color` . See below. |
| [st ("suckless") ](https://st.suckless.org/ ) | ✅ | ✅ |? |`TERM=st-256color` `COLORTERM=24bit` | Many features are maintained as external patches; users often roll their own instance, composing from these patches. |
| [Tabby ](https://github.com/Eugeny/tabby ) | ? | ? | ? | ? | |
2021-07-31 10:49:11 +00:00
| [Terminal.app ](https://en.wikipedia.org/wiki/Terminal_(macOS )) | ✅ | ❌ | ❌ | `TERM=xterm-256color` | No RGB; no `ccc` despite wanting `xterm-256color` . |
2021-07-16 19:25:40 +00:00
| [Terminator ](https://github.com/software-jessies-org/jessies/wiki/Terminatorhttps://github.com/software-jessies-org/jessies/wiki/Terminator ) | ✅ | ? |? | ? | |
2021-08-02 18:43:35 +00:00
| [Terminology ](https://github.com/borisfaure/terminology ) | ❌ | ❌ |✅ | `TERM=terminology` | Identified via DA3. 256 colors, no RGB. |
2021-07-06 08:29:25 +00:00
| [Tilda ](https://github.com/lanoxx/tilda ) | | ? |? | ? | |
| [tmux ](https://github.com/tmux/tmux/wiki ) | ✅ | ❌ |n/a |`TERM=tmux-256color` `COLORTERM=24bit` | `tmux.conf` must apply `Tc` ; see below. `bce` is available with the `tmux-256color-bce` definition. |
2021-07-19 01:59:15 +00:00
| [WezTerm ](https://github.com/wez/wezterm ) | ✅ | ✅ |? |`TERM=wezterm` `COLORTERM=24bit` | See below. |
2021-09-08 08:11:54 +00:00
| [Windows Terminal ](https://github.com/microsoft/terminal )| | ? |? | `TERM=ms-terminal` `COLORTERM=24bit` | Nice [escape docs ](https://docs.microsoft.com/en-us/windows/console/console-virtual-terminal-sequences ).|
2021-03-14 09:48:15 +00:00
| [wterm ](https://github.com/majestrate/wterm ) | | ? |? | ? | |
| [XFCE4 Terminal ](https://gitlab.xfce.org/apps/xfce4-terminal ) | ❌ | ✅ |✅ |`TERM=xfce` `COLORTERM=24bit` | No `xfce-direct` variant exists. |
| [XTerm ](https://invisible-island.net/xterm/xterm.html ) | ✅ | ? |❌ |`TERM=xterm+256color2` `COLORTERM=24bit` | See note about DirectColor. Must configure with `--enable-direct-color` . `TERM=xterm-direct` seems to have the undesirable effect of mapping low RGB values to a palette; I don't yet understand this well. The problem is not seen with the specified configuration. Sixel support when built with `--enable-sixel-graphics` and run in vt340 mode. |
| [Yakuake ](https://github.com/KDE/yakuake ) | | ? |? | ? | |
2020-07-12 06:55:48 +00:00
2020-10-17 02:07:07 +00:00
Note that `xfce4-terminal` , `gnome-terminal` , etc. are essentially skinning
2021-07-31 15:30:32 +00:00
atop the common GNOME [VTE ("Virtual TErminal") ](https://gitlab.gnome.org/GNOME/vte ) library.
2020-07-19 00:35:58 +00:00
2021-06-20 03:20:56 +00:00
### Kitty
2020-12-22 00:38:32 +00:00
Kitty has some interesting, atypical behaviors. Foremost among these is that
an RGB background color equivalent to the configured default background color
will be rendered as the default background. This means, for instance, that if
the configured default background color is RGB(0, 0, 0), and is translucent,
2021-10-28 19:51:23 +00:00
a background of RGB(0, 0, 0) will be translucent. To work around this, we
detect the default background color if possible, and when we have done so *and*
verified that the terminal is Kitty *and* we would write this as RGB, we alter
one of the colors by 1. See https://github.com/kovidgoyal/kitty/issues/3185 and
2021-05-26 05:19:20 +00:00
https://github.com/dankamongmen/notcurses/issues/1117.
2020-12-22 00:38:32 +00:00
2021-01-16 23:10:32 +00:00
Kitty is furthermore the only terminal I know to lack the `bce` (Background
2021-10-28 19:51:23 +00:00
Color Erase) capability, but Notcurses never relies on `bce` behavior, and
goes to some lengths to avoid triggering it.
2020-12-22 00:38:32 +00:00
2021-09-04 20:56:01 +00:00
Kitty has introduced an unambiguous [keyboard protocol ](https://sw.kovidgoyal.net/kitty/keyboard-protocol/ ).
Notcurses supports this protocol when it is detected.
2021-10-28 19:51:23 +00:00
The Kitty [graphics protocol ](https://sw.kovidgoyal.net/kitty/graphics-protocol/ )
is superior in just about every way (save breadth of support) to Sixel.
2021-07-19 01:59:15 +00:00
### WezTerm
2021-03-29 01:32:08 +00:00
2021-07-19 01:59:15 +00:00
WezTerm [implements ](https://wezfurlong.org/wezterm/escape-sequences.html ) some
2021-10-28 19:51:23 +00:00
interesting underline options, and both the Sixel and Kitty graphic protocols
(I think it even handles iTerm2).
2021-03-29 01:32:08 +00:00
2021-06-20 03:20:56 +00:00
### GNU screen
2020-07-25 22:55:41 +00:00
GNU screen does have 24-bit color support, but only in the 5.X series. Note
that many distributions ship screen 4.X as of 2020. When built with truecolor
support, add `truecolor on` to your `screenrc` , or run it with `--truecolor` .
Attempting to force RGB color in screen 4.X **will not work** .
Add `defutf8 on` to your `screenrc` , or run screen with `-U` , to ensure UTF-8.
2021-06-20 03:20:56 +00:00
### tmux
2021-02-03 08:50:28 +00:00
`tmux` supports 24-bit color through its `Tc` (Truecolor) extension. You'll
need an entry in `tmux.conf` of the form:
`set -ga terminal-overrides ",EXTERNALTERM:Tc"`
Where `EXTERNALTERM` is your `TERM` variable at the time of attachment, e.g.:
`set -ga terminal-overrides ",vte-256color:Tc"`
You'll then need `COLORTERM=24bit` defined within your tmux environment.
2021-10-20 07:49:09 +00:00
### iTerm2
You're recommented to change "Report terminal type" to `iterm2` .
2021-10-20 07:59:19 +00:00
You're recommended to enable "Use Unicode version 9+ widths" under
`Profiles/Text` .
You're recommended to enable the following "Experimental Features":
* REP (Repeat previous character)
* Support variation selector 16 making emoji fullwidth
2021-10-20 07:49:09 +00:00
### mintty
You're recommended to change the default `TERM` to `mintty-direct` .
2021-11-30 14:01:16 +00:00
### Putty
Of the fonts present on Putty 0.76, "Cascadia Mono 10 Regular" is
far superior to the default "Courier New 10". The latter doesn't
support quadrants, and thus the quadblitter and sexblitter are
unavailable on Putty. I recommend setting "ClearType" under
"Appearance→Font Quality".
Be sure "UTF-8" is set under "Remote character set".
DirectColor is available so long as "Allow terminal to use 24-bit color"
is checked under "Appearance→Colours". Ensure "Allow terminal to specify
ANSI colours" and "Allow terminal to use xterm 256-colour mode" are also
checked.
2021-06-20 03:20:56 +00:00
### The Linux console
2020-07-12 06:55:48 +00:00
The Linux console supports concurrent virtual terminals, and is manipulated
by userspace via `ioctl()` s. These `ioctl()` s generally fail when applied to
a pseudotty device, as will happen if e.g. invoked upon one's controlling
terminal whilst running in a terminal emulator under X (it is still generally
possible to use them by explicitly specifying a console device, i.e.
`showconsolefont -C /dev/tty0` ).
The VGA text console requires the kernel option `CONFIG_VGA_CONSOLE` . A
framebuffer console for VESA 2.0 is provided by `CONFIG_FB_VESA` , while
UEFI-compatible systems can use `CONFIG_FB_EFI` . So long as a framebuffer
driver is present, `CONFIG_FRAMEBUFFER_CONSOLE` will enable a graphics-mode
console using the framebuffer device.
The Linux console can be in either text or graphics mode. The mode can be
determined with the `KDGETMODE` `ioctl()` , and changed with `KDSETMODE` ,
using the constants `KD_TEXT` and `KD_GRAPHICS` . Text mode supports a
rectangular matrix of multipixel cells, filled with glyphs from a font,
a foreground color, and a background color. Graphics ("All-Points-Addressable")
mode supports a rectangular matrix of pixels, each with a single color.
Note that both modes require appropriate hardware support (and kernel
configuration options), and might or might not be available on a given
installation. Non-x86 platforms often provide only a framebuffer (graphics)
console.
The kernel text mode loosely corresponds to the 1987 IBM VGA definition. At any
time, the display is configured with a monospace raster font, a palette, and
(when in Unicode mode) a mapping from multibyte sequences to font elements. Up
to 16 colors can be used with a font of 256 glyphs or fewer. Only 8 colors can
be used with fonts having more than 256 glyphs; the maximum font size in any
configuration is 512 glyphs. The keyboard is further configured with a keymap,
mapping keyboard scancodes to elements of the character set. These properties
are per-virtual console, not common to all of them. These limitations are not
typically present on framebuffer consoles.
2020-07-14 03:26:46 +00:00
Exporting `COLORTERM=24bit` and emitting RGB escapes to the Linux console
**does** work, though the RGB values provided are downsampled to a 256-slot
palette. Backgrounds don't seem to have the same degree of flexibility in this
situation as do foregrounds. The output is better, but not as much better as
one might expect. More research is necessary here.
2020-07-12 06:55:48 +00:00
The following more-or-less standard tools exist:
* `showconsolefont` : show the console font
* `setfont` : load console font
* `fbset` : show and modify framebuffer settings
* `fgconsole` : print name of foreground terminal
* `chvt` : change the foreground terminal
* `deallocvt` : destroy a virtual console
* `dumpkeys` : print all keycodes
* `loadkeys` : load scancode/keycode mapping (the keymap)
* `setkeycodes` : load scancode/keycode mappings one at a time
* `showkeys` : interactively print scancodes
* `kbd_mode` : show or set the keyboard mode
Both `mapscrn` and `loadunimap` are obsolete; their functionality is present
in `setfont` .
2020-10-20 02:34:49 +00:00
2021-02-06 19:05:49 +00:00
Note that Notcurses reprograms the console font table when running in the
Linux console (unless `NCOPTION_NO_FONT_CHANGES` is used). This adds support
for half blocks and quadrants.
2021-08-24 08:00:36 +00:00
### Windows Terminal
Ensure UTF-8 is being used for "Administrative language settings"
(see [README.md ](README.md )). Codepage 65001 ought be used.
2021-06-20 14:09:10 +00:00
### 24-bit RGB
2020-10-20 02:34:49 +00:00
Many terminals support one or another form of non-indexed color encoding (also
known as DirectColor, RGB color, 24-bit color, or the similar but distinct
TrueColor), using either the semicolon-based presentation introduced by Konsole
or the colon-delimited presentation specified in ECMA-48 and ITU T.416. The
`rgb` termcap capability indicates support for such encodings via the
`set_a_foreground` and `set_b_foreground` capabilities. Not all terminals
implementing `rgb` use the 3x8bpc model; XTerm for instance:
> for values 0 through 7, it uses the “ANSI” control sequences, while
> for other values, it uses the 3-byte direct-color sequence introduced by Konsole.
> the number of colors is 224 while the number of color pairs is 216
Thus emitting `setaf` with an RGB value close to black can result, when
using `xterm-direct` 's `setaf` and `rgb` definitions, in a bright ANSI color.
2021-01-12 10:07:45 +00:00
2021-07-19 01:59:15 +00:00
24-bit RGB is always enabled for Kitty, Alacritty, Contour, WezTerm, iTerm2,
and foot.
2021-05-14 10:02:06 +00:00
2021-06-20 03:20:56 +00:00
### Problematic characters
2021-01-12 10:07:45 +00:00
Some characters seem to cause problems with one terminal or another. These
are best avoided until the problems are better understood:
* '
2021-10-08 21:18:08 +00:00
* '' U+070F [SYRIAC ABBREVIATION MARK ](https://en.wikipedia.org/wiki/Syriac_Abbreviation_Mark ): puts an
overbar above following characters until a non-Syriac character is found.
* '' U+06DD[ARABIC END OF AYAH](https://scriptsource.org/cms/scripts/page.php?item_id=character_detail_des& key=U0006DD):
bound to up to three digits, which ought be drawn inside.
2021-01-12 10:07:45 +00:00
* '' U+08E2 ARABIC DISPUTED END OF AYAH
* '﷽' U+FDFD ARABIC LIGATURE BISMILLAH AR-RAHMAN AR-RAHEEM
2021-11-09 11:13:01 +00:00
* '⁄ FRACTION SLASH ](https://en.wikipedia.org/wiki/Universal_Character_Set_characters#Fraction_slash )
bound to digits fore and aft
2021-10-06 22:29:58 +00:00
## Notes for terminal authors
The `notcurses-info` tool built as part of Notcurses can be used to inspect
2021-10-28 20:03:27 +00:00
how well your terminal supports Notcurses. It is generally desirable that your
terminal:
* implements `XTVERSION` (no matter your personal philosophical stance).
* implements `XTGETTCAP` (especially for the `rgb` capability).
* uses the communication channel to perform flow control. don't read data more quickly than you can actually display it; you'll end up dropping frames or effecting bufferbloat latency. this wastes work, and moves the drop decision away from the client code.
* draws Unicode's Line- and Box-Drawing characters itself, rather than relying on the font.
* supports some graphics protocol, ideally Kitty's. if you support Sixel instead, please implement `XTSMGRAPHICS` .
* implement a keyboard disambiguation protocol, ideally Kitty's.
* implement `hpa` for cheap absolute horizontal positioning.
* size EGCs according to the largest `wcwidth()` result returned for any of the component characters. draw them all the same size otherwise.
* honor Unicode rules for segmentation, including Zero-Width Joiners. emit either zero or one glyph per EGC.
Without a properly-bracketed Primary Device Attributes reply to my DA1 query,
Notcurses is not going to work on your terminal emulator.
BiDi's gonna be a mess no matter what. Don't stress too much about it.
