RFC 735 PROPOSED STANDARD TELNET · OPTIONS

Revised Telnet byte macro option

A Telnet option that lets one side define a single byte as shorthand for a longer string.

On rfc-editor.org ↗
PUBLISHED
November 1977
AUTHORS
D. Crocker, R.H. Gumpertz
STREAM
Legacy
BUILDS ON
RFC 729 — Telnet byte macro option
OPTION CODE
BM 19
MINIMUM SUBCOMMAND OVERHEAD
5 characters
CANNOT BE A MACRO BYTE
IAC (decimal 255)
DOI
10.17487/RFC0735

RFC text

Contents
Original text · RFC Editor View on rfc-editor.org ↗
RFC 735                                          DHC RHG  3 Nov 77 42083
Telnet Byte Macro Option



Network Working Group                                   David H. Crocker
RFC: #735                                                       Rand-ISD
NIC: #42083                                      (Dcrocker at Rand-Unix)
                                                     Richard H. Gumpertz
                                              Carnegie-Mellon University
                                                   (Gumpertz at CMU-10A)

Obsoletes: RFC #729 (NIC #40306)                         3 November 1977

                    Revised TELNET Byte Macro Option

1. Command name and code:

   BM 19

2. Command Meanings:

   IAC WILL BM

      The sender of this command REQUESTS or AGREES to use the BM
      option, and will send single data characters which are to be
      interpreted as if replacement data strings had been sent.

   IAC WON'T BM

      The sender of this option REFUSES to send single data characters
      which are to be interpreted as if replacement data strings had
      been sent. Any existing BM <macro byte> definitions are discarded
      (i.e., reset to their original data interpretations).

   IAC DO BM

      The sender REQUESTS or AGREES to have the other side (sender of
      WILL BM) send single data characters which are to be interpreted
      as if replacement data strings had been sent.

   IAC DON'T BM

      The sender REFUSES to allow the other side to send single data
      characters which are to be interpreted as if replacement data
      strings had been sent. Any existing BM <macro byte> definitions
      are to be discarded.

Telnet Byte Macro Option



   IAC SB BM <DEFINE> <macro byte> <count>
                                             <replacement string> IAC SE

      where:

         <macro byte> is the data byte actually to be sent across the
         network; it may NOT be Telnet IAC (decimal 255, but may be any
         other 8-bit character.

         <count> is one 8-bit byte binary number, indicating how many
         <replacement string> characters follow, up to the ending IAC
         SE, but not including it. Note that doubled IACs in the
         definition should only be counted as one character per pair.

         <replacement string> is a string of zero or more Telnet ASCII
         characters and/or commands, which the <macro byte> is to
         represent; any character may occur within a <replacement
         string>. Note, however, that an IAC in the string must be
         doubled, to be interpreted later as an IAC; to be interpreted
         later as data byte 255, it must be quadrupled in the original
         <replacement string> specification.

      The indicated <macro byte> will be sent instead of the indicated
      <replacement string>. The receiver of the <macro byte> (the sender
      of the DO BM) is to behave EXACTLY as if the <replacement string>
      string of bytes had instead been received from the network. This
      interpretation is to occur before any other Telnet
      interpretations, unless the <macro byte> occurs as part of a
      Telnet command; in this case no special interpretation is to be
      made. In particular, an entire Telnet subnegotiation (i.e. from
      IAC SB through IAC SE) is to be considered a Telnet command in
      which NO replacement should be done.

      The effect of a particular <macro byte> may be negated by reseting
      it to "expand" into itself.

      IAC SB BM <DEFINE> X <0> IAC SE may be used to cause X to be
      ignored in the data stream.

      <DEFINE> is decimal 1.

   IAC SB BM <ACCEPT> <macro byte> IAC SE

      The receiver of the <DEFINE> for <macro byte> accepts the
      requested definition and will perform the indicated replacement
      whenever a <macro byte> is received and is not part of any IAC
      Telnet command sequence.

Telnet Byte Macro Option



      <ACCEPT> is decimal 2.

   IAC SB BM <REFUSE> <macro byte> <REASON> IAC SE

      The receiver of the <DEFINE> for <macro byte> refuses to perform
      the indicated translation from <macro byte> to <replacement
      string> because the particular <macro byte> is not an acceptable
      choice, the length of the <replacement string> exceeds available
      storage, the length of the actual <replacement string> did not
      match the length predicted in the <count>, or for some unspecified
      reason.

      <REFUSE> is decimal 3.

      <REASON> may be

         <BAD-CHOICE>        which is decimal 1;

         <TOO-LONG>          (for receiver's storage) which is decimal
                             2;

         <WRONG-LENGTH>      (of actual string compared with promised
                             length in <count>) which is decimal 3; or

         <OTHER-REASON>      (intended for use only until this document
                             can be updated to include reasons not
                             anticipated by the authors) which is
                             decimal zero (0).

   IAC SB BM <LITERAL> <macro byte> IAC SE

      The <macro byte> is to be treated as real data, rather than as
      representative of the <replacement string>

      Note that this subcommand cannot be used during Telnet
      subcommands, since subcommands are defined to end with the next
      occurrence of "IAC SE". Including this BM subcommand within any
      Telnet subcommand would therefore prematurely terminate the
      containing subcommand.

      <LITERAL> is decimal 4.

   IAC SB BM <PLEASE CANCEL> <macro byte> <REASON> IAC SE

      The RECEIVER of the defined <macro byte> (i.e., the sender of IAC
      DO BM) requests the sender of <macro byte> to cancel its
      definition. <REASON> is the same as for the <REFUSE> subcommand.

Telnet Byte Macro Option



      The <macro byte> sender should (but is not required to) respond by
      resetting <macro byte> (i.e., sending an IAC SB BM <DEFINE> <macro
      byte> <1> <macro byte> IAC SE).

      If the receiver absolutely insists on cancelling a given macro,
      the best it can do is to turn off the entire option, with IAC DONT
      BM, wait for an acknowledging IAC WONT BM and then restart the
      option, with IAC DO BM. This will reset all other macroes as well
      but it will allow the receiver to REFUSE with code BAD CHOICE
      if/when the foreign site attempts to redefine the macro in
      question.

3. Default:

   WON'T BM -- DON'T BM

      No reinterpretation of data bytes is done.

4. Motivation for the option:

   Subcommands for Telnet options currently require a minimum of five
   characters to be sent over the network (i.e., IAC SB <Option name>
   IAC SE). For subcommands which are employed infrequently, in absolute
   numbers and in relation to normal data, this overhead is tolerable.
   In other cases, however, it is not. For example, data which is sent
   in a block- oriented fashion may need a "block separator" mark. If
   blocks are commonly as small as five or ten bytes, then most of the
   cross-net data will be control information. The BM option is intended
   as a simple data compression technique, to remove this overhead from
   the communication channel.

5. Description of the option

   The option is enabled through the standard Telnet Option negotiation
   process. Afterwards, the SENDER of data (the side which sends the IAC
   WILL BM) is free to define and use mappings between single and
   replacement NVT characters. Except for the ability to refuse
   particular definitions, the receiver of data has no control over the
   definition and use of mappings.

   The sender (of the WILL BM) is prohibited from using or redefining a
   <macro byte> until it has received an <ACCEPT> <REFUSE>, or DONT BM,
   in reply to a <DEFINE>.

   NOTE: The Telnet command character IAC (decimal 255) may be a member
   of a <replacement string> but is the ONLY character which may NOT be
   defined as a <macro byte>.

Telnet Byte Macro Option



   Within any Telnet command (i.e., any sequence beginning with IAC)
   macro replacement may NOT take place. Data are to be interpreted only
   as their normal character values. This avoids the problem of
   distinguishing between a character which is to be taken as a <macro
   byte>, and interpreted as its corresponding <replacement string>, and
   one which is to be taken as its usual Telnet NVT value. In all other
   cases, however, <macro byte>s are to be interpreted immediately, as
   if their corresponding <replacement string>s had actually been sent
   across the network. Expanded strings are not subject to
   reinterpretation, so that recursive definitions cannot be made.
   Telnet commands may be included in <replacement strings>; however,
   they must be totally contained within the macro or must begin within
   the macro and terminate outside of it. In particular, they may NOT
   begin outside a macro and continue or terminate inside one, since no
   macro replacement takes place while processing any Telnet command.

   Note that when skipping data due to Telnet SYNCH (INS/DM) processing,
   BM macro replacement should still take place, since (for example)
   "IAC DM" would be a valid <replacement string>.

   The <count> in the <DEFINE> subcommand is intended to allow the
   receiver to allocate storage. IAC interpretation is not over-ridden
   during BM subcommands so that IAC SE will continue to safely
   terminate malformed subcommands.

   The BM option is notably inefficient with regard to problems during
   <macro byte> definition and use of <macro byte>s as real data. It is
   expected that relatively few <macro byte>s will be defined and that
   they will represent relatively short strings. Since the Telnet data
   space between decimal 128 and decimal 254 is not normally used,
   except by implementations employing the original (obsolete) Telnet
   protocol, it is recommended that <macro byte>s normally be drawn from
   that pool.

AI ELI5

On this page
PROBLEMTelnet subcommands cost at least five bytes each, which is too much overhead when data comes in tiny blocks that each need a separator mark.
MECHANISMAfter negotiating the BM option (code 19), the sending side defines single macro bytes that stand for replacement strings. The receiver expands each macro byte as if the full string had arrived.
WHY IT MATTERSIt works as a simple form of data compression. RFC 735 revises and obsoletes RFC 729.

§1Why Byte Macros

Telnet subcommands need at least five characters on the network (IAC SB, the option name, IAC SE). That is tolerable for rare subcommands, but not for block-oriented data that needs a block separator. If blocks are only five or ten bytes, most of the traffic would be control information.

The BM (byte macro) option, command code 19, is intended as a simple data compression technique that removes this overhead.

If every tiny message needs a long label, the labels end up bigger than the messages. A shortcut makes the label tiny.

§2Negotiating the Option

The option is enabled through the standard Telnet option negotiation. IAC WILL BM offers to send single data characters that stand for replacement strings, and IAC DO BM agrees to receive them. WON'T BM or DON'T BM refuses and discards any existing macro definitions. The default is WON'T BM and DON'T BM, with no reinterpretation of data bytes.

The side that sent WILL BM is free to define and use mappings. Apart from refusing particular definitions, the receiver has no control over them.

First both sides say "yes, let's use shortcuts." If either says no, everyone goes back to sending every word in full.

§3Defining and Using Macros

A sender defines a macro with IAC SB BM DEFINE macro-byte count replacement-string IAC SE. The macro byte may be any 8-bit value except IAC (decimal 255). The receiver answers with ACCEPT or REFUSE plus a reason, and the sender must not use or redefine that byte until it has an answer. Later the macro byte is sent instead of the string, and the receiver must behave exactly as if the string had been received.

No replacement happens inside a Telnet command, and expanded strings are not reinterpreted, so recursive definitions cannot be made. LITERAL marks a macro byte as real data, and PLEASE CANCEL lets the receiver ask the sender to cancel a definition. The RFC recommends choosing macro bytes from the range between decimal 128 and decimal 254, which is not normally used.

You announce "this one symbol means that whole phrase." The listener says OK or no thanks. After that, each time they see the symbol they read the whole phrase.

BM SUBCOMMANDS (RFC 735)
  • 1DEFINE — Sender defines a macro byte, a count and its replacement string.
  • 2ACCEPT — Receiver accepts the definition.
  • 3REFUSE — Receiver refuses, with a reason code.
  • 4LITERAL — Treat the macro byte as real data.