RFC 5785 PROPOSED STANDARD WEB · URIS · METADATA

Well-Known URIs: Defining Well-Known Uniform Resource Identifiers (URIs)

One reserved path prefix, /.well-known/, so sites can publish site-wide metadata without name collisions.

On rfc-editor.org ↗
PUBLISHED
April 2010
AUTHORS
M. Nottingham, E. Hammer-Lahav
STREAM
IETF
BUILDS ON
RFC 2616 — HTTP/1.1, RFC 2818 — HTTPS
OBSOLETED BY
RFC 8615 — Well-Known URIs
PATH PREFIX
/.well-known/
REGISTRATION POLICY
Specification Required, with Designated Experts
EXPERT REVIEW TIME
14 days
ESCALATE TO IESG AFTER
21 days undetermined
DOI
10.17487/RFC5785
ERRATA
Reported errata

RFC text

Contents
Original text · RFC Editor View on rfc-editor.org ↗
Internet Engineering Task Force (IETF)                     M. Nottingham
Request for Comments: 5785                               E. Hammer-Lahav
Updates: 2616, 2818                                           April 2010
Category: Standards Track
ISSN: 2070-1721


        Defining Well-Known Uniform Resource Identifiers (URIs)

Abstract

   This memo defines a path prefix for "well-known locations",
   "/.well-known/", in selected Uniform Resource Identifier (URI)
   schemes.

Status of This Memo

   This is an Internet Standards Track document.

   This document is a product of the Internet Engineering Task Force
   (IETF).  It represents the consensus of the IETF community.  It has
   received public review and has been approved for publication by the
   Internet Engineering Steering Group (IESG).  Further information on
   Internet Standards is available in Section 2 of RFC 5741.

   Information about the current status of this document, any errata,
   and how to provide feedback on it may be obtained at
   http://www.rfc-editor.org/info/rfc5785.

Copyright Notice

   Copyright (c) 2010 IETF Trust and the persons identified as the
   document authors.  All rights reserved.

   This document is subject to BCP 78 and the IETF Trust's Legal
   Provisions Relating to IETF Documents
   (http://trustee.ietf.org/license-info) in effect on the date of
   publication of this document.  Please review these documents
   carefully, as they describe your rights and restrictions with respect
   to this document.  Code Components extracted from this document must
   include Simplified BSD License text as described in Section 4.e of
   the Trust Legal Provisions and are provided without warranty as
   described in the Simplified BSD License.

Table of Contents

   1.  Introduction  . . . . . . . . . . . . . . . . . . . . . . . . . 2
     1.1.  Appropriate Use of Well-Known URIs  . . . . . . . . . . . . 3
   2.  Notational Conventions  . . . . . . . . . . . . . . . . . . . . 3
   3.  Well-Known URIs . . . . . . . . . . . . . . . . . . . . . . . . 3
   4.  Security Considerations . . . . . . . . . . . . . . . . . . . . 4
   5.  IANA Considerations . . . . . . . . . . . . . . . . . . . . . . 4
     5.1.  The Well-Known URI Registry . . . . . . . . . . . . . . . . 4
       5.1.1.  Registration Template . . . . . . . . . . . . . . . . . 5
   6.  References  . . . . . . . . . . . . . . . . . . . . . . . . . . 5
     6.1.  Normative References  . . . . . . . . . . . . . . . . . . . 5
     6.2.  Informative References  . . . . . . . . . . . . . . . . . . 5
   Appendix A.  Acknowledgements . . . . . . . . . . . . . . . . . . . 7
   Appendix B.  Frequently Asked Questions . . . . . . . . . . . . . . 7

1.  Introduction

   It is increasingly common for Web-based protocols to require the
   discovery of policy or other information about a host ("site-wide
   metadata") before making a request.  For example, the Robots
   Exclusion Protocol <http://www.robotstxt.org/> specifies a way for
   automated processes to obtain permission to access resources;
   likewise, the Platform for Privacy Preferences [W3C.REC-P3P-20020416]
   tells user-agents how to discover privacy policy beforehand.

   While there are several ways to access per-resource metadata (e.g.,
   HTTP headers, WebDAV's PROPFIND [RFC4918]), the perceived overhead
   (either in terms of client-perceived latency and/or deployment
   difficulties) associated with them often precludes their use in these
   scenarios.

   When this happens, it is common to designate a "well-known location"
   for such data, so that it can be easily located.  However, this
   approach has the drawback of risking collisions, both with other such
   designated "well-known locations" and with pre-existing resources.

   To address this, this memo defines a path prefix in HTTP(S) URIs for
   these "well-known locations", "/.well-known/".  Future specifications
   that need to define a resource for such site-wide metadata can
   register their use to avoid collisions and minimise impingement upon
   sites' URI space.

1.1.  Appropriate Use of Well-Known URIs

   There are a number of possible ways that applications could use Well-
   known URIs.  However, in keeping with the Architecture of the World-
   Wide Web [W3C.REC-webarch-20041215], well-known URIs are not intended
   for general information retrieval or establishment of large URI
   namespaces on the Web.  Rather, they are designed to facilitate
   discovery of information on a site when it isn't practical to use
   other mechanisms; for example, when discovering policy that needs to
   be evaluated before a resource is accessed, or when using multiple
   round-trips is judged detrimental to performance.

   As such, the well-known URI space was created with the expectation
   that it will be used to make site-wide policy information and other
   metadata available directly (if sufficiently concise), or provide
   references to other URIs that provide such metadata.

2.  Notational Conventions

   The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT",
   "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this
   document are to be interpreted as described in RFC 2119 [RFC2119].

3.  Well-Known URIs

   A well-known URI is a URI [RFC3986] whose path component begins with
   the characters "/.well-known/", and whose scheme is "HTTP", "HTTPS",
   or another scheme that has explicitly been specified to use well-
   known URIs.

   Applications that wish to mint new well-known URIs MUST register
   them, following the procedures in Section 5.1.

   For example, if an application registers the name 'example', the
   corresponding well-known URI on 'http://www.example.com/' would be
   'http://www.example.com/.well-known/example'.

   Registered names MUST conform to the segment-nz production in
   [RFC3986].

   Note that this specification defines neither how to determine the
   authority to use for a particular context, nor the scope of the
   metadata discovered by dereferencing the well-known URI; both should
   be defined by the application itself.

   Typically, a registration will reference a specification that defines
   the format and associated media type to be obtained by dereferencing
   the well-known URI.

   It MAY also contain additional information, such as the syntax of
   additional path components, query strings and/or fragment identifiers
   to be appended to the well-known URI, or protocol-specific details
   (e.g., HTTP [RFC2616] method handling).

   Note that this specification does not define a format or media-type
   for the resource located at "/.well-known/" and clients should not
   expect a resource to exist at that location.

4.  Security Considerations

   This memo does not specify the scope of applicability of metadata or
   policy obtained from a well-known URI, and does not specify how to
   discover a well-known URI for a particular application.  Individual
   applications using this mechanism must define both aspects.

   Applications minting new well-known URIs, as well as administrators
   deploying them, will need to consider several security-related
   issues, including (but not limited to) exposure of sensitive data,
   denial-of-service attacks (in addition to normal load issues), server
   and client authentication, vulnerability to DNS rebinding attacks,
   and attacks where limited access to a server grants the ability to
   affect how well-known URIs are served.

5.  IANA Considerations

5.1.  The Well-Known URI Registry

   This document establishes the well-known URI registry.

   Well-known URIs are registered on the advice of one or more
   Designated Experts (appointed by the IESG or their delegate), with a
   Specification Required (using terminology from [RFC5226]).  However,
   to allow for the allocation of values prior to publication, the
   Designated Expert(s) may approve registration once they are satisfied
   that such a specification will be published.

   Registration requests should be sent to the
   wellknown-uri-review@ietf.org mailing list for review and comment,
   with an appropriate subject (e.g., "Request for well-known URI:
   example").

   Before a period of 14 days has passed, the Designated Expert(s) will
   either approve or deny the registration request, communicating this
   decision both to the review list and to IANA.  Denials should include
   an explanation and, if applicable, suggestions as to how to make the
   request successful.  Registration requests that are undetermined for
   a period longer than 21 days can be brought to the IESG's attention
   (using the iesg@iesg.org mailing list) for resolution.

5.1.1.  Registration Template

   URI suffix:  The name requested for the well-known URI, relative to
      "/.well-known/"; e.g., "example".

   Change controller:  For Standards-Track RFCs, state "IETF".  For
      others, give the name of the responsible party.  Other details
      (e.g., postal address, e-mail address, home page URI) may also be
      included.

   Specification document(s):  Reference to the document that specifies
      the field, preferably including a URI that can be used to retrieve
      a copy of the document.  An indication of the relevant sections
      may also be included, but is not required.

   Related information:  Optionally, citations to additional documents
      containing further relevant information.

6.  References

6.1.  Normative References

   [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate
             Requirement Levels", BCP 14, RFC 2119, March 1997.

   [RFC3986] Berners-Lee, T., Fielding, R., and L.  Masinter, "Uniform
             Resource Identifier (URI): Generic Syntax", STD 66,
             RFC 3986, January 2005.

   [RFC5226] Narten, T. and H. Alvestrand, "Guidelines for Writing an
             IANA Considerations Section in RFCs", BCP 26, RFC 5226,
             May 2008.

6.2.  Informative References

   [RFC2616] Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter,
             L., Leach, P., and T. Berners-Lee, "Hypertext Transfer
             Protocol -- HTTP/1.1", RFC 2616, June 1999.

   [RFC4918] Dusseault, L., "HTTP Extensions for Web Distributed
             Authoring and Versioning (WebDAV)", RFC 4918, June 2007.

   [W3C.REC-P3P-20020416]
             Marchiori, M., "The Platform for Privacy Preferences 1.0
             (P3P1.0) Specification", World Wide Web Consortium
             Recommendation REC-P3P-20020416, April 2002,
             <http://www.w3.org/TR/2002/ REC-P3P-20020416>.

   [W3C.REC-webarch-20041215]
             Jacobs, I. and N. Walsh, "Architecture of the World Wide
             Web, Volume One", World Wide Web Consortium
             Recommendation REC- webarch-20041215, December 2004,
             <http:// www.w3.org/TR/2004/REC-webarch-20041215>.

Appendix A.  Acknowledgements

   We would like to acknowledge the contributions of everyone who
   provided feedback and use cases for this document; in particular,
   Phil Archer, Dirk Balfanz, Adam Barth, Tim Bray, Brian Eaton, Brad
   Fitzpatrick, Joe Gregorio, Paul Hoffman, Barry Leiba, Ashok Malhotra,
   Breno de Medeiros, John Panzer, and Drummond Reed.  However, they are
   not responsible for errors and omissions.

Appendix B.  Frequently Asked Questions

   1. Aren't well-known locations bad for the Web?

      They are, but for various reasons -- both technical and social --
      they are commonly used and their use is increasing.  This memo
      defines a "sandbox" for them, to reduce the risks of collision and
      to minimise the impact upon pre-existing URIs on sites.

   2. Why /.well-known?

      It's short, descriptive, and according to search indices, not
      widely used.

   3. What impact does this have on existing mechanisms, such as P3P and
      robots.txt?

      None, until they choose to use this mechanism.

   4. Why aren't per-directory well-known locations defined?

      Allowing every URI path segment to have a well-known location
      (e.g., "/images/.well-known/") would increase the risks of
      colliding with a pre-existing URI on a site, and generally these
      solutions are found not to scale well, because they're too
      "chatty".

Authors' Addresses

   Mark Nottingham

   EMail: mnot@mnot.net
   URI:   http://www.mnot.net/


   Eran Hammer-Lahav

   EMail: eran@hueniverse.com
   URI:   http://hueniverse.com/

AI ELI5

On this page
PROBLEMMore and more Web protocols need to find site-wide policy or metadata before making a request, and ad hoc fixed locations risk colliding with each other and with existing resources.
MECHANISMThe RFC reserves the path prefix /.well-known/ in HTTP and HTTPS URIs, and creates an IANA registry where each new name under that prefix must be registered.
STATUS TODAYApplications get predictable, collision-free locations for site-wide metadata. RFC 5785 was obsoleted by RFC 8615.

§1The Problem with Ad Hoc Locations

Web-based protocols often need to discover policy or other information about a host, called site-wide metadata, before making a request. The RFC gives the Robots Exclusion Protocol and the Platform for Privacy Preferences as examples. Per-resource mechanisms such as HTTP headers or WebDAV's PROPFIND exist, but their perceived overhead in latency or deployment difficulty often rules them out.

So it is common to pick a fixed, "well-known location" for the data. That has a drawback: collisions with other such locations and with resources that already exist on the site. This memo addresses it by defining one path prefix, /.well-known/, for these locations.

If every program picks its own secret spot on a website, two programs may pick the same one. One agreed spot, with a list, avoids the mix-ups.

§2What a Well-Known URI Is

A well-known URI is a URI whose path begins with /.well-known/ and whose scheme is HTTP, HTTPS, or another scheme that has explicitly been specified to use well-known URIs. Applications that want a new well-known URI must register it. If an application registers the name example, the URI on http://www.example.com/ is http://www.example.com/.well-known/example. Registered names must conform to the segment-nz production in RFC 3986.

The RFC leaves a lot to each application. It defines neither how to determine the authority to use nor the scope of the metadata, and no format or media type exists for /.well-known/ itself; clients should not expect a resource there. A registration typically references a specification of the format and media type, and may add details such as extra path components, query strings or HTTP method handling.

The intended use is narrow. Well-known URIs are not for general information retrieval or for building large URI namespaces. They suit cases such as policy that must be evaluated before accessing a resource, or where several round trips would hurt performance.

Websites keep their special notes in a folder with a fixed name. The folder itself is not a note, and only things on the official list may go in it.

§3The Well-Known URI Registry

The memo establishes the well-known URI registry. Names are registered on the advice of one or more Designated Experts appointed by the IESG, under Specification Required. Experts may approve before the specification is published once they are satisfied that it will be.

Requests go to a review mailing list. Within 14 days the experts approve or deny, and denials should explain why and suggest fixes. Requests undetermined for longer than 21 days can be brought to the IESG's attention.

The registration template has four parts: the URI suffix (relative to /.well-known/), the change controller, the specification documents, and optional related information. For Standards Track RFCs the change controller is IETF.

To put something in the special folder, you fill in a short form. A few experts look at it and usually answer within two weeks.

§4Security Considerations and FAQ

The memo does not say how far metadata from a well-known URI applies, nor how to discover a well-known URI for an application; each application must define both. Those minting new URIs and the administrators deploying them should consider exposure of sensitive data, denial-of-service attacks, server and client authentication, DNS rebinding, and attacks where limited access to a server lets someone affect how well-known URIs are served.

The appendix FAQ admits that well-known locations are bad for the Web, but says they are commonly used for technical and social reasons, so the memo defines a "sandbox" for them. The name /.well-known was chosen because it is short, descriptive and not widely used. Per-directory locations such as /images/.well-known/ were rejected because they would raise collision risks and are too "chatty". Existing mechanisms such as P3P and robots.txt are unaffected until they choose to use it.

The special folder is a convenience, not a safe. Each program that uses it has to think about who could read or tamper with what is inside.

§5References