Internet DRAFT - draft-abhishek-mmusic-overlay-grouping
draft-abhishek-mmusic-overlay-grouping
mmusic R. Abhishek
Internet-Draft Tencent
Intended status: Standards Track October 27, 2020
Expires: April 30, 2021
SDP Overlay Grouping framework for immersive telepresence media streams
draft-abhishek-mmusic-overlay-grouping-00
Abstract
This document defines semantics that allow for signalling a new SDP
group "OL" for overlays in an immersive telepresence session. The
"OL" attribute can be used by the application to relate all the
overlay media streams enabling them to be added as overlay on top of
the immersive video. The overlay grouping semantics is required, if
the media data is seperate and transported via different protocols.
Status of This Memo
This Internet-Draft is submitted in full conformance with the
provisions of BCP 78 and BCP 79.
Internet-Drafts are working documents of the Internet Engineering
Task Force (IETF). Note that other groups may also distribute
working documents as Internet-Drafts. The list of current Internet-
Drafts is at https://datatracker.ietf.org/drafts/current/.
Internet-Drafts are draft documents valid for a maximum of six months
and may be updated, replaced, or obsoleted by other documents at any
time. It is inappropriate to use Internet-Drafts as reference
material or to cite them other than as "work in progress."
This Internet-Draft will expire on April 30, 2021.
Copyright Notice
Copyright (c) 2020 IETF Trust and the persons identified as the
document authors. All rights reserved.
This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents
(https://trustee.ietf.org/license-info) in effect on the date of
publication of this document. Please review these documents
carefully, as they describe your rights and restrictions with respect
to this document. Code Components extracted from this document must
include Simplified BSD License text as described in Section 4.e of
Abhishek Expires April 30, 2021 [Page 1]
Internet-Draft Overlay Group Semantic October 2020
the Trust Legal Provisions and are provided without warranty as
described in the Simplified BSD License.
Table of Contents
1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 2
2. Contribution and Discussion Venues for this draft . . . . . . 3
3. Terminology . . . . . . . . . . . . . . . . . . . . . . . . . 3
4. Overview of Operation . . . . . . . . . . . . . . . . . . . . 3
5. Overlay Stream Group Identification Attribute . . . . . . . . 4
6. Use of group and mid . . . . . . . . . . . . . . . . . . . . 4
7. Example of OL . . . . . . . . . . . . . . . . . . . . . . . . 5
8. Security Considerations . . . . . . . . . . . . . . . . . . . 5
9. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 6
10. References . . . . . . . . . . . . . . . . . . . . . . . . . 6
10.1. Normative References . . . . . . . . . . . . . . . . . . 7
10.2. Informative References . . . . . . . . . . . . . . . . . 8
Author's Address . . . . . . . . . . . . . . . . . . . . . . . . 8
1. Introduction
Telepresence [RFC7205] can be described as a technology that allows a
person the experience of "being present" at a remote location for
video as well as audio telepresence sessions, so as to enable the
users sense of realism and presence [TS26.223] . SDP [RFC4566] is
being predominantly used for describing the format for multimedia
communication session for telepresence conferencing. These use open
standards such as RTP [RFC3550] and SIP [RFC3261] .
An SDP session may contain more than one media lines with each media
line identified by "m"=line. Each line denotes a single media
stream. If multiple media lines are present in a session, a receiver
needs to identify relationship between those media lines.
Overlay media stream can be defined as a piece of visual media which
can be rendered over an immersive video or image or over a viewport
[ISO23090] . When an overlay is transmitted, its media stream needs
to be uniquely identified across multiple SDP descriptions exchanged
with different receivers so that the streams can be identified in
terms of its role in the session irrespective of its media type and
transport protocol.
In an immersive telepresence session, one media is streamed as an
immersive stream whereas other media streams are overlaid on top of
the immersive video/image. An end user can stream more than one
overlay, subject to its decoding capacity. When multiple overlay
streams are transmitted within a session, the end application upon
receiving, needs to be able to relate the media streams to each
Abhishek Expires April 30, 2021 [Page 2]
Internet-Draft Overlay Group Semantic October 2020
other. This can be achieved by SDP grouping framework by using the
"group" attribute that groups different "m" lines in a session.
However, the current SDP signalling framework does not provide such
grouping semantics for overlays.
This document describes a new SDP group semantics for grouping the
overlays when an immersive media stream is transmitted for
telepresence conferencing. SDP session description consists of one
or multiple media lines know as "m" lines which can be identified by
a token carried in a "mid" attribute. The SDP session describes a
session-level group level attributes that groups different media
lines using a defined group semantics. The semantics defined in this
memo is to be used in conjuction with [RFC5888] titled "The Session
Description Protocol (SDP) Grouping Framework".
2. Contribution and Discussion Venues for this draft
(Note to RFC Editor - if this document ever reaches you, please
remove this section)
Substantial discussion of this document should take place on the
MMUSIC working group mailing list ( mmusic@ietf.org). Subscription
and archive details are at https://www.ietf.org/mailman/listinfo/
mmusic.
3. Terminology
The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT",
"SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this
document are to be interpreted as described in [RFC2119].
4. Overview of Operation
A non-normative description of SDP overlay group semantics is
described in this section. An immersive stream for a telepresence
session may consist of one or more conference rooms with a 360-degree
camera and the remote users using head mounted display for streaming.
"Participant cameras" are used to capture the conference participants
whereas "presentation cameras" or "content cameras" can be used for
document display [RFC7205] . The remote participant can stream any
of the available immersive video in the session as background whereas
other available streams such as the presentation stream or 2D video
from any other room or participant can be used as an overlay on top
of the immersive video/image.
A user with a head mounted display may stream more than one overlay
in a single SDP session. These overlay streams are transmitted via
"m" line in SDP session description. Each "m" line in the session
Abhishek Expires April 30, 2021 [Page 3]
Internet-Draft Overlay Group Semantic October 2020
description is identified by a token carried via the "mid" attribute.
When multiple overlay streams are transmitted within a session, the
end application upon receiving, needs to be able to relate the media
streams to each other. This is achieved by using the SDP grouping
framework [RFC5888]. The session descriptions carries session-level
"group" attribute for the overlays which groups different "m" lines
using overlay(OL) group semantics.
5. Overlay Stream Group Identification Attribute
The "overlay media stream identification" attribute is used to
identify overlay media streams within a session description. In a
overlay group, the media lines MAY have different media contents.
Its formatting in SDP [RFC4566] is described by the following
Augmented Backus-Naur Form (ABNF) [RFC5234] :
mid-attribute = "a=mid:" identification-tag
identification-tag = token
; token is defined in RFC4566
This documents defines a new group semantics "OL" identification
media attribute, which is used to identify overlay group media
streams within a session description. It is used for grouping the
media streams for different overlays together within a session. An
application that receives a session description that contains "m"
lines grouped together using "OL" semantics MUST overlay the
corresponding media streams on top of the immersive media stream.
6. Use of group and mid
All group and mid attributes MUST follow the rules defined in
[RFC5888]. The "mid" attribute should be used for all "m" lines
within a session description . If for any "m" lines within a session,
no "mid" attribute is identified for a session description, the
application MUST NOT perform any media line grouping. If the
identification-tags associated with "a=group" lines do not map to any
"m" lines, it MUST be ignored.
group-attribute ="a=group:" semantics
*(SP identification-tag)
semantics = "OL" / semantics-extension
semantics-extension = token
; token is defined in RFC4566
Abhishek Expires April 30, 2021 [Page 4]
Internet-Draft Overlay Group Semantic October 2020
7. Example of OL
The following two examples show a session description for overlays in
an immersive telepresence conference. The "group" line indicates
that the "m" lines with tokens 1 and 2 are grouped for the purpose of
overlays and intended to be overlaid on top of the immersive video.
In the first example shown below, two overlays are being transmitted.
The first media stream (mid:1) carries the video stream, and the
second stream (mid:2) contains an audio stream.
v=0
o=Alice 292742730 29277831 IN IP4 233.252.0.74
c=IN IP4 233.252.0.79
t=0 0
a=group:OL 1 2
m=video 30000 RTP/AVP 31
a=mid:1
m=audio 30002 RTP/AVP 31
a=mid:2
The second example, below, uses 'content' attribute with the media
streams which are transmitted for overlay purpose.
v=0
o=Alice 292742730 29277831 IN IP4 233.252.0.74
c=IN IP4 233.252.0.79
t=0 0
a=group:OL 1 2
m=video 30000 RTP/AVP 31
a= content:slides
a=mid:1
m=video 30002 RTP/AVP 31
a=content:speaker
a=mid:2
8. Security Considerations
All security considerations as defined in [RFC5888] apply:
Using the "group" parameter with FID semantics, an entity that
managed to modify the session descriptions exchanged between the
participants to establish a multimedia session could force the
participants to send a copy of the media to any destination of its
choosing.
Integrity mechanisms provided by protocols used to exchange session
descriptions and media encryption can be used to prevent this attack.
Abhishek Expires April 30, 2021 [Page 5]
Internet-Draft Overlay Group Semantic October 2020
In SIP, Secure/Multipurpose Internet Mail Extensions (S/MIME)
[RFC8550] and Transport Layer Security (TLS) [RFC8446] can be used to
protect session description exchanges in an end-to-end and a hop-
byhop fashion, respectively.
9. IANA Considerations
The following contact information shall be used for all registrations
included here:
Contact: Rohit Abhishek
email: rabhishek@rabhishek.com
tel : +1-816-585-7500
This document defines a new SDP group semantics for overlays for a
immersive telepresence session. This attribute can be used by the
application to group all the overlays in a session. Semantics values
to be used with this framework should be registered by the IANA
following the Standards Action policy [RFC8126]. This document adds
a new group semantics and follows the registry group defined in
[RFC5888].
The following semantics needs to be registered by IANA in Semantics
for the "group" SDP Attribute under SDP Parameters.
Semantics Token Reference
----------------------------------------------
Overlay OL RFCXXXX
The "OL" attribute is used to group different media streams to be
rendered as overlays. Its format is defined in Section 5 .
The IANA Considerations section of the RFC MUST include the following
information, which appears in the IANA registry along with the RFC
number of the publication.
o A brief description of the semantics.
o Token to be used within the "group" attribute. This token may be
of any length, but SHOULD be no more than four characters long.
o Reference to a standards track RFC.
10. References
Abhishek Expires April 30, 2021 [Page 6]
Internet-Draft Overlay Group Semantic October 2020
10.1. Normative References
[RFC2119] Bradner, S., "Key words for use in RFCs to Indicate
Requirement Levels", BCP 14, RFC 2119,
DOI 10.17487/RFC2119, March 1997,
<https://www.rfc-editor.org/info/rfc2119>.
[RFC3261] Rosenberg, J., Schulzrinne, H., Camarillo, G., Johnston,
A., Peterson, J., Sparks, R., Handley, M., and E.
Schooler, "SIP: Session Initiation Protocol", RFC 3261,
DOI 10.17487/RFC3261, June 2002,
<https://www.rfc-editor.org/info/rfc3261>.
[RFC3550] Schulzrinne, H., Casner, S., Frederick, R., and V.
Jacobson, "RTP: A Transport Protocol for Real-Time
Applications", STD 64, RFC 3550, DOI 10.17487/RFC3550,
July 2003, <https://www.rfc-editor.org/info/rfc3550>.
[RFC4566] Handley, M., Jacobson, V., and C. Perkins, "SDP: Session
Description Protocol", RFC 4566, DOI 10.17487/RFC4566,
July 2006, <https://www.rfc-editor.org/info/rfc4566>.
[RFC5234] Crocker, D., Ed. and P. Overell, "Augmented BNF for Syntax
Specifications: ABNF", STD 68, RFC 5234,
DOI 10.17487/RFC5234, January 2008,
<https://www.rfc-editor.org/info/rfc5234>.
[RFC5888] Camarillo, G. and H. Schulzrinne, "The Session Description
Protocol (SDP) Grouping Framework", RFC 5888,
DOI 10.17487/RFC5888, June 2010,
<https://www.rfc-editor.org/info/rfc5888>.
[RFC8126] Cotton, M., Leiba, B., and T. Narten, "Guidelines for
Writing an IANA Considerations Section in RFCs", BCP 26,
RFC 8126, DOI 10.17487/RFC8126, June 2017,
<https://www.rfc-editor.org/info/rfc8126>.
[RFC8446] Rescorla, E., "The Transport Layer Security (TLS) Protocol
Version 1.3", RFC 8446, DOI 10.17487/RFC8446, August 2018,
<https://www.rfc-editor.org/info/rfc8446>.
[RFC8550] Schaad, J., Ramsdell, B., and S. Turner, "Secure/
Multipurpose Internet Mail Extensions (S/MIME) Version 4.0
Certificate Handling", RFC 8550, DOI 10.17487/RFC8550,
April 2019, <https://www.rfc-editor.org/info/rfc8550>.
Abhishek Expires April 30, 2021 [Page 7]
Internet-Draft Overlay Group Semantic October 2020
10.2. Informative References
[ISO23090]
"Information technology -- Coded representation of
immersive media -- Part 2: Omnidirectional MediA Format
(OMAF) 2nd Edition", ISO ISO 23090-2:2020(E), February
2020.
[RFC7205] Romanow, A., Botzko, S., Duckworth, M., and R. Even, Ed.,
"Use Cases for Telepresence Multistreams", RFC 7205,
DOI 10.17487/RFC7205, April 2014,
<https://www.rfc-editor.org/info/rfc7205>.
[TS26.223]
"3rd Generation Partnership Project; Technical
Specification Group Services and System Aspects;
Telepresence using the IP Multimedia Subsystem (IMS);
Media Handling and Interaction", 3GPP TS26.223, March
2020.
Author's Address
Rohit Abhishek
Tencent
2747 Park Blvd
Palo Alto 94588
USA
Email: rabhishek@rabhishek.com
Abhishek Expires April 30, 2021 [Page 8]
