Authors: Olof Hagsand, Kjell Hanson and Ian Marsh (SICS)
Venue: IEEE Global Telecommunications Conference (Globecom '99), Rio de Janeiro, December 1999, pp. 1838–1842
DOI: 10.1109/GLOCOM.1999.832479
Year: 1999
Topic: Real time voice (over IP)
Paper (IEEE Xplore) · VoIP project overview
Summary
In 1999, Internet telephony was new and its users were demanding good audio. Quality depends heavily on the instantaneous network conditions, and there was little data on what those were between real sites. This paper describes:
- a scheme for measuring network connections the way a voice call experiences them, by sending test calls and logging every packet;
- a motivation for a new metric when assessing quality, beyond average loss and delay;
- results from a wide range of geographically distributed sites, useful to users, operators and developers of VoIP applications.
The verdict, under the subtitle "where are we today?": Internet telephony is feasible on today's Internet, but problems should be expected if the Internet continues to grow at the rate it has so far.

Why a new metric?
Averages hide what callers hear. A call with 2% loss spread evenly sounds very different from one with the same loss in bursts, and the same mean delay can come with very different jitter. Measuring the distribution and structure of loss and delay, how often packets are lost in a row and how often they arrive too late to play, gets closer to perceived quality. Later work in the group modelled exactly these aspects: packet arrival processes and loss burstiness with PESQ.
Discussion
Looking back, the warning about growth was well founded, and the solution came from two directions. Capacity grew enormously, so most paths became good enough for voice. And applications got much better at coping: adaptive jitter buffers, loss concealment, and codecs such as Opus. Today's global voice and video calling runs mostly over the plain Internet, with no special network support, as this paper hoped.
This paper started a line of work: the 2002 measurement infrastructure repeated it on a larger scale, the QoFIS 2003 paper compared the two campaigns, and the Sicsophone tool came from the observation that end systems added more delay than many networks.
Future work
From the paper and the work that followed:
- More sites and continuous measurement.
- Measures that track perceived quality, not just network statistics.
- Attention to the end systems, whose delay was often larger than the network's.
The EU perspective
- In 1999 the EU was liberalising telecoms, and the Commission's question was whether Internet telephony was "voice telephony" to be regulated as such. Its 1998 and 2000 notices concluded that it generally was not, because it was not yet of comparable quality and reliability. Quality measurements like these were the evidence in that debate.
- The 2002 regulatory framework and then the European Electronic Communications Code (Directive (EU) 2018/1972) settled it: VoIP services that use phone numbers are regulated like telephony, and app-based calling became a "number-independent interpersonal communications service".
- Today all European mobile and fixed voice is moving onto IP, with 2G/3G and copper switch-offs, and the Gigabit Infrastructure Act (EU) 2024/1309 accelerates the networks it runs on.
References
- O. Hagsand, K. Hanson and I. Marsh, "Measuring Internet telephony quality: where are we today?," IEEE Globecom, 1999, pp. 1838–1842.
- J.-C. Bolot, "End-to-end packet delay and loss behavior in the Internet," ACM SIGCOMM, 1993.
- M. S. Borella, D. Swider, S. Uludag and G. B. Brewster, "Internet packet loss: measurement and implications for end-to-end QoS," ICPP Workshops, 1998.
- European Commission, Status of voice on the Internet under Community law, notice, OJ C 6, 10 January 1998; and the 2000 update, OJ C 369, 22 December 2000.
- ITU-T Recommendation G.114, One-way transmission time.
Citation
Olof Hagsand, Kjell Hanson and Ian Marsh, Measuring Internet Telephony Quality: Where are we today?, IEEE Globecom, 1999, Paper.
BibTeX
@inproceedings{hagsand1999measuring,
author = {Hagsand, Olof and Hanson, Kjell and Marsh, Ian},
title = {Measuring {Internet} telephony quality: where are we today?},
booktitle = {IEEE Global Telecommunications Conference (GLOBECOM)},
pages = {1838--1842},
year = {1999},
doi = {10.1109/GLOCOM.1999.832479}
}
More in Real time voice (over IP): ← Dimensioning Links for IP Telephony