Post #196,980
3/3/05 1:38:39 AM
|
Here's as good as anywhere, questioning Metcalfe's Law
Metcalfe's law is widely quoted. It is the claim that the value of a network scales as the square of the number of people in that network. In this paper a couple of yahoos question this estimate and argue for a much more modest n log(n) estimate.
Feedback appreciated.
[link|http://www.dtc.umn.edu/~odlyzko/doc/metcalfe.pdf|http://www.dtc.umn.e.../doc/metcalfe.pdf]
Cheers, Ben
I have come to believe that idealism without discipline is a quick road to disaster, while discipline without idealism is pointless. -- Aaron Ward (my brother)
|
Post #197,003
3/3/05 9:48:43 AM
|
I stopped at the point where
he talks about the reasons for Metcalfe's law incorrectness. I think his examples actually demonstrate the opposite of what he uses them for. The examples demonstrate that the networks do indeed merge eventually.
More importantly, his logic for "drive to merge" is flawed. Merging is only attractive if the cost of merge is less than certain threshold. In other words, only truly "same" or very close (designed to merge) network technologies offer merge benefits.
--
And what are we doing when the two most powerful nations on earth -- America and Israel -- stomp on the elementary rights of human beings?
-- letter to the editor from W. Ostermeier, Liechtenstein
|
Post #197,008
3/3/05 10:54:49 AM
|
He's not saying what you think
He's not saying that networks don't merge. He's saying that they do - but not nearly as readily as one would predict from the huge incentives predicted by Metcalfe's law.
Note that the networks that he's talking about merging are ones that use identical (or nearly so) technologies. The technical barriers to merging are negligable, yet still they resist merging for long periods of time.
Cheers, Ben
I have come to believe that idealism without discipline is a quick road to disaster, while discipline without idealism is pointless. -- Aaron Ward (my brother)
|
Post #197,022
3/3/05 12:05:32 PM
|
At least two of his examples are wrong
The proprietary networks of Prodigy and all were not at all same technology, except for very small values of "same". Note that none of the networks in question survives on the technolgy it had before the merge - the technology was completely replaced. Let's consider the math: we get 4 times the value for 2 times cost. If we must rip out the implementation of both technologies to merge, the cost just increased two-fold. No gain at all.
Another example is AIM. There, the technology could be called merger-friendly. However, there are two other factors: client-side merge (GAIM, multiple clients) and size difference. When we have non-equal size of merging networks, the gains are not as spectacular as with equal size. Adding 20% of value for 10% cost just doesn't seem as important as quadrupling the value. Moreover, the network in question is not managed by the people who will gain the value, but rather by people who'll incur cost. Interoperability between AIM and Yahoo would not add a single cent of revenue to AOL or Yahoo. And the users voted long ago by installing both Yahoo and AOL clients on their machines.
--
And what are we doing when the two most powerful nations on earth -- America and Israel -- stomp on the elementary rights of human beings?
-- letter to the editor from W. Ostermeier, Liechtenstein
|
Post #197,045
3/3/05 1:57:45 PM
|
Disagreement
I don't believe that building email gateways between the various proprietary networks of Prodigy etc would have been that technically hard to accomplish. It certainly would not have required replacing all of their existing technology.
True, today none of them kept their technologies. But as I understand what happened, the reason was that all of them had to deal with demands to deliver the web in real time - certain a much more demanding infrastructure challenge than email gateways.
But even if we thought that interconnection required rebuilding everything, Metcalfe's Law is still too strong. First of all most businesses run at a profit, and the cost of infrastructure is only one line item on their budgets. Therefore even in the worst case cost scenario, Metcalfe's Law provides enough incentives to justify making the transition because the potential added revenue is equivalent to what they already make.
Furthermore even if businesses cannot see their way to making this choices, the market should swiftly decide. Suppose that one network is 30% larger than another. According to Metcalfe's Law, my value for being on the larger network should be 30% larger than for the other, and so I should have little trouble deciding to switch (even if switching costs are fairly high). Once people start voting with their feet, it doesn't take long to get to a "tipping point" at which the networks merge defacto because everyone switches to the bigger one.
But, I hear you saying, what if I don't want to switch because my friends happen to be on the smaller network? Well then you've demonstrated our fundamental criticism of Metcalfe's Law: not all connections are of equal value. We don't value potential connections to most people very much. We value a small number of them highly. Therefore our value for being a member of a network does not simply scale linearly with the size of the network.
Note that the fact that people should vote with their feet also addresses the AIM situation where the companies making the decision cannot necessarily capture value. Companies make decisions about interoperability and technology. Customers decide where they want to be. The fact that people didn't en masse agree where they wanted to be suggests that network effects aren't as big an incentive as Metcalfe predicts.
And a final point, you're getting hung up on one criticism. Please feel free to leave that saying that you don't agree there, and then proceed to read everything else that's said. There are several lines of argument to similar conclusions, and it may be that you'll find some of them more convincing than others.
Cheers, Ben
I have come to believe that idealism without discipline is a quick road to disaster, while discipline without idealism is pointless. -- Aaron Ward (my brother)
|
Post #197,104
3/3/05 8:49:53 PM
3/3/05 9:11:41 PM
|
One counter-example, and a possible new POV
We don't value potential connections to most people very much. Ever flown to a convention? Was it in a decent-sized city or not? One thing I have noticed living in Cleveland is the almost complete lack of taxis. Sure you can call one, but unless you are at the airport, or at Tower City during morning or evening rush hour, you are not going to just walk out on the sidewalk and flag one down. When organizations are looking for a location to hold their conventions, the ability of attendees to get around factors in. In Cleveland there isn't enough demand for taxis to support heavy coverage, but without the heavy coverage the convention business won't come here. Chicken, meet egg. Closed networks present a similar issue. People won't join them until there are people in them. That's why first-mover advantage is so important building new networks. Now for why Metcalf's Law has an upper boundary: Network effects only hold up while networks are still islands of incompatibility. When you have to choose between incompatible cell phone networks, you want the larger network. Its size is an asset. But which internet do you want to sign up for? Well, there is only one. In theory that should make it wildly valuable. The barrier to start a "new" internet is huge, because no current users would have an incentive to switch.[1] But lack of alternatives is synonymous with lack of competition. So I think the value curve will rise geometrically in comparison to the alternatives. Once a single network has achieved the defacto merger you describe, the value of the alternatives also drops. Once the value of the alternatives drops, your multiplier is less useful. [edit] How can you talk so much about graphs and not have any? While your "law" may model observed trends more closely than Metcalf's, both the law and the explanation of the reasoning require more mathematical knowledge than most people will probably have. As much as it might feel like "dumbing down" your presentation to the USA Today level, some pretty pictures might make it more concrete for people who can't follow the math. [1] Technology being equal.
===
Purveyor of Doc Hope's [link|http://DocHope.com|fresh-baked dog biscuits and pet treats]. [link|http://DocHope.com|http://DocHope.com]
Edited by drewk
March 3, 2005, 09:11:41 PM EST
|
Post #197,217
3/4/05 2:48:17 PM
|
That's not entirely a counterexample
We were trying to analyze communication networks, not conventions. As you noticed, Cleveland cannot hold large conventions because it doesn't have a fundamental requirement for that (a good taxi supply). If you want to draw analogies, that's something like saying that a network that isn't working can't be used.
As to the upper boundary question, there isn't really one. Even if there is only one game in town, the value of the network affects how much people will be willing to pay for it, and how much usage of the network there will be. In other words even once network effects have forced everyone to one standard, there are consequences of the size of network effects.
On why we don't have graphs, that paper is supposed to be headed for an academic publication. It may not be understandable for most people, but it isn't supposed to be either. (Of course I don't think that most people here quite count as most people...)
Cheers, Ben
I have come to believe that idealism without discipline is a quick road to disaster, while discipline without idealism is pointless. -- Aaron Ward (my brother)
|
Post #197,228
3/4/05 3:27:51 PM
|
You got the analogy, but missed the point
... that's something like saying that a network that isn't working can't be used. Right. And the proposed network that can't overcome the barrier to entry can't be used, either. That's what I meant in saying a new internet wouldn't get off the ground. If you could promise people $5/month for high-speed access they'd flock to you in droves. But if the only way to make money at that price is to already be the only game in town, you're not going to build it. Even if there is only one game in town, the value of the network affects how much people will be willing to pay for it, and how much usage of the network there will be. You're using "value" for "utility". The "value" of the network is how much people are willing to pay for it. They don't pay because it's valuable. It's valuable because people are willing to pay. I just thought of another thing. In your explanation of why larger networks want smaller networks to pay when they merge, you used Metcalfe's Law to describe the value of the networks. It would make more sense to use Zipf's Law. If the smaller network has all of the top third most-popular nodes, it will probably be more valuable.
===
Purveyor of Doc Hope's [link|http://DocHope.com|fresh-baked dog biscuits and pet treats]. [link|http://DocHope.com|http://DocHope.com]
|
Post #197,437
3/7/05 4:06:43 AM
|
Chicken and egg on value
You're using "value" for "utility". The "value" of the network is how much people are willing to pay for it. They don't pay because it's valuable. It's valuable because people are willing to pay.
Whenever two parties enter into a reasoned voluntary trade, it is because each values what they are getting more than what they are giving up. To the network owner, the value of the network is what you're being paid. To the network user, the value of the network is what you'd have been willing to pay if you were forced. Those two numbers tend to be different, often substantially so. Vendors would like the gap to be small, and customers want it large.
Metcalfe's Law is about the value that customers perceive, not what vendors get.
In general in a competitive market, the gap tends to be fairly large (in fact economics says that the price should be the marginal cost of the last provider). In a monopoly the gap tends to be much smaller. If Metcalfe's Law holds, then a vendor should be able to dominate a market, and then proceed to jack up prices substantially, trusting to network effects to keep competitors from getting established. So the market should tend towards a monopoly that eventually becomes very profitable.
This plan doesn't seem to work as well in practice as Metcalfe's Law would predict.
As for your comment about where we should use Zipf's law vs Metcalfe's, we didn't use either. We used our own n log(n) law instead. As for whether to use a variation, while it is possible that the smaller network has all of the value, it is highly unlikely in practice. If you disagree, I'd be interested in hearing about specific examples.
Cheers, Ben
I have come to believe that idealism without discipline is a quick road to disaster, while discipline without idealism is pointless. -- Aaron Ward (my brother)
|
Post #197,218
3/4/05 2:48:53 PM
|
OK, I finished reading
I still think that the n^2 rule stands, but we have to define "value". "Value" for whom? As I said before, in the network business, the people paying for the merge and the people reaping benefits are different people. So, the n^2 rule holds for the nodes of network, but it does not work for the network infrastructure owners. I wonder if thew genesis of your n log(n) should be considered. In other words, it may be that the n^2 "ideal" of users is tempered something far less than n^2 of the providers.
--
And what are we doing when the two most powerful nations on earth -- America and Israel -- stomp on the elementary rights of human beings?
-- letter to the editor from W. Ostermeier, Liechtenstein
|
Post #197,221
3/4/05 2:52:36 PM
|
If n^2 holds for users...
then if one network is, say, 30% larger than another, people should find it fairly easy to decide to switch in droves.
In the real world this doesn't seem to happen.
Why not?
Cheers, Ben
I have come to believe that idealism without discipline is a quick road to disaster, while discipline without idealism is pointless. -- Aaron Ward (my brother)
|
Post #197,232
3/4/05 3:37:26 PM
|
Switching is not same as joining
60% gain may not justify the switch if it's costly for the user. In any case, there has to be a reason for _the_particular_user_ to switch. We're entering into micro-level here, and formulae do not apply.
However, when I consider joining a new network, the one larger by 30% wins hands down, all other things being equal.
--
And what are we doing when the two most powerful nations on earth -- America and Israel -- stomp on the elementary rights of human beings?
-- letter to the editor from W. Ostermeier, Liechtenstein
|
Post #197,438
3/7/05 4:21:04 AM
|
Larger by 30% wins?
Suppose that you're comparing company A, much smaller but has very good penetration in your area, with company B, new to your area but much larger (their home base is, say, Japan). Which do you prefer? Odds are that you prefer A, because most of the people that you care about are going to be on that network. Despite company B having more people, you're not going to experience more value there. If you think carefully about that hypothetical, the heart of our criticism of Metcalfe's law is right there. Incidentally I think that the following paragraph is key: Metcalfe's Law is intuitively appealing, since our personal estimate of the size of a network is based on uptake of that network among friends and family. Our derived value also varies directly with the metric. We therefore see a linear relationship between the perceived size and value of that network. Of course this intuition leads us astray because we do not percieve the vast majority of the network, and therefore have bad intuition of what its true size is. Cheers, Ben
I have come to believe that idealism without discipline is a quick road to disaster, while discipline without idealism is pointless. -- Aaron Ward (my brother)
|
Post #197,458
3/7/05 9:26:01 AM
|
I guess I should re-read
I have to agree with you that when we say "size of network" we mean, most of the time, "number of people I want to connect to on network". But that would simply lead to change of "n" in "n^2". I'll have to re-read for comprehension :) and figure out how you get from the "the heart of our criticism" to n log n.
--
And what are we doing when the two most powerful nations on earth -- America and Israel -- stomp on the elementary rights of human beings?
-- letter to the editor from W. Ostermeier, Liechtenstein
|
Post #197,475
3/7/05 11:23:39 AM
|
Read section 4
We present several arguments suggesting n log(n). The one that you want is in section 4.
Zipf's law says that the value of the n'th thing tends to be 1/n times the value of the first. This has been found to apply in a wide range of different areas. (Personal wealth, size of cities, etc.) If this holds for the potential value of connections over networks, and the value of the most important connections is fixed by the medium and human nature, then the average value from being in a network is the value of the most valuable times (1 + 1/2 + ... + 1/n) which scales as log(n). Over n people this totals n log(n).
Cheers, Ben
I have come to believe that idealism without discipline is a quick road to disaster, while discipline without idealism is pointless. -- Aaron Ward (my brother)
|
Post #197,487
3/7/05 12:26:30 PM
3/7/05 12:26:44 PM
|
There's your example :-)
Odds are that you prefer A, because most of the people that you care about are going to be on that network. You asked for an example where the smaller network was more valuable. There it is.
===
Purveyor of Doc Hope's [link|http://DocHope.com|fresh-baked dog biscuits and pet treats]. [link|http://DocHope.com|http://DocHope.com]
Edited by drewk
March 7, 2005, 12:26:44 PM EST
|
Post #197,493
3/7/05 12:57:30 PM
|
More valuable to you, yes
More valuable across all members of the network? No.
Cheers, Ben
I have come to believe that idealism without discipline is a quick road to disaster, while discipline without idealism is pointless. -- Aaron Ward (my brother)
|
Post #197,011
3/3/05 11:18:45 AM
|
I have come to the conclusion...
That all rough estimates are rough for a reason, they streamline the variables considered as "known" and make many assumptions based on those "known" unknowns.
I'll agree the Metcalfe's, Reed's and Zipf are all flawed. They should not be used as the "Standard Reference" on decision making, but another piece of the puzzle called: Cost Containment.
Cost Containment(or lack-of) is what killed more dotcom-ers than anything else. As the the saying back then, "Cost is no object", even the VCs were buying into that mantra. Quoting an "unproven" law, that was showing the evident sharp edges, but ignoring them.
Time has taken its toll on Metcalfe's and Reed's, they aren't aging well. I'd be curious to know how well this paper is recieved, and the comments on it as well.
I like the format you chose, it made a very good read. I'd only change a few things in your proof (such as the (2n)2 thing... you are going to need to back that up more than you have, even though the Biblio exists, it would help to have it in the paper keep the chain-of-thought/proof going. But then, too much and it becomes drool.
Nice job overall. Like I said, it did make a good read.
-- [link|mailto:greg@gregfolkert.net|greg], [link|http://www.iwethey.org/ed_curry|REMEMBER ED CURRY!] @ iwethey[link|http://it.slashdot.org/comments.pl?sid=134485&cid=11233230|"Microsoft Security" is an even better oxymoron than "Military Intelligence"] No matter how much Microsoft supporters whine about how Linux and other operating systems have just as many bugs as their operating systems do, the bottom line is that the serious, gut-wrenching problems happen on Windows, not on Linux, not on Mac OS. -- [link|http://www.eweek.com/article2/0,1759,1622086,00.asp|source]
|
Post #197,062
3/3/05 4:34:01 PM
3/3/05 10:48:07 PM
|
Re: Paper.
Structurally, the paper appears to make use of the n log(n) rule in the Introduction well before establishing that it is reasonable. You need to make it more obvious that you intend to justify it's use. The justification for the rule itself, done later, is done well.
The comment about Kilkki and Kalervo making a "first step towards modeling..." seems pretentious. :)
Considering the overall content it's a good paper.
One thing that may be worth looking at is the consumer cost of unlimited local phone service based on the number of phones in the service area. Generally, phone company rates for local service do factor in the number of "local" phones that can be called. Unfortunately, other factors like geographical density of phones and infrastructure economies of scale creep in. Anyway, it seems like a real world example of pricing based on perceived network value being offered.
[edit typos]
Alex
The trouble with the world is that the stupid are cocksure and the intelligent are full of doubt. -- Bertrand Russell
Edited by a6l6e6x
March 3, 2005, 10:48:07 PM EST
|
Post #197,123
3/4/05 12:03:27 AM
|
Something else I just realized
You mentioned a few times in the paper the dotcoms with their hockey-stick projections, and how they frequently went bust. Most of the money going into the boom was chasing the idea -- promoted heavily by the geeks with the "business plans" -- that this "internet thing" was something new in the world of business. To the extent that they were relying on Metcalf's Law, they were overlooking something that any MBA will probably tell you he had figured out by junior high: popularity matters.
Oh sure, we can dress it up in all the academic language we want: social network, affinity, gravity law, information locality. But Zipf's Law is the one that really touches on the heart of it, popularity. Some connectoins are more popular than others.
Metcalf, in describing the value of a connection, did what any good geek would do. He used the term "value" as synonymous with "utility". A network with more connections is more useful than one with fewer connections. But "value" is a measure of desire. How much does someone want something. A connection that is valuable to you may be worthless to me.
Maybe we can quantify how important popularity is. But is it actually a useul predictor of anything?
===
Purveyor of Doc Hope's [link|http://DocHope.com|fresh-baked dog biscuits and pet treats]. [link|http://DocHope.com|http://DocHope.com]
|
Post #197,130
3/4/05 1:14:02 AM
|
The mathematics is interesting and I presume . .
reasonably valid, but network scaling has little to do with the failure of most Dot.coms. Take the market exchanges which were going to match buyers and sellers and make a friction-free and highly efficient market. These folded up far faster than anyone involved could possibly have expected. Business inexperienced developers were certain people wanted to buy at the lowes price. This is false. Those who shop the lowest price are losers. What's important is existing business relationships. You only look for new ones when you have to. The established relationship is worth paying a higher price for (within limits, of course) because it provides other forms of efficiency. Businesses were interested in using the Internet to enhance and streamline existing relationships, and they didn't need the exchanges for that. Another thing so many expected was the death of the middleman - everyone would buy direct. Many still believed that even long after it was obvious the middlemen were the ones most benefitting from the Internet. Why, for instance, do I buy from Tech Data when I could buy directly from the manufacturers. A few reasons are: - The price is lower because Tech Data buys by negotiated contracts and they have negotiation power.
- Delivery is way faster, because delivery is Tech Data's specialty. Most manufacturers take days, even weeks to ship rather than about an hour.
- Availability is better because their warehousing smooths out productions runs.
- I only have to establish a business relationship with one company, not 450 companies each with different requirements and credit applications.
- I can make one phone call and order products made by ten, or fifty different manufacturers, not ten or fifty phone calls for one product each.
- I can write one check to cover the purchase of many different items.
- I know what the return policies are and how to apply them - I know who to talk to when there's a problem.
For this I need an Internet based exchange service? I think not. Many other examples of stupid Dot.com thinking can be displayed for our amusement. The funniest though was the concept that you could sell goods at cost and get rich selling advertising on your site. Of couse you needed to build traffic so you could sell advertising so you had to advertise your site to build traffic. This resulted in a big circle jerk where all the Dot.coms were buying advertising with each other in hopes of generating enough traffic to sell advertising to each other. Alas, this perpetual motion machine leaked a lot faster than most due to complete lack of cost controls.
[link|http://www.aaxnet.com|AAx]
|
Post #197,219
3/4/05 2:50:50 PM
|
Mostly true
What you're saying is all true (and I'll send back comments to Andrew about it), but there are notable exceptions. For instance one of the companies that was trying to create a frictionless market happened to be a site named AuctionWeb that was hosted at [link|http://www.ebay.com/|http://www.ebay.com/].
It didn't exactly fold. ;-)
Cheers, Ben
I have come to believe that idealism without discipline is a quick road to disaster, while discipline without idealism is pointless. -- Aaron Ward (my brother)
|
Post #197,223
3/4/05 3:07:47 PM
|
Andrew's obviously talking B2B
Interesting statistic would be: what percentage of commerce is B2B vs B2C? If, for instance, B2B makes up 80% of all commerce, existing relationships and single points of contact will be much more valuable than lowest price.
===
Purveyor of Doc Hope's [link|http://DocHope.com|fresh-baked dog biscuits and pet treats]. [link|http://DocHope.com|http://DocHope.com]
|
Post #197,249
3/4/05 6:06:53 PM
3/4/05 6:08:19 PM
|
My very favorite was a B to C
WebVan, an online grocer. They deliberately and firmly refused to have anyone in the company from the "old economy". With no exerienced buyers they were paying a lot more for everything than established grocers, and with nobody who knew anything about warehousing and distribution they ran through an incredible amount of money in an incredibly short time. I guess that's what the "new economy" was all about, but it's old now.
I have one of their refrigerator magnets and the liquidator's auction catalog around here somewhere.
[link|http://www.aaxnet.com|AAx]
|
Post #197,441
3/7/05 4:27:27 AM
|
Oops!
I have come to believe that idealism without discipline is a quick road to disaster, while discipline without idealism is pointless. -- Aaron Ward (my brother)
|
Post #197,440
3/7/05 4:26:36 AM
|
I don't know the breakdown...
but I think that I've seen claims that most business is business to business.
Certainly that's been true of every job that I've had, it has all been companies that were business to business. (Some consumers may have thought that Rent.com was doing business with them, but we weren't. Like in advertising, consumers are product, not customers. Though obviously we can't actually treat them as product and still successfully deliver them...)
Cheers, Ben
I have come to believe that idealism without discipline is a quick road to disaster, while discipline without idealism is pointless. -- Aaron Ward (my brother)
|
Post #197,245
3/4/05 5:50:13 PM
|
But it isn't exactly frictionless . . .
Seems there's a fair amount of friction between eBay and their sellers with this year's annual fee increase (and they've had to back off a little on some fees).
[link|http://www.aaxnet.com|AAx]
|
Post #197,439
3/7/05 4:23:25 AM
|
True but...
that's far less friction than used to exist in the same market. It is like comparing moving a puck across sandpaper as opposed to air hockey. Sure, there is friction in air hockey, the puck will not travel forever, but compared to sandpaper it might as well not be there!
Cheers, Ben
I have come to believe that idealism without discipline is a quick road to disaster, while discipline without idealism is pointless. -- Aaron Ward (my brother)
|
Post #235,519
11/22/05 11:29:44 AM
|
Ben, do you mind if I cite this for a paper?
I have a presentation tomorrow, and an essay to hand in next week, and would like to use this paper as part of my background for the talk and paper.
--\n-------------------------------------------------------------------\n* Jack Troughton jake at consultron.ca *\n* [link|http://consultron.ca|http://consultron.ca] [link|irc://irc.ecomstation.ca|irc://irc.ecomstation.ca] *\n* Kingston Ontario Canada [link|news://news.consultron.ca|news://news.consultron.ca] *\n-------------------------------------------------------------------
|
Post #235,600
11/22/05 10:20:54 PM
|
You can cite this, if unpublished papers are acceptable
Many professors want published stuff. We intend to do that eventually, but I haven't had time, and Andrew has been busy on other stuff.
Cheers, Ben
I have come to believe that idealism without discipline is a quick road to disaster, while discipline without idealism is pointless. -- Aaron Ward (my brother)
|
Post #235,675
11/23/05 11:40:41 AM
|
No, it works as it's on the net
so it is published, at least for the purposes of this course. Might be different for some other courses, but this in this one we're given a pretty long leash.
Anyhoo, the presentation on it is in three hours, so I gotta go. Thanks.
--\n-------------------------------------------------------------------\n* Jack Troughton jake at consultron.ca *\n* [link|http://consultron.ca|http://consultron.ca] [link|irc://irc.ecomstation.ca|irc://irc.ecomstation.ca] *\n* Kingston Ontario Canada [link|news://news.consultron.ca|news://news.consultron.ca] *\n-------------------------------------------------------------------
|