What computerized analysis of all the country’s school tests has done to education is exactly what Facebook has done to friendships. In both cases, life is turned into a database. Both degradations are based on the same philosophical mistake, which is the belief that computers can presently represent human thought or human relationships. These are things computers cannot currently do. Whether one expects computers to improve in the future is a different issue. In a less idealistic atmosphere it would go without saying that software should be designed only to perform tasks that can be successfully carried out at a given time. That is not the atmosphere in which Internet software is designed, however. When technologists deploy a computer model of something like learning or friendship in a way that has an effect on real lives, they are relying on faith. When they ask people to live their lives through their models, they are potentially reducing life itself.

Jaron Lanier, You Are Not a Gadget