Test Set for Summarization Techniques

Regina Barzilay and Michael Elhadad

This page provides the result of our experiments in developing text summarizing algorithm using lexical chains. The specific technique used here is described in Using Lexical Chains for text Summarization (Regina Barzilay and Michael Elhadad, in Proceedings of the Intelligent Scalable Text Summarization Workshop (ISTS'97), ACL, Madrid, 1997). A more detailled description is presented in Regina Barzilay's MSc thesis. Detailled evaluation of the method is available in Summarization Evaluation Methods: Experiments and Analysis (Jing, Barzilay, McKeown and Elhadad, AAAI Symposium on Intelligent Summarization, March 23-25, 1998, Stanford University, CA).

For each text,we give the results of 3 variants of our algorithm and the intermediate data showing segmentation and lexical chains in a visual manner. The results include the following information:

Note that the algorithm also identifies noun-compounds using a shallow grammar of English. Noun-compounds are identified with their heads in the search for lexical relations in WordNet. All the results are obtained using WordNet 1.5.

Text 1: Testing.Testing

(The Economist 96)

Text 2: The cutting edge

(Los Angeles Times 96)

Text 3: Partying post-op

(The Economist 96)

Text 4: A shortage of sirs

(The Economist 96)

Text 5: What Does Fundamentalism Really Mean?

(The Islamic Harold 95)

Text 6: Handing out the rations

(The Economist 96)

Text 7: Water on the moon

(The Economist 96)

Text 8: A Discerning Eye

(Scientific American 96)

Text 9: Attack of the Killer Neutrinos

(The Economist 96)

Text 10: Amateur night

(The Economist 96)

Text 11: Hello,Dolly

(The Economist 96)

Text 12: The weirdest computer of all

(The Economist 96)

Text 13: News

(Reuters 97)

Text 14: What boys and girls are made of

(The Economist 97)

Text 15: Quantum computer

Text 16: Pressure

(Scientific American 96)

Text 17: How to pay for the NHS

(The Economist 97)

Text 18: Wine

(Wall Street Journal)

Text 19: Breaking the brain barrier

(The Economist 97)

Text 20: Cue the qubits

(The Economist 96)

Text 21: News

(Reuter)

Text 22: The genetic illusion

(The Economist 96)

Text 23: Courting abuse

(The Economist 97)

Text 24: Hope

(The Economist 96)