Assignment 7

This assignment is worth 50 points.

Write a program which will analyze a text document.

When you have finished this assignment, you should have:

Developed an efficient program employing appropriate algorithms and data structures.
Demonstrated you ability to used data and file structures.

Implement a program which can read text from a file, classify the words and count their use frequency. For this program, a word consists of a contiguous collection of letters, surrounded by white space. We will not allow words such as contraction (don't is not a word ), or words with digits in them (BR549, NCC-1701 are not words), and we will not allow hyphenated words (low-budget is not a word). You do not need to decide if a sequence of characters is a word, if it meets the above criteria, it is a word ( kajigger is a word ). You may need to remove punctuation from a word (hello! should be hello). Punctuation is only one character and is in the set {., !, ,, ?} any other terminating character yields a non-word.

Words are surrounded by white space, so the stream extraction operator will be sufficient for extracting words from a file. You may, however, have to decided if a set of input is a word (according to the above definition). For the purposes of this program, please reduce all words to lower case. (World is the same as world).

Your program should request the name of a text file and should present the user with the following information and abilities:

Print the total number of "words" in the file.
Print the number of distinct words.
Print the top ten most frequently occurring words.
Allow the user to search for a word, if found, print out the word's frequency in the document.
Allow the user to print out all words occurring with a given frequency.

Your program should be well written, and modular in design. It should be well documented.

In addition to your code, please submit a report which

Describes all data structures used in the program. Justify your selection of each data structure.
Describes data organization within your program. Justify your selection of data organization.
Describes all algorithms used in your program. Provide expected performance for each user task, including initial data processing.
Describe any difficulties, problems, or discoveries encountered while constructing this program.

In the appendix to your report, please include

A design document
A test plan

Please be advised, the input files might be quite large.

You may use the standard template library list class and vector class, but no other containers. You may not use any functions from the algorithms library.

You should use other tools, if necessary in your analysis.

You should submit your code via email to danbennett360@gmail.com on the due date. Submit your report in class.