Please start any new threads on our new site at https://forums.sqlteam.com. We've got lots of great SQL Server experts to answer whatever question you can come up with.

 All Forums
 SQL Server 2000 Forums
 SQL Server Development (2000)
 Finding word frequency within a text field

Author  Topic 

AskSQLTeam
Ask SQLTeam Question

0 Posts

Posted - 2001-05-06 : 14:32:49
Bryan writes "Hello SQL Team. How do I enable SQL to generate a word-frequency count on all words contained in a text field on a full-text query on SQL Server 2000?

For example, if I full text query on "microsoft", I want to generate a list of words occuring, sorted by frequency (rank would be better), within that resultset (ignoring noise words).

word          freq.
*******************
sql 60
olap 55
index 35
microsoft 25
xml 15
spam 10
foo 5
bar 1


A lookup table would not do much good since the data is highly dynamic and we're not always sure what the words will be. Plus, I would like to be able to drill down even further using these subequent keywords.

e.g.:
microsoft--->sql
microsoft--->sql--->queries
microsoft--->sql--->queries--->joins
microsoft--->sql--->queries--->joins--->inner

We load our data using DTS on a nightly process and update our fulltext catalogs accrodingly.

I've done my best to search Books Online and FAQ's but have wound up empty handed. Assume I am very familiar with full-text queries and string functions.

Thanks in advance for your help!

database: SQL Server 2K
Windows: NT Server
Virtual Mem: 3GB

-B"
   

- Advertisement -