Given 5 documents: D1, D2, D3, D4, D5 (see image 1) The dictionary consists of 8 words: w1= data, w2 = system, w3 = algorithm, w4 = computer, w5 = geometry, w6 = structure, w7 = analysis, w8 = organization PS: after stemming, “computer” is the same as “computational”, as well as “algorithms” and “algorithm”. (a) Give the value of tf(wi, Di) (b) Give the value of idf(wi) (c) Convert each document into an 8-dimensional point according to the tf-idf model as defined in image 2

MIS
9th Edition
ISBN:9781337681919
Author:BIDGOLI
Publisher:BIDGOLI
Chapter13: Intelligent Information Systems
Section: Chapter Questions
Problem 1AYRM
icon
Related questions
icon
Concept explainers
Question

Given 5 documents: D1, D2, D3, D4, D5 (see image 1)

The dictionary consists of 8 words: w1= data, w2 = system, w3 = algorithm, w4 = computer, w5 = geometry, w6 = structure, w7 = analysis, w8 = organization

PS: after stemming, “computer” is the same as “computational”, as well as “algorithms” and “algorithm”.

(a) Give the value of tf(wi, Di)

(b) Give the value of idf(wi)

(c) Convert each document into an 8-dimensional point according to the tf-idf model as defined in image 2.

document words
D1
D2
D3
D4
D5
Data Base System Concepts
Introduction to Algorithms
Computational Geometry: Algorithms and Applications
Data Structures and Algorithm Analysis on Massive Data Sets
Computer Organization
Transcribed Image Text:document words D1 D2 D3 D4 D5 Data Base System Concepts Introduction to Algorithms Computational Geometry: Algorithms and Applications Data Structures and Algorithm Analysis on Massive Data Sets Computer Organization
tf-idf weighting
• The tf-idf weight of a term is the product of its tf weight and its idf
weight.
N
Wt.a =
(1+ log(tft,a))×log(-
df'
Transcribed Image Text:tf-idf weighting • The tf-idf weight of a term is the product of its tf weight and its idf weight. N Wt.a = (1+ log(tft,a))×log(- df'
Expert Solution
trending now

Trending now

This is a popular solution!

steps

Step by step

Solved in 4 steps

Blurred answer
Knowledge Booster
Concepts in designing Database
Learn more about
Need a deep-dive on the concept behind this application? Look no further. Learn more about this topic, computer-science and related others by exploring similar questions and additional content below.
Similar questions
  • SEE MORE QUESTIONS
Recommended textbooks for you
MIS
MIS
Computer Science
ISBN:
9781337681919
Author:
BIDGOLI
Publisher:
Cengage