Search icon
Subscription
0
Cart icon
Close icon
You have no products in your basket yet
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Lucene 4 Cookbook

You're reading from  Lucene 4 Cookbook

Product type Book
Published in Jun 2015
Publisher
ISBN-13 9781782162285
Pages 220 pages
Edition 1st Edition
Languages
Authors (2):
Edwood Ng Edwood Ng
Profile icon Edwood Ng
Vineeth Mohan Vineeth Mohan
Profile icon Vineeth Mohan
View More author details

Table of Contents (16) Chapters

Lucene 4 Cookbook
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Preface
1. Introducing Lucene 2. Analyzing Your Text 3. Indexing Your Data 4. Searching Your Indexes 5. Near Real-time Searching 6. Querying and Filtering Data 7. Flexible Scoring 8. Introducing Elasticsearch 9. Extending Lucene with Modules Index

Implementing the divergence from randomness model


In Lucene, divergence from randomness model is implemented as DFRSimilarity. It's made up of three components: BasicModel, AfterEffect, and Normalization. BasicModel is a model of information content, AfterEffect is the first normalization, and Normalization is second (length) normalization. Here is an excerpt from Lucene's Javadoc on DFRSimilarity's components:

  1. BasicModel: This is a basic model of information content:

    • BasicModelBE: This is the limiting form of Bose-Einstein

    • BasicModelG: This is the geometric approximation of Bose-Einstein

    • BasicModelP: This is the Poisson approximation of the Binomial

    • BasicModelD: This is the divergence approximation of the Binomial

    • BasicModelIn: This is the inverse document frequency

    • BasicModelIne: This is the inverse expected document frequency (mixture of Poisson and IDF)

    • BasicModelIF: This is the inverse term frequency (approximation of I(ne))

  2. AfterEffect: This is the first normalization of information...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime}