Changelog

The page lists changes to the summary database, newest first.

You can follow the history of this schema using the git history of lib-unobtanium/src/database/summary/initalize.rs.

0.2.0-token-index-try-2.1

• Added is_noramlized field to token_v2 table

Tagged in commit

0.2.0-token-index-try-2.0

• Enabled foregin key checking
• Changed occurances field in token_statistics to hold weighted occurances
• Added token_text table
• Added token_normalization table
• Added token_v2 table
• Removed token table
• Renamed all token_id fields to token_v2_id

Tagged in commit

0.0.0-textrank-preview.2 alias 0.1.0

• Removed full_text_entity_index fts5 table
• Added unnormal_token table
• Added relevant_segments field to text_pile_v0_2 table
• Added token_language_enl field to token table
  • Added token_language_enl to the already existing UNIQUE(unnormal_text)
• Added token_idf table
• Renamed all text_pile_id fields to text_pile_v0_2_id

Tagged in commit

0.0.0-textrank-preview.1

• Removed text_pile table

Tagged in commit

0.0.0-textrank-preview.0

• Adds the text_pile_v0_2 table to introduce and test Text Pile Gen2

Tagged in commit

0.0.0 - The first versioned (stable)

This is the first versioned and documented version of this database.

This schema is released with unobtanium 3.0.0.

Tagged in commit